-- Logs begin at Wed 2022-09-14 19:01:16 UTC, end at Wed 2022-09-14 20:14:29 UTC. -- Sep 14 19:32:37.402816 dv-cinder-839768-8-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 14 19:32:37.410169 dv-cinder-839768-8-smb devstack@keystone.service[93531]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 14 19:32:37.415565 dv-cinder-839768-8-smb devstack@keystone.service[93531]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 14 19:32:37 2022] *** Sep 14 19:32:37.415565 dv-cinder-839768-8-smb devstack@keystone.service[93531]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 14 19:32:37.415565 dv-cinder-839768-8-smb devstack@keystone.service[93531]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 14 19:32:37.415565 dv-cinder-839768-8-smb devstack@keystone.service[93531]: nodename: dv-cinder-839768-8-smb Sep 14 19:32:37.415565 dv-cinder-839768-8-smb devstack@keystone.service[93531]: machine: x86_64 Sep 14 19:32:37.415565 dv-cinder-839768-8-smb devstack@keystone.service[93531]: clock source: unix Sep 14 19:32:37.415565 dv-cinder-839768-8-smb devstack@keystone.service[93531]: pcre jit disabled Sep 14 19:32:37.415565 dv-cinder-839768-8-smb devstack@keystone.service[93531]: detected number of CPU cores: 4 Sep 14 19:32:37.415565 dv-cinder-839768-8-smb devstack@keystone.service[93531]: current working directory: / Sep 14 19:32:37.415565 dv-cinder-839768-8-smb devstack@keystone.service[93531]: detected binary path: /usr/bin/uwsgi-core Sep 14 19:32:37.415565 dv-cinder-839768-8-smb devstack@keystone.service[93531]: your processes number limit is 47680 Sep 14 19:32:37.415565 dv-cinder-839768-8-smb devstack@keystone.service[93531]: your memory page size is 4096 bytes Sep 14 19:32:37.415565 dv-cinder-839768-8-smb devstack@keystone.service[93531]: detected max file descriptor number: 2048 Sep 14 19:32:37.415565 dv-cinder-839768-8-smb devstack@keystone.service[93531]: lock engine: pthread robust mutexes Sep 14 19:32:37.415565 dv-cinder-839768-8-smb devstack@keystone.service[93531]: thunder lock: enabled Sep 14 19:32:37.415565 dv-cinder-839768-8-smb devstack@keystone.service[93531]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 14 19:32:37.415565 dv-cinder-839768-8-smb devstack@keystone.service[93531]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 14 19:32:37.453639 dv-cinder-839768-8-smb devstack@keystone.service[93531]: Python main interpreter initialized at 0x558713d9b9c0 Sep 14 19:32:37.453639 dv-cinder-839768-8-smb devstack@keystone.service[93531]: python threads support enabled Sep 14 19:32:37.453639 dv-cinder-839768-8-smb devstack@keystone.service[93531]: your server socket listen backlog is limited to 100 connections Sep 14 19:32:37.453639 dv-cinder-839768-8-smb devstack@keystone.service[93531]: your mercy for graceful operations on workers is 90 seconds Sep 14 19:32:37.453993 dv-cinder-839768-8-smb devstack@keystone.service[93531]: mapped 403077 bytes (393 KB) for 2 cores Sep 14 19:32:37.454067 dv-cinder-839768-8-smb devstack@keystone.service[93531]: *** Operational MODE: preforking *** Sep 14 19:32:37.454346 dv-cinder-839768-8-smb devstack@keystone.service[93531]: *** uWSGI is running in multiple interpreter mode *** Sep 14 19:32:37.454346 dv-cinder-839768-8-smb devstack@keystone.service[93531]: spawned uWSGI master process (pid: 93531) Sep 14 19:32:37.454546 dv-cinder-839768-8-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 14 19:32:37.457395 dv-cinder-839768-8-smb devstack@keystone.service[93531]: spawned uWSGI worker 1 (pid: 93544, cores: 1) Sep 14 19:32:37.457395 dv-cinder-839768-8-smb devstack@keystone.service[93531]: spawned uWSGI worker 2 (pid: 93545, cores: 1) Sep 14 19:32:37.457395 dv-cinder-839768-8-smb devstack@keystone.service[93531]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 14 19:32:41.820343 dv-cinder-839768-8-smb devstack@keystone.service[93545]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 19:32:41.820343 dv-cinder-839768-8-smb devstack@keystone.service[93545]: from cryptography.utils import int_from_bytes Sep 14 19:32:41.821093 dv-cinder-839768-8-smb devstack@keystone.service[93544]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 19:32:41.821093 dv-cinder-839768-8-smb devstack@keystone.service[93544]: from cryptography.utils import int_from_bytes Sep 14 19:32:41.821503 dv-cinder-839768-8-smb devstack@keystone.service[93545]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 19:32:41.821503 dv-cinder-839768-8-smb devstack@keystone.service[93545]: from cryptography.utils import int_from_bytes Sep 14 19:32:41.821613 dv-cinder-839768-8-smb devstack@keystone.service[93544]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 19:32:41.821613 dv-cinder-839768-8-smb devstack@keystone.service[93544]: from cryptography.utils import int_from_bytes Sep 14 19:32:41.870831 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 19:32:41.870999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 19:32:41.871083 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 19:32:41.871173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 19:32:41.871252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] command line args: [] {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 19:32:41.871323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] command line args: [] {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 19:32:41.871472 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 19:32:41.871576 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 19:32:41.871667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ================================================================================ {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 19:32:41.871746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ================================================================================ {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 19:32:41.871923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] admin_token = **** {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.872008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] admin_token = **** {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.872175 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] config_dir = [] {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.872259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] config_dir = [] {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.872367 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.872459 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.872559 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] config_source = [] {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.872690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] config_source = [] {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.872775 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] debug = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.872848 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] debug = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.872929 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.873175 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.873272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.873338 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.873454 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.873548 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.873707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.873784 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.873956 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.874021 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.874186 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] list_limit = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.874251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] list_limit = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.874368 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] log_config_append = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.874439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] log_config_append = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.874541 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.874614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.874720 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] log_dir = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.874785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] log_dir = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.874896 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] log_file = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.874959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] log_file = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.875199 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.875275 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.875378 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.875456 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.875656 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.875755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.875905 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.875997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.876081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.876156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.876246 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.876327 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.876494 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.876581 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.876742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.876826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.876975 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.877057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.877209 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.877303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.877441 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.877514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.877673 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.877755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.877917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.878002 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.878161 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.878232 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.878441 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.878524 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.878935 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.879025 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.879097 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] publish_errors = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.879204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] publish_errors = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.879331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.879413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.879576 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.879665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.879758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.879844 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.880006 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.880109 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.880239 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.880321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.880474 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] standard_threads = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.880549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] standard_threads = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.880705 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.880779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.880948 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.881031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.881123 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.881198 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.881299 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] use_journal = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.881379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] use_journal = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.882006 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] use_json = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.882101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] use_json = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.882224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] use_stderr = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.882296 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] use_stderr = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.882370 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] use_syslog = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.882475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] use_syslog = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.882589 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.882742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:41.882846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.882963 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.883085 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.883207 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.883348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.883473 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.883618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.883746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.883872 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.884002 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.884113 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.884245 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.884363 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.884499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.884625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.884739 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.884852 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.884991 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.885101 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.885243 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.885354 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.885494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.885595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.885733 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.885843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.886241 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.886324 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.886485 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.886559 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.886745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.886826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.886999 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.887074 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.887243 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.887328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.887502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.887612 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.887787 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.887872 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.888025 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.888108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.888270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.888352 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.888528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.888603 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.888779 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.888929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.889031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.889106 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.889263 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.889344 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.889496 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.889579 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.889726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.889802 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.889958 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.890032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.890200 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.890285 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.890446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.890521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.890679 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.890753 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.890911 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.891003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.891144 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.891218 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.891396 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.891470 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.891661 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.891755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.891902 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.891976 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.892134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.892209 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.892374 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.892490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.892611 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.892712 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.892845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.892983 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.893085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.893187 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.893288 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.893381 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.893515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.893590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.893749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.893839 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.893991 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.894066 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.894223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.894307 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.894463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.894547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.894719 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.894849 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.894928 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.894990 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.895159 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.895248 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.895400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.895479 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.895655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.895735 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.895897 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.895975 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.896136 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.896251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.896373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.896448 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.896612 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.896691 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.896849 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.896929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.897099 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.897787 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.897921 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.898009 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.898163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.898241 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.898401 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.898476 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.898636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.898728 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.898873 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.898997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.899125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.899208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.899358 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.899434 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.899614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.899695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.899854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.899940 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.900092 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.900168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.900354 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.900430 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.900600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.900675 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.900846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.900921 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.901090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.901169 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.901328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.901405 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.901566 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.901641 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.901808 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.901885 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.902047 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.902122 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.902286 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.902374 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.902526 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.902610 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.902765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.902841 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.903004 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.903080 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.903242 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.903325 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.903481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.903572 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.903744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.903820 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.903983 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.904067 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.904220 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.904295 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.904460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.904536 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.904711 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.904834 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.904958 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.905042 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.905198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.905279 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.905439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.905522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.905679 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.905754 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.905918 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.905995 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.906157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.906243 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.906395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.906470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.906625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.906700 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.906857 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.906944 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.907089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.907165 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.907321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.907396 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.907559 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.907649 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.907802 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.907877 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.908038 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.908113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.908275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.908378 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.908514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.908595 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.908754 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.908829 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.909015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.909099 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.909254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.909329 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.909487 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] auth.external = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.909576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.909718 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.909795 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] auth.external = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.909952 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.910035 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.910239 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.910315 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.910471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] auth.password = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.910547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.910703 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] auth.password = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.910786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] auth.token = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.910939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] auth.token = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.911015 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.911174 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.911250 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.911409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.911492 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.911667 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.911747 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.911909 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.911985 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.912157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.912245 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.912390 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.912475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.912627 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.912702 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] credential.caching = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.912894 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] credential.caching = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.913007 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.913146 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.913268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.913504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.913587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.913659 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.913736 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.913869 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.913984 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.914116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.914221 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.914355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.914469 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.914605 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.914724 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.914866 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.914971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.915109 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.915272 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.915353 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.915473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.915663 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.915742 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.915911 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.915990 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.916180 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.916264 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.916426 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.916503 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.916689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.916767 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] federation.caching = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.916929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] federation.caching = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.917005 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.917169 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.917245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.917415 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.917492 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.917648 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.917724 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.917883 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.917959 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.918122 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.918199 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.918363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.918438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.918599 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.918675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.918846 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.918931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.919082 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.919158 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.919329 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.919405 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.919581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] identity.caching = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.919662 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.919828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] identity.caching = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.919904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.920075 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.920161 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.920312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.920390 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.920546 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.920625 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.920781 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.920858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.921012 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.921089 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.921253 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.921347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.921495 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.921575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.921745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.921823 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.921976 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.922053 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.922208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.922291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.922439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.922524 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.922671 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.922748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.922915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.922991 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.923161 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.923239 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.923407 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.923483 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.923676 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.923758 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.923928 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.924006 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.924175 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.924251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.924414 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.924499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.924646 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.924723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.924881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.925022 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.925096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.925173 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.925337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.925414 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.925574 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.925650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.925814 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.925898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.926055 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.926137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.926284 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.926360 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.926532 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.926616 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.926780 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.926857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.927016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.927094 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.927250 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.927333 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.927497 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.927590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.927753 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.927829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.927991 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.928078 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.928219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.928296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.928979 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.929060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.929220 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.929439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.929568 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.929690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.929767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.929927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.930003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.930170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.930247 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.930413 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.930523 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.930668 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.930752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.930981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.931058 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.931232 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.931309 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.931479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.931608 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.931743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.931821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.931984 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.932060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.932257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.932348 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.932460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.user = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.932539 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.932699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.932775 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.932937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.user = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.933013 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.933178 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.933256 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.933429 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.933505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.933664 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.933739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.933915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.933992 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.934152 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.934230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.934382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.934460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.934619 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.934698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.934850 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.934926 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.935084 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.935160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.935315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.935393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.935563 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.935642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.935809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.935886 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.936060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.936139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.936307 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.936383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.936555 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.936632 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.936787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.936865 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.937034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.937111 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.937270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.937346 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.937505 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.937583 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.937742 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.937818 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.937978 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.938055 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.938215 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.938292 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.938453 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.938530 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.938688 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.938764 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.938943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.939021 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.939173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.939250 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.939418 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.939496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.939692 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.939771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.939928 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.940005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.940166 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.940243 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.940403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.940480 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.940645 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.940722 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.940876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.940959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.941113 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.941190 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.941347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.941423 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] resource.caching = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.941588 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.941673 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.941834 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] resource.caching = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.941911 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.942069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.942144 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.942325 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.942408 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.942564 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.942641 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.942798 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.942874 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.943045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.943131 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.943282 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.943363 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.943520 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.943646 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.943781 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] role.caching = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.943870 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.944073 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.944654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] role.driver = sql {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.944809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.945029 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] role.caching = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.945134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.945297 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.945375 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] role.driver = sql {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.945545 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.945621 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.945792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.945868 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.946040 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.946119 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.946287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.946364 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.946534 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.946610 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.946783 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.946861 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.947016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.947093 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.947263 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.947340 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.947509 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.947605 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.947772 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.947848 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.948018 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.948094 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.948267 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.948418 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.948519 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.948656 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.948771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.948909 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.949161 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.949238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.949399 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.949476 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.949651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.949734 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.949888 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.949965 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.950142 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.950218 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.950394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.950478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.950630 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.950706 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.950862 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.950938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.951095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.951179 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.951326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.951403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.951598 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.951679 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.951836 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.951923 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.952070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.952148 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.952322 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.952397 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.952558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.952643 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.952789 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.952866 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.953024 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] token.caching = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.953100 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.953259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.953344 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.953492 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.953567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.953729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.953805 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] token.caching = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.953966 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.954050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.954216 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.954298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.954452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.954528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.954698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.954823 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.954940 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.955017 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.955181 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.955258 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.955418 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.955502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.955686 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.955763 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.955922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.955997 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.956165 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.956253 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.956407 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.956484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.956644 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.956720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.956886 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.956971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.957152 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.957230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.957385 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.957469 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] database.connection = **** {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.957631 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.957709 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.957882 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.957958 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.958122 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.958200 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] database.connection = **** {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.958363 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.958440 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.958600 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.958677 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.958838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.958916 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.959073 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.959150 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.959308 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.959384 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.959606 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.959730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.959862 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.959990 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.960122 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.960244 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.960467 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.960551 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.960723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.960841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.960971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.961201 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.961287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.961453 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.961574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.961697 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.961946 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.962062 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.962170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.962309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.962414 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.962553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.962664 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:41.962752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 19:32:41.962825 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 19:32:41.992765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:41.992998 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:41.993228 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:41.997428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:41.997667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:41.997896 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.003423 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.006340 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.034998 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.035227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.035606 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.035845 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.098047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.103118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.152084 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.152259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.152351 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.152499 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.309347 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.309566 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.309763 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.309983 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.310201 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.310417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.312809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.313049 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.313277 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.313501 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.313722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.313942 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.343522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.343780 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.344017 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.344169 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.344253 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.344412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.344494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.344645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.344726 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.344870 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.344958 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.345093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.345314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.345535 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.357127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.357398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.370201 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.370367 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.370440 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.371021 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.375827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.375938 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.376051 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.376148 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.376216 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.376278 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.376356 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.376420 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.376479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.376538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 19:32:42.392593 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.392811 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 19:32:42.392965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.393155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.393248 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 19:32:42.393361 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 19:32:42.393497 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.393644 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.393725 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 19:32:42.393915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.393995 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.394182 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.394288 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.394444 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.394524 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.394722 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.404733 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.405028 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.405137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.405304 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.405439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.405598 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.405679 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.405962 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.412603 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.413324 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.415691 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.415987 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.416228 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.416310 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.416516 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.416598 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.416807 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.416897 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.417087 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.417167 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.417365 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.417445 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.417625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.417714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.417898 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.417994 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.418183 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.418274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.418457 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.418538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.418817 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.419091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.441634 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.442649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.443113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.443415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.444664 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.445097 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.448736 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.449026 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.449318 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.450237 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.450526 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.450810 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.455797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.456094 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.457241 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.457532 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.462379 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.462687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.463000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.463289 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.463603 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.463897 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.464120 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.464249 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.464417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.464498 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.464711 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.465002 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.465281 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.465557 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.465830 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.466101 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.479916 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.487072 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.487207 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.487207 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.487395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.487465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.487536 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.487536 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.488979 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.489279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.491748 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.493558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.494934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.496761 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.498190 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.498501 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.498798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.499094 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.499381 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.499719 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.500023 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.500326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.500615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.500902 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.501192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.501486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.516573 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.516864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.517142 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.517414 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.518500 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.518793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.519066 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.519334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.524448 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.526012 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.526535 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.527560 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.527851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.528098 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.529692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.529967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.530590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.530890 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.531178 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.531463 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.531888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.532738 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.533028 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.533320 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.533607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.533997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.543638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.543927 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.544217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.544510 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.544900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.545204 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.545500 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.545755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.546043 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.546328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.546617 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.547105 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.547403 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.547719 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.560957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.563914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.564008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.566836 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.566926 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.568344 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.570451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.570618 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.570905 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.571319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.571976 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.573445 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.573730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.574125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.577711 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.579172 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.580627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.582110 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.582225 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.582509 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.582806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.583097 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.585137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.585531 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.585821 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.586105 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.591038 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.591341 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.593001 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.593982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.594275 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.594560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.598537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.598824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.599116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.599401 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.599714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.599995 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.600275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.601084 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.601369 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.601661 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.601948 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.602216 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.602488 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.602568 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 19:32:42.602773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.602850 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.603059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.603340 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.603639 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.603916 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.604191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.604528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.604836 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.605121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.605404 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.605686 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.605980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.606266 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 19:32:42.638165 dv-cinder-839768-8-smb devstack@keystone.service[93544]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558713d9b9c0 pid: 93544 (default app) Sep 14 19:32:42.641365 dv-cinder-839768-8-smb devstack@keystone.service[93545]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558713d9b9c0 pid: 93545 (default app) Sep 14 19:32:42.641490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc082514-60e7-4f6a-bed8-f8327dc40289 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:32:42.641779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc082514-60e7-4f6a-bed8-f8327dc40289 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:32:42.642056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc082514-60e7-4f6a-bed8-f8327dc40289 None None] PATH_INFO: `/v3` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:32:42.646270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Wed Sep 14 19:32:42 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:32:50.531173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2109d-c2cd-4976-a171-33297145527d None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:32:50.531778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2109d-c2cd-4976-a171-33297145527d None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:32:50.531778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2109d-c2cd-4976-a171-33297145527d None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:32:50.535987 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:32:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:32:50.541981 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46fb42-8299-4ae7-bad9-f6d1a1f45c64 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:32:50.542496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46fb42-8299-4ae7-bad9-f6d1a1f45c64 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:32:50.542593 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46fb42-8299-4ae7-bad9-f6d1a1f45c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:32:50.613265 dv-cinder-839768-8-smb devstack@keystone.service[93544]: INFO dbcounter [None req-ea46fb42-8299-4ae7-bad9-f6d1a1f45c64 None None] Registered counter for database keystone Sep 14 19:32:50.634794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG oslo_db.sqlalchemy.engines [None req-ea46fb42-8299-4ae7-bad9-f6d1a1f45c64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:32:50.641293 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writer thread running {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 19:32:50.820548 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG passlib.handlers.bcrypt [None req-ea46fb42-8299-4ae7-bad9-f6d1a1f45c64 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=93544) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 14 19:32:50.820916 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG passlib.handlers.bcrypt [None req-ea46fb42-8299-4ae7-bad9-f6d1a1f45c64 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93544) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 14 19:32:50.878513 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-ea46fb42-8299-4ae7-bad9-f6d1a1f45c64 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:32:50.880130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ea46fb42-8299-4ae7-bad9-f6d1a1f45c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:32:51.007622 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:32:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 14 19:32:51.434923 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2109d-c2cd-4976-a171-33297145527d None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:32:51.504530 dv-cinder-839768-8-smb devstack@keystone.service[93545]: INFO dbcounter [None req-76e2109d-c2cd-4976-a171-33297145527d None None] Registered counter for database keystone Sep 14 19:32:51.525075 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG oslo_db.sqlalchemy.engines [None req-76e2109d-c2cd-4976-a171-33297145527d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:32:51.531275 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writer thread running {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 19:32:51.650912 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2109d-c2cd-4976-a171-33297145527d None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:32:51.655107 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf5629-b7b2-4fd4-8899-0e0d8b5a1af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:32:51.655760 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf5629-b7b2-4fd4-8899-0e0d8b5a1af3 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:32:51.656042 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf5629-b7b2-4fd4-8899-0e0d8b5a1af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:32:51.656315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf5629-b7b2-4fd4-8899-0e0d8b5a1af3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:32:51.664361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf5629-b7b2-4fd4-8899-0e0d8b5a1af3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:32:51.716671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: WARNING keystone.common.rbac_enforcer.enforcer [None req-36cf5629-b7b2-4fd4-8899-0e0d8b5a1af3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 14 19:32:51.717009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf5629-b7b2-4fd4-8899-0e0d8b5a1af3 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:32:51.726219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Wed Sep 14 19:32:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 19:32:51.732261 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46fb42-8299-4ae7-bad9-f6d1a1f45c64 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:32:51.749431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46fb42-8299-4ae7-bad9-f6d1a1f45c64 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:32:51.753831 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449913e-d232-4337-9429-34b8c69daa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:32:51.754954 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449913e-d232-4337-9429-34b8c69daa1e admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:32:51.755230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449913e-d232-4337-9429-34b8c69daa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:32:51.755496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449913e-d232-4337-9429-34b8c69daa1e admin admin] PATH_INFO: `/v3/projects/de7968443f1e4b4a80b77215071336a1` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:32:51.757138 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449913e-d232-4337-9429-34b8c69daa1e admin admin] RBAC: Authorizing `identity:get_project(project_id=de7968443f1e4b4a80b77215071336a1)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:32:51.812576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9449913e-d232-4337-9429-34b8c69daa1e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 14 19:32:51.812915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449913e-d232-4337-9429-34b8c69daa1e admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:32:51.817432 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Wed Sep 14 19:32:51 2022] GET /identity/v3/projects/de7968443f1e4b4a80b77215071336a1 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:32:53.950812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f85fec-0a85-4736-9c86-ac53b1f60329 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:32:53.951351 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f85fec-0a85-4736-9c86-ac53b1f60329 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:32:53.951351 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f85fec-0a85-4736-9c86-ac53b1f60329 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:32:53.955455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:32:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:32:53.960818 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9a328-1e90-44fe-927a-39234d162b81 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:32:53.961754 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9a328-1e90-44fe-927a-39234d162b81 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:32:53.962023 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9a328-1e90-44fe-927a-39234d162b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:32:53.982656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-cce9a328-1e90-44fe-927a-39234d162b81 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:32:53.984193 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-cce9a328-1e90-44fe-927a-39234d162b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:32:53.991934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:32:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 14 19:32:54.271200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f85fec-0a85-4736-9c86-ac53b1f60329 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:32:54.284001 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f85fec-0a85-4736-9c86-ac53b1f60329 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:32:54.288219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab883e-1b11-4efe-a2cd-08f23d1ffef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:32:54.288826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab883e-1b11-4efe-a2cd-08f23d1ffef3 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:32:54.289148 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab883e-1b11-4efe-a2cd-08f23d1ffef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:32:54.289490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab883e-1b11-4efe-a2cd-08f23d1ffef3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:32:54.297073 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab883e-1b11-4efe-a2cd-08f23d1ffef3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:32:54.298833 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab883e-1b11-4efe-a2cd-08f23d1ffef3 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:32:54.307561 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Wed Sep 14 19:32:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 19:32:54.312808 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9a328-1e90-44fe-927a-39234d162b81 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:32:54.322301 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9a328-1e90-44fe-927a-39234d162b81 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:32:54.326566 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e4ff5-2732-47ed-b8fb-5313f6e907ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:32:54.327191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e4ff5-2732-47ed-b8fb-5313f6e907ac admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:32:54.327466 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e4ff5-2732-47ed-b8fb-5313f6e907ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:32:54.327782 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e4ff5-2732-47ed-b8fb-5313f6e907ac admin admin] PATH_INFO: `/v3/users/10fb21e5e3c84511bf4f1b659ae7154b` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:32:54.329073 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e4ff5-2732-47ed-b8fb-5313f6e907ac admin admin] RBAC: Authorizing `identity:get_user(user_id=10fb21e5e3c84511bf4f1b659ae7154b)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:32:54.330878 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e4ff5-2732-47ed-b8fb-5313f6e907ac admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:32:54.332405 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Wed Sep 14 19:32:54 2022] GET /identity/v3/users/10fb21e5e3c84511bf4f1b659ae7154b => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:32:56.559193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80d81a-d3fb-47c9-a299-a6c557e4ad73 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:32:56.559738 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80d81a-d3fb-47c9-a299-a6c557e4ad73 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:32:56.559738 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80d81a-d3fb-47c9-a299-a6c557e4ad73 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:32:56.561231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:32:56.566220 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef71378-f6eb-46a2-8aab-dbe50331d1eb None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:32:56.566606 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef71378-f6eb-46a2-8aab-dbe50331d1eb None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:32:56.566896 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef71378-f6eb-46a2-8aab-dbe50331d1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:32:56.584899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-1ef71378-f6eb-46a2-8aab-dbe50331d1eb None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:32:56.586082 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1ef71378-f6eb-46a2-8aab-dbe50331d1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:32:56.614707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2a102-1dce-4a0f-aed0-1deaee635921 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:32:56.614993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2a102-1dce-4a0f-aed0-1deaee635921 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:32:56.615269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2a102-1dce-4a0f-aed0-1deaee635921 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:32:56.616628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:32:56.622597 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe876f1-48eb-457f-b46a-91ed79487a9d None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:32:56.622896 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe876f1-48eb-457f-b46a-91ed79487a9d None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:32:56.623238 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe876f1-48eb-457f-b46a-91ed79487a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:32:56.664005 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG passlib.handlers.bcrypt [None req-5fe876f1-48eb-457f-b46a-91ed79487a9d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=93545) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 14 19:32:56.664953 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG passlib.handlers.bcrypt [None req-5fe876f1-48eb-457f-b46a-91ed79487a9d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93545) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 14 19:32:56.669585 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:32:56.713773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-5fe876f1-48eb-457f-b46a-91ed79487a9d None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:32:56.715356 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-5fe876f1-48eb-457f-b46a-91ed79487a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:32:56.819078 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:32:56.937938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef71378-f6eb-46a2-8aab-dbe50331d1eb None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:32:56.963276 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:32:57.043773 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef71378-f6eb-46a2-8aab-dbe50331d1eb None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:32:57.079847 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7db35-7923-4a14-94bf-e9717d919afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:32:57.079847 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7db35-7923-4a14-94bf-e9717d919afa None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:32:57.079847 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7db35-7923-4a14-94bf-e9717d919afa None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:32:57.079847 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7db35-7923-4a14-94bf-e9717d919afa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:32:57.092918 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe876f1-48eb-457f-b46a-91ed79487a9d None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:32:57.148614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7db35-7923-4a14-94bf-e9717d919afa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:32:57.150605 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7db35-7923-4a14-94bf-e9717d919afa None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:32:57.173951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:32:57.192038 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe876f1-48eb-457f-b46a-91ed79487a9d None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:32:57.194261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:32:57.230349 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfe950-0722-4ee0-bf06-13d7e34f492a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:32:57.231464 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfe950-0722-4ee0-bf06-13d7e34f492a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:32:57.231798 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfe950-0722-4ee0-bf06-13d7e34f492a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:32:57.232048 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfe950-0722-4ee0-bf06-13d7e34f492a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:32:57.244267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfe950-0722-4ee0-bf06-13d7e34f492a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:32:57.249300 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 7/14] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:32:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:32:57.252791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-a5cfe950-0722-4ee0-bf06-13d7e34f492a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:32:57.252791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:32:57.252791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:32:57.252791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:32:57.252791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:32:57.252791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:32:57.252791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:32:57.252791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:32:57.252791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:32:57.252791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:32:57.252791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:32:57.252791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:32:57.252791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:32:57.252791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:32:57.252791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:32:57.252791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:32:57.253650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:32:57.253650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:32:57.253650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:32:57.253650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:32:57.253650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:32:57.253650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:32:57.253650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:32:57.253650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:32:57.253650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:32:57.253650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:32:57.253650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:32:57.253650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:32:57.253650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:32:57.253650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:32:57.253650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:32:57.253650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:32:57.254442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:32:57.254442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:32:57.254442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:32:57.254442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:32:57.254442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:32:57.254442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:32:57.254442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:32:57.254442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:32:57.254442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:32:57.254442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:32:57.254442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:32:57.254442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:32:57.254442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:32:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:32:57.255088 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7db35-7923-4a14-94bf-e9717d919afa None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:32:57.260032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfe950-0722-4ee0-bf06-13d7e34f492a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:32:57.353113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7db35-7923-4a14-94bf-e9717d919afa None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:32:57.357195 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfe950-0722-4ee0-bf06-13d7e34f492a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:32:57.379534 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:32:57.391976 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19959e08-1429-4a84-ac3a-da6ce566a947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:32:57.392622 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19959e08-1429-4a84-ac3a-da6ce566a947 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:32:57.392900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19959e08-1429-4a84-ac3a-da6ce566a947 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:32:57.393168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19959e08-1429-4a84-ac3a-da6ce566a947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:32:57.401134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b31eb-35cc-4ce2-933c-c84b0444e324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:32:57.401765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b31eb-35cc-4ce2-933c-c84b0444e324 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:32:57.402041 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b31eb-35cc-4ce2-933c-c84b0444e324 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:32:57.402417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b31eb-35cc-4ce2-933c-c84b0444e324 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:32:57.403101 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b31eb-35cc-4ce2-933c-c84b0444e324 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:32:57.403401 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b31eb-35cc-4ce2-933c-c84b0444e324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:32:57.403787 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19959e08-1429-4a84-ac3a-da6ce566a947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:32:57.405206 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b31eb-35cc-4ce2-933c-c84b0444e324 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:32:57.405336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19959e08-1429-4a84-ac3a-da6ce566a947 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:32:57.417965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 9/16] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:32:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:32:57.423685 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b31eb-35cc-4ce2-933c-c84b0444e324 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:32:57.423912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-19959e08-1429-4a84-ac3a-da6ce566a947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:32:57.423912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:32:57.423912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:32:57.423912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:32:57.423912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:32:57.423912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:32:57.423912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:32:57.423912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:32:57.423912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:32:57.423912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:32:57.423912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:32:57.423912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:32:57.423912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:32:57.423912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:32:57.423912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:32:57.423912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:32:57.424936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:32:57.424936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:32:57.424936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:32:57.424936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:32:57.424936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:32:57.424936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:32:57.424936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:32:57.424936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:32:57.424936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:32:57.424936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:32:57.424936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:32:57.424936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:32:57.424936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:32:57.424936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:32:57.424936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:32:57.424936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:32:57.424936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:32:57.425944 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:32:57.425944 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:32:57.425944 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:32:57.425944 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 8/17] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:32:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:32:57.431376 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19959e08-1429-4a84-ac3a-da6ce566a947 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:32:57.452489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:32:57.524659 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b31eb-35cc-4ce2-933c-c84b0444e324 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:32:57.532342 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19959e08-1429-4a84-ac3a-da6ce566a947 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:32:57.557453 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1f688-e00e-4bbe-ad73-f2153a863b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:32:57.558089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1f688-e00e-4bbe-ad73-f2153a863b93 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:32:57.558367 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1f688-e00e-4bbe-ad73-f2153a863b93 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:32:57.558642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1f688-e00e-4bbe-ad73-f2153a863b93 None admin] PATH_INFO: `/v3/users/10fb21e5e3c84511bf4f1b659ae7154b` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:32:57.560154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1f688-e00e-4bbe-ad73-f2153a863b93 None admin] RBAC: Authorizing `identity:get_user(user_id=10fb21e5e3c84511bf4f1b659ae7154b)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:32:57.561613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1f688-e00e-4bbe-ad73-f2153a863b93 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:32:57.563287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 10/18] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:32:57 2022] GET /identity/v3/users/10fb21e5e3c84511bf4f1b659ae7154b => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:32:57.566373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d0d75-53e1-4f1d-be2d-24e5a8b0ad21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:32:57.566986 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d0d75-53e1-4f1d-be2d-24e5a8b0ad21 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:32:57.567261 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d0d75-53e1-4f1d-be2d-24e5a8b0ad21 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:32:57.567528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d0d75-53e1-4f1d-be2d-24e5a8b0ad21 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:32:57.568196 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d0d75-53e1-4f1d-be2d-24e5a8b0ad21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:32:57.568496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d0d75-53e1-4f1d-be2d-24e5a8b0ad21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:32:57.568639 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1f688-e00e-4bbe-ad73-f2153a863b93 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:32:57.569860 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d0d75-53e1-4f1d-be2d-24e5a8b0ad21 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:32:57.588208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 9/19] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:32:57.668039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:32:57.674857 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1f688-e00e-4bbe-ad73-f2153a863b93 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:32:57.711887 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6f9a8-d917-4b85-aa5c-e6e0a7ec5719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:32:57.712462 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6f9a8-d917-4b85-aa5c-e6e0a7ec5719 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:32:57.712742 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6f9a8-d917-4b85-aa5c-e6e0a7ec5719 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:32:57.713014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6f9a8-d917-4b85-aa5c-e6e0a7ec5719 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:32:57.714218 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6f9a8-d917-4b85-aa5c-e6e0a7ec5719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:32:57.715740 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6f9a8-d917-4b85-aa5c-e6e0a7ec5719 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:32:57.717355 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 11/20] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:32:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:32:57.723648 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d0d75-53e1-4f1d-be2d-24e5a8b0ad21 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:32:57.763013 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:32:57.844671 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d0d75-53e1-4f1d-be2d-24e5a8b0ad21 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:32:57.881659 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e092ec-e4a2-48cb-b7fa-32c67b2a06bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:32:57.882360 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e092ec-e4a2-48cb-b7fa-32c67b2a06bc None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:32:57.882638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e092ec-e4a2-48cb-b7fa-32c67b2a06bc None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:32:57.882908 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e092ec-e4a2-48cb-b7fa-32c67b2a06bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:32:57.884219 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e092ec-e4a2-48cb-b7fa-32c67b2a06bc None admin] RBAC: Adding query filter params (role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a, scope.domain.id=default, user.id=10fb21e5e3c84511bf4f1b659ae7154b) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:32:57.884524 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e092ec-e4a2-48cb-b7fa-32c67b2a06bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:32:57.885988 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e092ec-e4a2-48cb-b7fa-32c67b2a06bc None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:32:57.893352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 10/21] 10.222.0.15 () {56 vars in 1322 bytes} [Wed Sep 14 19:32:57 2022] GET /identity/v3/role_assignments?user.id=10fb21e5e3c84511bf4f1b659ae7154b&scope.domain.id=default&role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 233 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:00.547335 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f19c4-cfcf-4f86-9acf-fc9f5c447dc6 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:00.547866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f19c4-cfcf-4f86-9acf-fc9f5c447dc6 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:00.547969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f19c4-cfcf-4f86-9acf-fc9f5c447dc6 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:00.549373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 12/22] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:00.554553 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47931be-ad90-479b-b647-e22d90e971ed None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:00.554937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47931be-ad90-479b-b647-e22d90e971ed None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:00.555098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47931be-ad90-479b-b647-e22d90e971ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:00.580557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-d47931be-ad90-479b-b647-e22d90e971ed None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:00.581761 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d47931be-ad90-479b-b647-e22d90e971ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:00.607387 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e14251-7d57-44dc-86ad-a37bbf0f8e6c None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:00.608017 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e14251-7d57-44dc-86ad-a37bbf0f8e6c None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:00.608502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e14251-7d57-44dc-86ad-a37bbf0f8e6c None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:00.610015 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 13/23] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:33:00.637175 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933c5fd-3503-44a2-9830-f91232861920 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:00.637748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933c5fd-3503-44a2-9830-f91232861920 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:00.638215 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933c5fd-3503-44a2-9830-f91232861920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:00.675516 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-5933c5fd-3503-44a2-9830-f91232861920 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:00.677115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-5933c5fd-3503-44a2-9830-f91232861920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:00.683024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 11/24] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:00.733139 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b5463-bf60-4db6-a9f4-97b8b6804e03 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:00.733764 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b5463-bf60-4db6-a9f4-97b8b6804e03 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:00.734252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b5463-bf60-4db6-a9f4-97b8b6804e03 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:00.738139 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 12/25] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:33:00.752263 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fcac4-97b4-4d02-81a0-110db237aace None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:00.752845 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fcac4-97b4-4d02-81a0-110db237aace None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:00.753321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fcac4-97b4-4d02-81a0-110db237aace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:00.791777 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-502fcac4-97b4-4d02-81a0-110db237aace None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:00.798071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-502fcac4-97b4-4d02-81a0-110db237aace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:00.806240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 14/26] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:33:00.850385 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:00.912136 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 13/27] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:33:01.139400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933c5fd-3503-44a2-9830-f91232861920 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:01.147063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fcac4-97b4-4d02-81a0-110db237aace None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:01.253221 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:01.268866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933c5fd-3503-44a2-9830-f91232861920 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:01.314256 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf242786-b1b3-439e-96ee-1b6890781323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:01.314875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fcac4-97b4-4d02-81a0-110db237aace None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:01.315358 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf242786-b1b3-439e-96ee-1b6890781323 None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:01.315863 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf242786-b1b3-439e-96ee-1b6890781323 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:01.316351 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf242786-b1b3-439e-96ee-1b6890781323 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:01.317251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf242786-b1b3-439e-96ee-1b6890781323 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:01.318923 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf242786-b1b3-439e-96ee-1b6890781323 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:01.351939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bf606-9c52-4c87-986a-545a0b51b9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:01.352798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bf606-9c52-4c87-986a-545a0b51b9b8 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:01.353174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bf606-9c52-4c87-986a-545a0b51b9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:01.353528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bf606-9c52-4c87-986a-545a0b51b9b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:01.363832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bf606-9c52-4c87-986a-545a0b51b9b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:01.365375 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bf606-9c52-4c87-986a-545a0b51b9b8 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:01.381155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-c18bf606-9c52-4c87-986a-545a0b51b9b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:33:01.381155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:01.381155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:01.381155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:01.381155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:01.381155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:01.381155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:01.381155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:01.381155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:01.381155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:01.381155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:01.381155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:01.381155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:33:01.381155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:33:01.381155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:33:01.381155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:33:01.382044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:01.382044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:01.382044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:01.382044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:01.382044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:01.382044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:01.382044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:01.382044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:01.382044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:01.382044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:01.382044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:01.382044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:01.382044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:01.382044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:01.382044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:01.382044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:01.382044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:33:01.382844 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:33:01.382844 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:33:01.382844 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:01.382844 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 14/28] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:33:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:33:01.384548 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6ad1b-49d1-4327-bcea-0b86859907b5 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:01.384916 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6ad1b-49d1-4327-bcea-0b86859907b5 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:01.385162 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6ad1b-49d1-4327-bcea-0b86859907b5 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:01.390889 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 15/29] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:01.390889 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6ad1b-49d1-4327-bcea-0b86859907b5 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:01.402953 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:01.498537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6ad1b-49d1-4327-bcea-0b86859907b5 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:01.524081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 15/30] 10.222.0.15 () {60 vars in 1131 bytes} [Wed Sep 14 19:33:01 2022] POST /identity/v3/roles => generated 225 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:33:01.527085 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf242786-b1b3-439e-96ee-1b6890781323 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:01.534329 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522ea48-3e6c-4af4-b5a5-6151f4b75b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:01.534969 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522ea48-3e6c-4af4-b5a5-6151f4b75b8d None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:01.544074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522ea48-3e6c-4af4-b5a5-6151f4b75b8d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:01.544415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522ea48-3e6c-4af4-b5a5-6151f4b75b8d None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:01.545378 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522ea48-3e6c-4af4-b5a5-6151f4b75b8d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:01.546811 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522ea48-3e6c-4af4-b5a5-6151f4b75b8d None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:01.655915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf242786-b1b3-439e-96ee-1b6890781323 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:01.697644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f73c3-0800-4b2e-bb83-249b2533ac06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:01.698644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f73c3-0800-4b2e-bb83-249b2533ac06 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:01.699145 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f73c3-0800-4b2e-bb83-249b2533ac06 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:01.699662 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f73c3-0800-4b2e-bb83-249b2533ac06 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:01.700528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f73c3-0800-4b2e-bb83-249b2533ac06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:01.701085 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f73c3-0800-4b2e-bb83-249b2533ac06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:01.702843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f73c3-0800-4b2e-bb83-249b2533ac06 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:01.738737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 16/31] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:01.740632 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f2204-a8ea-498f-95b4-aaf3f974a475 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:01.741213 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f2204-a8ea-498f-95b4-aaf3f974a475 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:01.741793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f2204-a8ea-498f-95b4-aaf3f974a475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:01.764205 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-ae7f2204-a8ea-498f-95b4-aaf3f974a475 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:01.766135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ae7f2204-a8ea-498f-95b4-aaf3f974a475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:01.776035 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:01.782463 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 16/32] 10.222.0.15 () {60 vars in 1131 bytes} [Wed Sep 14 19:33:01 2022] POST /identity/v3/roles => generated 219 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:33:01.783303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522ea48-3e6c-4af4-b5a5-6151f4b75b8d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:01.901466 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 17/33] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:01.902844 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:01.904901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad824f3d-e7b5-41b7-b2ac-3766a2d0e583 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:01.905200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad824f3d-e7b5-41b7-b2ac-3766a2d0e583 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:01.905477 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad824f3d-e7b5-41b7-b2ac-3766a2d0e583 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:01.906772 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 18/34] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:01.912988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb78801-61f8-44f2-acc5-f0adccd3f484 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:01.918204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb78801-61f8-44f2-acc5-f0adccd3f484 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:01.918204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb78801-61f8-44f2-acc5-f0adccd3f484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:01.946469 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-4bb78801-61f8-44f2-acc5-f0adccd3f484 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:01.947876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4bb78801-61f8-44f2-acc5-f0adccd3f484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:01.962790 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522ea48-3e6c-4af4-b5a5-6151f4b75b8d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:02.032516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8b6ed-e028-4e5c-9143-80dd9b883adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:02.033101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8b6ed-e028-4e5c-9143-80dd9b883adc None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:02.033385 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8b6ed-e028-4e5c-9143-80dd9b883adc None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:02.033663 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8b6ed-e028-4e5c-9143-80dd9b883adc None admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:02.034339 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8b6ed-e028-4e5c-9143-80dd9b883adc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:02.036006 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8b6ed-e028-4e5c-9143-80dd9b883adc None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:02.077096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 19/35] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:33:02.178526 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 17/36] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Sep 14 19:33:01 2022] POST /identity/v3/projects => generated 301 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:33:02.232181 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb78801-61f8-44f2-acc5-f0adccd3f484 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:02.238618 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad6c76-a7c9-4734-89fa-fb36506f298a None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:02.238906 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad6c76-a7c9-4734-89fa-fb36506f298a None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:02.239239 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad6c76-a7c9-4734-89fa-fb36506f298a None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:02.240798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 18/37] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:33:02.251516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cd176-a83c-4ab0-9802-29ec35d54baf None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:02.251850 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cd176-a83c-4ab0-9802-29ec35d54baf None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:02.252122 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cd176-a83c-4ab0-9802-29ec35d54baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:02.272679 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-e10cd176-a83c-4ab0-9802-29ec35d54baf None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:02.274371 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e10cd176-a83c-4ab0-9802-29ec35d54baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:02.320237 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:02.352304 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 19/38] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:33:02.356629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb78801-61f8-44f2-acc5-f0adccd3f484 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:02.358285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cd176-a83c-4ab0-9802-29ec35d54baf None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:02.403756 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c68a3-7ff1-4bf9-9ad6-51e84a8ee620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:02.404460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c68a3-7ff1-4bf9-9ad6-51e84a8ee620 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:02.405483 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c68a3-7ff1-4bf9-9ad6-51e84a8ee620 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:02.405483 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c68a3-7ff1-4bf9-9ad6-51e84a8ee620 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:02.422453 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c68a3-7ff1-4bf9-9ad6-51e84a8ee620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:02.427901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-473c68a3-7ff1-4bf9-9ad6-51e84a8ee620 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:33:02.427901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:02.427901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:02.427901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:02.427901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:02.427901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:02.427901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:02.427901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:02.427901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:02.427901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:02.427901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:02.427901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:02.427901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:02.427901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:02.427901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:02.427901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:02.428726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:02.428726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:02.428726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:02.428726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:02.428726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:02.428726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:02.428726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:02.428726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:02.428726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:02.428726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:02.428726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:02.428726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:02.428726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:02.428726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:02.428726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:02.428726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:02.429490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:02.429490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:02.429490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:02.429490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:02.429490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:02.429490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:02.429490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:02.429490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:02.429490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:02.429490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:02.429490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:33:02.429490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:33:02.429490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 20/39] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:33:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:02.433434 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:02.439837 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c68a3-7ff1-4bf9-9ad6-51e84a8ee620 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:02.494725 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cd176-a83c-4ab0-9802-29ec35d54baf None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:02.555479 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c68a3-7ff1-4bf9-9ad6-51e84a8ee620 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:02.589822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:02.594787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968c9a5-8dd1-4f7f-90d2-f6c01b283eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:02.595535 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968c9a5-8dd1-4f7f-90d2-f6c01b283eec None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:02.603298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968c9a5-8dd1-4f7f-90d2-f6c01b283eec None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:02.603298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968c9a5-8dd1-4f7f-90d2-f6c01b283eec None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:02.603298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968c9a5-8dd1-4f7f-90d2-f6c01b283eec None admin] RBAC: Adding query filter params (name=admin) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:02.603298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968c9a5-8dd1-4f7f-90d2-f6c01b283eec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:02.603298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968c9a5-8dd1-4f7f-90d2-f6c01b283eec None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:02.608763 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 21/40] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:02.614127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968c9a5-8dd1-4f7f-90d2-f6c01b283eec None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:02.638000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5653e3-d7ab-4333-9219-eae4d85ab286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:02.638627 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5653e3-d7ab-4333-9219-eae4d85ab286 None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:02.639143 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5653e3-d7ab-4333-9219-eae4d85ab286 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:02.639423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5653e3-d7ab-4333-9219-eae4d85ab286 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:02.640128 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5653e3-d7ab-4333-9219-eae4d85ab286 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:02.641516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5653e3-d7ab-4333-9219-eae4d85ab286 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:02.713890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968c9a5-8dd1-4f7f-90d2-f6c01b283eec None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:02.746558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d080e3-86e0-4f8a-b6c7-c7a3167908ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:02.747273 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d080e3-86e0-4f8a-b6c7-c7a3167908ba None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:02.747575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d080e3-86e0-4f8a-b6c7-c7a3167908ba None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:02.747855 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d080e3-86e0-4f8a-b6c7-c7a3167908ba None admin] PATH_INFO: `/v3/users/10fb21e5e3c84511bf4f1b659ae7154b` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:02.748995 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d080e3-86e0-4f8a-b6c7-c7a3167908ba None admin] RBAC: Authorizing `identity:get_user(user_id=10fb21e5e3c84511bf4f1b659ae7154b)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:02.750450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d080e3-86e0-4f8a-b6c7-c7a3167908ba None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:02.752280 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 22/41] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:02 2022] GET /identity/v3/users/10fb21e5e3c84511bf4f1b659ae7154b => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:02.752877 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d080e3-86e0-4f8a-b6c7-c7a3167908ba None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:02.763675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 20/42] 10.222.0.15 () {60 vars in 1131 bytes} [Wed Sep 14 19:33:02 2022] POST /identity/v3/roles => generated 223 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:33:02.764912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5653e3-d7ab-4333-9219-eae4d85ab286 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:02.833181 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:02.877027 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d080e3-86e0-4f8a-b6c7-c7a3167908ba None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:02.892812 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5653e3-d7ab-4333-9219-eae4d85ab286 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:02.908169 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:02.919319 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc0e1b-b789-4765-bcad-60bfedc1d281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:02.920197 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc0e1b-b789-4765-bcad-60bfedc1d281 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:02.920869 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc0e1b-b789-4765-bcad-60bfedc1d281 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:02.922499 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc0e1b-b789-4765-bcad-60bfedc1d281 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:02.922499 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc0e1b-b789-4765-bcad-60bfedc1d281 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:02.924053 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc0e1b-b789-4765-bcad-60bfedc1d281 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:02.925939 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 23/43] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:33:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:02.931381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc0e1b-b789-4765-bcad-60bfedc1d281 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:02.932414 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f65ae-9b16-4a47-bc92-b921002d7792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:02.933081 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f65ae-9b16-4a47-bc92-b921002d7792 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:02.933364 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f65ae-9b16-4a47-bc92-b921002d7792 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:02.933641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f65ae-9b16-4a47-bc92-b921002d7792 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:02.934818 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f65ae-9b16-4a47-bc92-b921002d7792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:02.936337 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f65ae-9b16-4a47-bc92-b921002d7792 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:02.938582 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 21/44] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:33:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:02.943968 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f65ae-9b16-4a47-bc92-b921002d7792 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:03.041729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc0e1b-b789-4765-bcad-60bfedc1d281 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:03.054933 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f65ae-9b16-4a47-bc92-b921002d7792 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:03.069050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:03.074779 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a2102-b1da-4221-8e31-fe01e5f68c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:03.075401 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a2102-b1da-4221-8e31-fe01e5f68c6b None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:03.078879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a2102-b1da-4221-8e31-fe01e5f68c6b None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:03.078879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a2102-b1da-4221-8e31-fe01e5f68c6b None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:03.078879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a2102-b1da-4221-8e31-fe01e5f68c6b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:03.078879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a2102-b1da-4221-8e31-fe01e5f68c6b None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:03.088884 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672aa268-cc6f-4a9e-8cca-d40122dffbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:03.089549 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aa268-cc6f-4a9e-8cca-d40122dffbef None admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:03.089833 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aa268-cc6f-4a9e-8cca-d40122dffbef None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:03.090111 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aa268-cc6f-4a9e-8cca-d40122dffbef None admin] PATH_INFO: `/v3/domains/default/users/10fb21e5e3c84511bf4f1b659ae7154b/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:03.092143 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672aa268-cc6f-4a9e-8cca-d40122dffbef None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=10fb21e5e3c84511bf4f1b659ae7154b, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:03.093587 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672aa268-cc6f-4a9e-8cca-d40122dffbef None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:03.163391 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 22/45] 10.222.0.15 () {58 vars in 1361 bytes} [Wed Sep 14 19:33:02 2022] PUT /identity/v3/domains/default/users/10fb21e5e3c84511bf4f1b659ae7154b/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:33:03.197908 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Sep 14 19:33:02 2022] POST /identity/v3/projects => generated 312 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:33:05.301980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7992593-d127-4c36-a25b-5144cb9c7993 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:05.302518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7992593-d127-4c36-a25b-5144cb9c7993 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:05.302518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7992593-d127-4c36-a25b-5144cb9c7993 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:05.303975 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 23/47] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:05.310182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570dea0-a64b-4bab-8f5a-13270b038053 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:05.310693 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570dea0-a64b-4bab-8f5a-13270b038053 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:05.310773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570dea0-a64b-4bab-8f5a-13270b038053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:05.330109 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-a570dea0-a64b-4bab-8f5a-13270b038053 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:05.331314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a570dea0-a64b-4bab-8f5a-13270b038053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:05.397971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 25/48] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:05.408126 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd9b7c-eb09-4940-9168-62cc1dc14e85 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:05.408496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd9b7c-eb09-4940-9168-62cc1dc14e85 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:05.408837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd9b7c-eb09-4940-9168-62cc1dc14e85 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:05.410230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 24/49] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:05.415464 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b253d4-ed55-49e9-b59e-e6803b868bd3 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:05.415818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b253d4-ed55-49e9-b59e-e6803b868bd3 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:05.416097 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b253d4-ed55-49e9-b59e-e6803b868bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:05.433977 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-04b253d4-ed55-49e9-b59e-e6803b868bd3 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:05.435149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-04b253d4-ed55-49e9-b59e-e6803b868bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:05.498715 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 26/50] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:33:05.664919 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd9b7c-eb09-4940-9168-62cc1dc14e85 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:05.708573 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:05.762389 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b253d4-ed55-49e9-b59e-e6803b868bd3 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:05.767147 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd9b7c-eb09-4940-9168-62cc1dc14e85 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:05.801807 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15560718-0a3e-409e-8e38-bb8773aacc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:05.802438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15560718-0a3e-409e-8e38-bb8773aacc9b None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:05.802717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15560718-0a3e-409e-8e38-bb8773aacc9b None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:05.802989 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15560718-0a3e-409e-8e38-bb8773aacc9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:05.805468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:05.814785 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15560718-0a3e-409e-8e38-bb8773aacc9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:05.821132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-15560718-0a3e-409e-8e38-bb8773aacc9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:33:05.821132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:05.821132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:05.821132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:05.821132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:05.821132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:05.821132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:05.821132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:05.821132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:05.821132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:05.821132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:05.821132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:05.821132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:05.821132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:05.821132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:05.821132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:05.824684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:05.824684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:05.824684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:05.824684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:05.824684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:05.824684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:05.824684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:05.824684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:05.824684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:05.824684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:05.824684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:05.824684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:05.824684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:05.824684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:05.824684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:05.824684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:05.825612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:05.825612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:05.825612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:05.825612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:05.825612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:05.825612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:05.825612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:05.825612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:05.825612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:05.825612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:05.825612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:33:05.825612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:05.825612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 25/51] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:33:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:05.828696 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15560718-0a3e-409e-8e38-bb8773aacc9b None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:05.866229 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b253d4-ed55-49e9-b59e-e6803b868bd3 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:05.902332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878c536-3aaf-4146-bf21-a6ce98a61eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:05.902967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878c536-3aaf-4146-bf21-a6ce98a61eab None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:05.903247 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878c536-3aaf-4146-bf21-a6ce98a61eab None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:05.903521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878c536-3aaf-4146-bf21-a6ce98a61eab None admin] PATH_INFO: `/v3/domains/default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:05.904786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878c536-3aaf-4146-bf21-a6ce98a61eab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:05.906248 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878c536-3aaf-4146-bf21-a6ce98a61eab None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:05.907848 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 27/52] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:33:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:05.913334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878c536-3aaf-4146-bf21-a6ce98a61eab None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:05.930057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:05.933654 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15560718-0a3e-409e-8e38-bb8773aacc9b None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:05.970317 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfd41a-02df-4915-842f-e3c8b88aa3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:05.970934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfd41a-02df-4915-842f-e3c8b88aa3fe None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:05.971229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfd41a-02df-4915-842f-e3c8b88aa3fe None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:05.971616 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfd41a-02df-4915-842f-e3c8b88aa3fe None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:05.972192 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfd41a-02df-4915-842f-e3c8b88aa3fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:05.972494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfd41a-02df-4915-842f-e3c8b88aa3fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:05.973882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfd41a-02df-4915-842f-e3c8b88aa3fe None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:05.985511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:05.991342 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfd41a-02df-4915-842f-e3c8b88aa3fe None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:06.013603 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878c536-3aaf-4146-bf21-a6ce98a61eab None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:06.025491 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:06.047885 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d9ef9-55ef-4b78-b70b-9e2b57d57d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:06.048496 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d9ef9-55ef-4b78-b70b-9e2b57d57d27 None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:06.048804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d9ef9-55ef-4b78-b70b-9e2b57d57d27 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:06.049083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d9ef9-55ef-4b78-b70b-9e2b57d57d27 None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:06.049733 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d9ef9-55ef-4b78-b70b-9e2b57d57d27 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:06.051168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d9ef9-55ef-4b78-b70b-9e2b57d57d27 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:06.094404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfd41a-02df-4915-842f-e3c8b88aa3fe None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:06.128314 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e6f47-973b-456a-acc7-7ed0aeac3ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:06.128948 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e6f47-973b-456a-acc7-7ed0aeac3ef9 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:06.129233 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e6f47-973b-456a-acc7-7ed0aeac3ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:06.129512 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e6f47-973b-456a-acc7-7ed0aeac3ef9 None admin] PATH_INFO: `/v3/users/10fb21e5e3c84511bf4f1b659ae7154b` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:06.130659 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e6f47-973b-456a-acc7-7ed0aeac3ef9 None admin] RBAC: Authorizing `identity:get_user(user_id=10fb21e5e3c84511bf4f1b659ae7154b)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:06.132144 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e6f47-973b-456a-acc7-7ed0aeac3ef9 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:06.133788 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 27/54] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:05 2022] GET /identity/v3/users/10fb21e5e3c84511bf4f1b659ae7154b => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:06.140611 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e6f47-973b-456a-acc7-7ed0aeac3ef9 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:06.149789 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 28/55] 10.222.0.15 () {60 vars in 1140 bytes} [Wed Sep 14 19:33:05 2022] POST /identity/v3/projects => generated 298 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:33:06.175190 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:06.251422 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e6f47-973b-456a-acc7-7ed0aeac3ef9 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:06.288991 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d122843-fd8f-408b-b0fa-78da4b8a48d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:06.289645 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d122843-fd8f-408b-b0fa-78da4b8a48d2 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:06.289929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d122843-fd8f-408b-b0fa-78da4b8a48d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:06.290204 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d122843-fd8f-408b-b0fa-78da4b8a48d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:06.292588 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d122843-fd8f-408b-b0fa-78da4b8a48d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:06.294083 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d122843-fd8f-408b-b0fa-78da4b8a48d2 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:06.295736 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 28/56] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:33:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:06.301835 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d9ef9-55ef-4b78-b70b-9e2b57d57d27 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:06.514698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d9ef9-55ef-4b78-b70b-9e2b57d57d27 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:06.547765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49fcdb-8f3c-4923-82c6-aedd91194fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:06.548386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49fcdb-8f3c-4923-82c6-aedd91194fe5 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:06.548668 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49fcdb-8f3c-4923-82c6-aedd91194fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:06.548942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49fcdb-8f3c-4923-82c6-aedd91194fe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:06.549670 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49fcdb-8f3c-4923-82c6-aedd91194fe5 None admin] RBAC: Adding query filter params (role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a, scope.domain.id=default, user.id=10fb21e5e3c84511bf4f1b659ae7154b) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:06.549976 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49fcdb-8f3c-4923-82c6-aedd91194fe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:06.551413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49fcdb-8f3c-4923-82c6-aedd91194fe5 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:06.560357 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 29/57] 10.222.0.15 () {56 vars in 1322 bytes} [Wed Sep 14 19:33:06 2022] GET /identity/v3/role_assignments?user.id=10fb21e5e3c84511bf4f1b659ae7154b&scope.domain.id=default&role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 530 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:08.307433 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0969c9f-9a72-4317-8cea-bd1e63c4b035 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:08.308000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0969c9f-9a72-4317-8cea-bd1e63c4b035 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:08.308000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0969c9f-9a72-4317-8cea-bd1e63c4b035 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:08.309344 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 29/58] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:08.314585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11351b68-9662-4b75-b93a-9634e3a7aa14 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:08.314987 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11351b68-9662-4b75-b93a-9634e3a7aa14 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:08.315142 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11351b68-9662-4b75-b93a-9634e3a7aa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:08.333884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-11351b68-9662-4b75-b93a-9634e3a7aa14 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:08.335079 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-11351b68-9662-4b75-b93a-9634e3a7aa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:08.354521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:08.401002 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 30/59] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:08.668116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0969c9f-9a72-4317-8cea-bd1e63c4b035 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:08.762443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:08.767132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0969c9f-9a72-4317-8cea-bd1e63c4b035 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:08.800352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2768b-6854-4780-83d5-5ba395b550da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:08.800976 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2768b-6854-4780-83d5-5ba395b550da None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:08.801254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2768b-6854-4780-83d5-5ba395b550da None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:08.801535 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2768b-6854-4780-83d5-5ba395b550da None admin] PATH_INFO: `/v3/domains/default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:08.802776 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2768b-6854-4780-83d5-5ba395b550da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:08.804476 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2768b-6854-4780-83d5-5ba395b550da None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:08.807136 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 30/60] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:33:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:08.812084 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11351b68-9662-4b75-b93a-9634e3a7aa14 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:08.917404 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11351b68-9662-4b75-b93a-9634e3a7aa14 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:08.950005 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37861e31-0194-43b2-8263-29e4bf0b2fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:08.950561 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37861e31-0194-43b2-8263-29e4bf0b2fb4 None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:08.950842 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37861e31-0194-43b2-8263-29e4bf0b2fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:08.951117 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37861e31-0194-43b2-8263-29e4bf0b2fb4 None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:08.952955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37861e31-0194-43b2-8263-29e4bf0b2fb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:08.957030 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37861e31-0194-43b2-8263-29e4bf0b2fb4 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:09.053965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 31/61] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Sep 14 19:33:08 2022] POST /identity/v3/users => generated 275 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:33:12.641526 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5252a6-b091-413a-b867-a7915f53f9b9 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:12.641526 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5252a6-b091-413a-b867-a7915f53f9b9 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:12.641526 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5252a6-b091-413a-b867-a7915f53f9b9 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:12.641526 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 31/62] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:12.647202 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d820c9-5570-4810-a10e-66e35bbf86c9 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:12.648127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d820c9-5570-4810-a10e-66e35bbf86c9 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:12.648602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d820c9-5570-4810-a10e-66e35bbf86c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:12.676147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-06d820c9-5570-4810-a10e-66e35bbf86c9 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:12.677744 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-06d820c9-5570-4810-a10e-66e35bbf86c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:12.688023 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:12.737223 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8caec25-da38-44cd-a154-f66cdee29297 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:12.737837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8caec25-da38-44cd-a154-f66cdee29297 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:12.738318 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8caec25-da38-44cd-a154-f66cdee29297 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:12.739905 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 32/63] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:12.745682 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa2f10-c182-46a8-bbee-4a614e3974cd None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:12.746249 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa2f10-c182-46a8-bbee-4a614e3974cd None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:12.746750 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa2f10-c182-46a8-bbee-4a614e3974cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:12.764978 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 32/64] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:12.782426 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-f8aa2f10-c182-46a8-bbee-4a614e3974cd None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:12.784661 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f8aa2f10-c182-46a8-bbee-4a614e3974cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:12.805464 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415e475-28a6-4b00-b463-c61fdb06fff4 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:12.805799 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415e475-28a6-4b00-b463-c61fdb06fff4 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:12.806025 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415e475-28a6-4b00-b463-c61fdb06fff4 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:12.808155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 33/65] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:33:12.813986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658640c5-fc47-4673-8d4b-c1b624b0a152 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:12.814478 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658640c5-fc47-4673-8d4b-c1b624b0a152 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:12.814932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658640c5-fc47-4673-8d4b-c1b624b0a152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:12.852013 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-658640c5-fc47-4673-8d4b-c1b624b0a152 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:12.853533 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-658640c5-fc47-4673-8d4b-c1b624b0a152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:12.934922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 33/66] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:33:12.949757 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b5665-9d27-4098-9f78-3d5a4cfd13cd None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:12.950076 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b5665-9d27-4098-9f78-3d5a4cfd13cd None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:12.950308 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b5665-9d27-4098-9f78-3d5a4cfd13cd None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:12.951667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 34/67] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:33:12.957775 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4facec7-d2b7-4a90-81e2-e89982820b48 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:12.958059 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4facec7-d2b7-4a90-81e2-e89982820b48 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:12.958333 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4facec7-d2b7-4a90-81e2-e89982820b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:12.983948 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-e4facec7-d2b7-4a90-81e2-e89982820b48 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:12.984916 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 34/68] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:12.985449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e4facec7-d2b7-4a90-81e2-e89982820b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:13.037518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170f7cf-cc12-42a3-82eb-447e2341b8c5 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:13.038127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170f7cf-cc12-42a3-82eb-447e2341b8c5 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:13.038622 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170f7cf-cc12-42a3-82eb-447e2341b8c5 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:13.040206 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 35/69] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:33:13.046172 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea3457-5b03-4737-9325-369bfbd138e1 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:13.046738 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea3457-5b03-4737-9325-369bfbd138e1 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:13.047229 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea3457-5b03-4737-9325-369bfbd138e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:13.066712 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-1aea3457-5b03-4737-9325-369bfbd138e1 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:13.068237 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-1aea3457-5b03-4737-9325-369bfbd138e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:13.102778 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 35/70] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:13.104621 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4facec7-d2b7-4a90-81e2-e89982820b48 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:13.138556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:13.144800 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 36/71] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:33:13.250497 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4facec7-d2b7-4a90-81e2-e89982820b48 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:13.295425 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee08c0-2106-40e9-84aa-22038896cd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:13.300138 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee08c0-2106-40e9-84aa-22038896cd66 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:13.300427 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee08c0-2106-40e9-84aa-22038896cd66 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:13.300706 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee08c0-2106-40e9-84aa-22038896cd66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:13.311305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee08c0-2106-40e9-84aa-22038896cd66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:13.313042 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea3457-5b03-4737-9325-369bfbd138e1 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:13.316103 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:13.317544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-c2ee08c0-2106-40e9-84aa-22038896cd66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:13.317544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:13.317544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:13.317544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:13.317544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:13.317544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:13.317544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:13.317544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:13.317544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:13.317544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:13.317544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:13.317544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:13.317544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:13.317544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:13.317544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:13.317544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:13.318384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:13.318384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:13.318384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:13.318384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:13.318384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:13.318384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:13.318384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:13.318384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:13.318384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:13.318384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:13.318384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:13.318384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:13.318384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:13.318384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:13.318384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:13.318384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:13.319141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:13.319141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:13.319141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:13.319141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:13.319141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:13.319141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:13.319141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:13.319141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:13.319141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:13.319141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:13.319141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:13.319141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:13.319141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 36/72] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:13.326593 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee08c0-2106-40e9-84aa-22038896cd66 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:13.433107 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:13.448292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee08c0-2106-40e9-84aa-22038896cd66 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:13.450666 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea3457-5b03-4737-9325-369bfbd138e1 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:13.483803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c573d-afb3-4358-9b82-c3d1119f9009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:13.484675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c573d-afb3-4358-9b82-c3d1119f9009 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:13.484953 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c573d-afb3-4358-9b82-c3d1119f9009 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:13.485223 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c573d-afb3-4358-9b82-c3d1119f9009 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:13.485890 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c573d-afb3-4358-9b82-c3d1119f9009 None admin] RBAC: Adding query filter params (name=member) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:13.486248 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c573d-afb3-4358-9b82-c3d1119f9009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:13.486865 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cbcf7-f558-4810-8751-53a7f47c02cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:13.487505 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cbcf7-f558-4810-8751-53a7f47c02cf None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:13.487793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c573d-afb3-4358-9b82-c3d1119f9009 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:13.487875 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cbcf7-f558-4810-8751-53a7f47c02cf None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:13.488072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cbcf7-f558-4810-8751-53a7f47c02cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:13.497039 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 37/73] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:13.497911 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c573d-afb3-4358-9b82-c3d1119f9009 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:13.499290 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99cbcf7-f558-4810-8751-53a7f47c02cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:13.504267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-e99cbcf7-f558-4810-8751-53a7f47c02cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:33:13.504267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:13.504267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:13.504267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:13.504267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:13.504267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:13.504267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:13.504267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:13.504267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:13.504267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:13.504267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:13.504267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:13.504267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:13.504267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:13.504267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:13.504267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:13.505282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:13.505282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:13.505282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:13.505282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:13.505282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:13.505282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:13.505282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:13.505282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:13.505282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:13.505282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:13.505282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:13.505282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:13.505282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:13.505282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:13.505282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:13.505282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:13.506014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:13.506014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:13.506014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:13.506014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:13.506014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:13.506014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:13.506014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:13.506014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:13.506014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:13.506014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:13.506014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:33:13.506014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:33:13.506014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 37/74] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:33:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:13.506688 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cbcf7-f558-4810-8751-53a7f47c02cf None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:13.569058 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:13.607383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cbcf7-f558-4810-8751-53a7f47c02cf None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:13.623208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c573d-afb3-4358-9b82-c3d1119f9009 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:13.642465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1503bc-d852-42e5-abca-918804172650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:13.643100 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1503bc-d852-42e5-abca-918804172650 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:13.643379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1503bc-d852-42e5-abca-918804172650 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:13.643682 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1503bc-d852-42e5-abca-918804172650 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:13.644815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1503bc-d852-42e5-abca-918804172650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:13.646267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1503bc-d852-42e5-abca-918804172650 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:13.647856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 38/75] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:33:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:13.653167 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1503bc-d852-42e5-abca-918804172650 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:13.657573 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad1cd2-3b71-47ba-add6-49fe38654abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:13.658219 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad1cd2-3b71-47ba-add6-49fe38654abc None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:13.658503 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad1cd2-3b71-47ba-add6-49fe38654abc None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:13.658787 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad1cd2-3b71-47ba-add6-49fe38654abc None admin] PATH_INFO: `/v3/roles/member` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:13.668930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad1cd2-3b71-47ba-add6-49fe38654abc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:13.674704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-34ad1cd2-3b71-47ba-add6-49fe38654abc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:13.674704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:13.674704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:13.674704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:13.674704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:13.674704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:13.674704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:13.674704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:13.674704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:13.674704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:13.674704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:13.674704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:13.674704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:13.674704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:13.674704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:13.674704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:13.675578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:13.675578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:13.675578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:13.675578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:13.675578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:13.675578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:13.675578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:13.675578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:13.675578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:13.675578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:13.675578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:13.675578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:13.675578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:13.675578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:13.675578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:13.675578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:13.676320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:13.676320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:13.676320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:13.676320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:13.676320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:13.676320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:13.676320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:13.676320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:13.676320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:13.676320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:13.676320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:13.676320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:13.676320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 38/76] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:13.676946 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad1cd2-3b71-47ba-add6-49fe38654abc None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:13.690841 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:13.751997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1503bc-d852-42e5-abca-918804172650 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:13.780356 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad1cd2-3b71-47ba-add6-49fe38654abc None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:13.780512 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:13.786806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f1135-3931-4911-b4f6-b119b04f4664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:13.787451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f1135-3931-4911-b4f6-b119b04f4664 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:13.787761 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f1135-3931-4911-b4f6-b119b04f4664 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:13.788040 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f1135-3931-4911-b4f6-b119b04f4664 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:13.798495 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f1135-3931-4911-b4f6-b119b04f4664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:13.803397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-168f1135-3931-4911-b4f6-b119b04f4664 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:33:13.803397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:13.803397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:13.803397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:13.803397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:13.803397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:13.803397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:13.803397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:13.803397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:13.803397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:13.803397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:13.803397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:13.803397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:13.803397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:13.803397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:13.803397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:13.804325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:13.804325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:13.804325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:13.804325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:13.804325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:13.804325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:13.804325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:13.804325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:13.804325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:13.804325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:13.804325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:13.804325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:13.804325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:13.804325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:13.804325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:13.804325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:13.805484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:13.805484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:13.805484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:13.805484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:13.805484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:13.805484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:13.805484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:13.805484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:13.805484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:13.805484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:13.805484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:33:13.805484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:33:13.805484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 39/77] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:33:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:13.806309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f1135-3931-4911-b4f6-b119b04f4664 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:13.816595 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba236e-afae-48bd-8da9-4805fdc5b6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:13.817242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba236e-afae-48bd-8da9-4805fdc5b6f4 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:13.817526 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba236e-afae-48bd-8da9-4805fdc5b6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:13.817803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba236e-afae-48bd-8da9-4805fdc5b6f4 None admin] PATH_INFO: `/v3/users/8fbbf46ece0240fd9bd840b4ccefeeaf` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:13.831568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba236e-afae-48bd-8da9-4805fdc5b6f4 None admin] RBAC: Authorizing `identity:get_user(user_id=8fbbf46ece0240fd9bd840b4ccefeeaf)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:13.833044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba236e-afae-48bd-8da9-4805fdc5b6f4 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:13.834657 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 39/78] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:13 2022] GET /identity/v3/users/8fbbf46ece0240fd9bd840b4ccefeeaf => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:13.836329 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba236e-afae-48bd-8da9-4805fdc5b6f4 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:13.905686 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:13.915813 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f1135-3931-4911-b4f6-b119b04f4664 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:13.943843 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba236e-afae-48bd-8da9-4805fdc5b6f4 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:13.951448 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81c772-3d08-46e4-93eb-4c3422eb55a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:13.952109 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81c772-3d08-46e4-93eb-4c3422eb55a2 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:13.952394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81c772-3d08-46e4-93eb-4c3422eb55a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:13.952672 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81c772-3d08-46e4-93eb-4c3422eb55a2 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:13.953335 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81c772-3d08-46e4-93eb-4c3422eb55a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:13.953644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81c772-3d08-46e4-93eb-4c3422eb55a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:13.955031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81c772-3d08-46e4-93eb-4c3422eb55a2 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:13.962915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 40/79] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:13.963780 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81c772-3d08-46e4-93eb-4c3422eb55a2 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:13.978203 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a916e9-8b84-40d6-a258-02264f00809d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:13.979424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a916e9-8b84-40d6-a258-02264f00809d None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:13.979970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a916e9-8b84-40d6-a258-02264f00809d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:13.980320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a916e9-8b84-40d6-a258-02264f00809d None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:13.980987 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a916e9-8b84-40d6-a258-02264f00809d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:13.982451 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a916e9-8b84-40d6-a258-02264f00809d None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:14.017347 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:14.062779 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81c772-3d08-46e4-93eb-4c3422eb55a2 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:14.079745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 40/80] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Sep 14 19:33:13 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:33:14.091750 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a916e9-8b84-40d6-a258-02264f00809d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:14.109110 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1f9d1-d33c-4b78-aab5-f8f4dd16174d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:14.110186 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1f9d1-d33c-4b78-aab5-f8f4dd16174d None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:14.110635 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1f9d1-d33c-4b78-aab5-f8f4dd16174d None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:14.110918 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1f9d1-d33c-4b78-aab5-f8f4dd16174d None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:14.111658 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1f9d1-d33c-4b78-aab5-f8f4dd16174d None admin] RBAC: Adding query filter params (name=member) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:14.111976 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1f9d1-d33c-4b78-aab5-f8f4dd16174d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:14.113676 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1f9d1-d33c-4b78-aab5-f8f4dd16174d None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:14.125699 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 41/81] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:14.126574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1f9d1-d33c-4b78-aab5-f8f4dd16174d None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:14.200997 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a916e9-8b84-40d6-a258-02264f00809d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:14.232046 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:14.243926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db415c-99d9-42b3-84d7-2c07f9ac2537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:14.244726 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db415c-99d9-42b3-84d7-2c07f9ac2537 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:14.245123 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db415c-99d9-42b3-84d7-2c07f9ac2537 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:14.245396 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db415c-99d9-42b3-84d7-2c07f9ac2537 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:14.246116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db415c-99d9-42b3-84d7-2c07f9ac2537 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:14.246424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db415c-99d9-42b3-84d7-2c07f9ac2537 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:14.247863 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db415c-99d9-42b3-84d7-2c07f9ac2537 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:14.251527 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1f9d1-d33c-4b78-aab5-f8f4dd16174d None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:14.262303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 41/82] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:33:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:14.262303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db415c-99d9-42b3-84d7-2c07f9ac2537 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:14.269354 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:14.297519 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e25ec-dad4-44bf-b967-2f72364edb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:14.298460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e25ec-dad4-44bf-b967-2f72364edb9a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:14.298900 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e25ec-dad4-44bf-b967-2f72364edb9a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:14.299186 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e25ec-dad4-44bf-b967-2f72364edb9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:14.381383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e25ec-dad4-44bf-b967-2f72364edb9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:14.383673 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e25ec-dad4-44bf-b967-2f72364edb9a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:14.389318 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db415c-99d9-42b3-84d7-2c07f9ac2537 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:14.429371 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf82b66-0dd9-4627-b15c-570e568ededc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:14.430021 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf82b66-0dd9-4627-b15c-570e568ededc None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:14.430305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf82b66-0dd9-4627-b15c-570e568ededc None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:14.430582 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf82b66-0dd9-4627-b15c-570e568ededc None admin] PATH_INFO: `/v3/users/10fb21e5e3c84511bf4f1b659ae7154b` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:14.433254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf82b66-0dd9-4627-b15c-570e568ededc None admin] RBAC: Authorizing `identity:get_user(user_id=10fb21e5e3c84511bf4f1b659ae7154b)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:14.434591 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf82b66-0dd9-4627-b15c-570e568ededc None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:14.437080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 42/83] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:14 2022] GET /identity/v3/users/10fb21e5e3c84511bf4f1b659ae7154b => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:14.437947 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf82b66-0dd9-4627-b15c-570e568ededc None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:14.511421 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 42/84] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:33:14.512419 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e25ec-dad4-44bf-b967-2f72364edb9a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:14.513091 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:14.531947 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:14.568577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf82b66-0dd9-4627-b15c-570e568ededc None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:14.617230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf2f8e-f98d-4b81-9c1d-679662fe46c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:14.618538 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf2f8e-f98d-4b81-9c1d-679662fe46c8 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:14.618995 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf2f8e-f98d-4b81-9c1d-679662fe46c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:14.619530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf2f8e-f98d-4b81-9c1d-679662fe46c8 None admin] PATH_INFO: `/v3/users/8fbbf46ece0240fd9bd840b4ccefeeaf` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:14.621922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf2f8e-f98d-4b81-9c1d-679662fe46c8 None admin] RBAC: Authorizing `identity:get_user(user_id=8fbbf46ece0240fd9bd840b4ccefeeaf)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:14.623868 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf2f8e-f98d-4b81-9c1d-679662fe46c8 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:14.626661 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 43/85] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:14 2022] GET /identity/v3/users/8fbbf46ece0240fd9bd840b4ccefeeaf => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:14.627877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf2f8e-f98d-4b81-9c1d-679662fe46c8 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:14.639584 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e25ec-dad4-44bf-b967-2f72364edb9a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:14.678297 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c802c6b-44bc-40e6-af4f-ee4ac76c1fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:14.679839 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c802c6b-44bc-40e6-af4f-ee4ac76c1fce None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:14.680133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c802c6b-44bc-40e6-af4f-ee4ac76c1fce None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:14.680413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c802c6b-44bc-40e6-af4f-ee4ac76c1fce None admin] PATH_INFO: `/v3/users/8fbbf46ece0240fd9bd840b4ccefeeaf` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:14.681618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c802c6b-44bc-40e6-af4f-ee4ac76c1fce None admin] RBAC: Authorizing `identity:get_user(user_id=8fbbf46ece0240fd9bd840b4ccefeeaf)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:14.684040 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c802c6b-44bc-40e6-af4f-ee4ac76c1fce None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:14.686478 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 43/86] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:14 2022] GET /identity/v3/users/8fbbf46ece0240fd9bd840b4ccefeeaf => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:14.687503 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c802c6b-44bc-40e6-af4f-ee4ac76c1fce None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:14.750653 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf2f8e-f98d-4b81-9c1d-679662fe46c8 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:14.772465 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:14.792073 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad891c-cf10-4d67-8964-2c1a8acea0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:14.792786 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad891c-cf10-4d67-8964-2c1a8acea0dd None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:14.793071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad891c-cf10-4d67-8964-2c1a8acea0dd None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:14.797381 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad891c-cf10-4d67-8964-2c1a8acea0dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:14.802677 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:14.824954 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c802c6b-44bc-40e6-af4f-ee4ac76c1fce None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:14.879020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad891c-cf10-4d67-8964-2c1a8acea0dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:14.880494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad891c-cf10-4d67-8964-2c1a8acea0dd None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:14.912741 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845ccd8-b66f-4185-9ce5-512258c25b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:14.913791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845ccd8-b66f-4185-9ce5-512258c25b4a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:14.914074 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845ccd8-b66f-4185-9ce5-512258c25b4a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:14.914612 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845ccd8-b66f-4185-9ce5-512258c25b4a None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:14.915792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845ccd8-b66f-4185-9ce5-512258c25b4a None admin] RBAC: Authorizing `identity:get_project(project_id=40b14549caef48dfb5996de78e97302f)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:14.918137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845ccd8-b66f-4185-9ce5-512258c25b4a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:14.920025 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 44/87] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:14 2022] GET /identity/v3/projects/40b14549caef48dfb5996de78e97302f => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:14.920622 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845ccd8-b66f-4185-9ce5-512258c25b4a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:14.989375 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 44/88] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:33:14.990148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad891c-cf10-4d67-8964-2c1a8acea0dd None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:15.018187 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:15.048811 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845ccd8-b66f-4185-9ce5-512258c25b4a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:15.091153 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195da49c-5cb3-488a-b255-46959bc347bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:15.092051 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195da49c-5cb3-488a-b255-46959bc347bb None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:15.092775 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195da49c-5cb3-488a-b255-46959bc347bb None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:15.093059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195da49c-5cb3-488a-b255-46959bc347bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:15.101414 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad891c-cf10-4d67-8964-2c1a8acea0dd None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:15.114653 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:15.141372 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb226dfa-9074-4532-82b2-b8b847bc0ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:15.141914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb226dfa-9074-4532-82b2-b8b847bc0ae5 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:15.142196 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb226dfa-9074-4532-82b2-b8b847bc0ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:15.142473 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb226dfa-9074-4532-82b2-b8b847bc0ae5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:15.181310 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195da49c-5cb3-488a-b255-46959bc347bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:15.183340 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195da49c-5cb3-488a-b255-46959bc347bb None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:15.235445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb226dfa-9074-4532-82b2-b8b847bc0ae5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:15.237689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb226dfa-9074-4532-82b2-b8b847bc0ae5 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:15.266844 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:15.300155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 45/89] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:33:15.301169 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195da49c-5cb3-488a-b255-46959bc347bb None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:15.360124 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:15.381312 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 45/90] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:33:15.384272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb226dfa-9074-4532-82b2-b8b847bc0ae5 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:15.423184 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195da49c-5cb3-488a-b255-46959bc347bb None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:15.464627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b48849-5024-42c1-b2a8-745b371e0e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:15.465248 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b48849-5024-42c1-b2a8-745b371e0e28 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:15.465529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b48849-5024-42c1-b2a8-745b371e0e28 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:15.465805 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b48849-5024-42c1-b2a8-745b371e0e28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:15.466530 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b48849-5024-42c1-b2a8-745b371e0e28 None admin] RBAC: Adding query filter params (role.id=f63dc07e563f4ffb9f88aa95c528da47, scope.project.id=40b14549caef48dfb5996de78e97302f, user.id=8fbbf46ece0240fd9bd840b4ccefeeaf) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:15.466840 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b48849-5024-42c1-b2a8-745b371e0e28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:15.468309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b48849-5024-42c1-b2a8-745b371e0e28 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:15.474065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 46/91] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:33:15 2022] GET /identity/v3/role_assignments?user.id=8fbbf46ece0240fd9bd840b4ccefeeaf&scope.project.id=40b14549caef48dfb5996de78e97302f&role.id=f63dc07e563f4ffb9f88aa95c528da47 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:15.474682 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b48849-5024-42c1-b2a8-745b371e0e28 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:15.521085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb226dfa-9074-4532-82b2-b8b847bc0ae5 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:15.546430 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:15.566977 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492233e-001a-4547-bada-631db6a0f879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:15.567670 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492233e-001a-4547-bada-631db6a0f879 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:15.567966 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492233e-001a-4547-bada-631db6a0f879 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:15.568683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492233e-001a-4547-bada-631db6a0f879 None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:15.570478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492233e-001a-4547-bada-631db6a0f879 None admin] RBAC: Authorizing `identity:get_project(project_id=40b14549caef48dfb5996de78e97302f)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:15.572265 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492233e-001a-4547-bada-631db6a0f879 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:15.575041 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 46/92] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:15 2022] GET /identity/v3/projects/40b14549caef48dfb5996de78e97302f => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:15.576317 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492233e-001a-4547-bada-631db6a0f879 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:15.670985 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b48849-5024-42c1-b2a8-745b371e0e28 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:15.688713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:15.715166 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a4ae6-612c-4971-ad82-7bf846529ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:15.716061 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a4ae6-612c-4971-ad82-7bf846529ca3 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:15.716353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a4ae6-612c-4971-ad82-7bf846529ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:15.716632 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a4ae6-612c-4971-ad82-7bf846529ca3 None admin] PATH_INFO: `/v3/projects/f4610a4df84b4edbbef0ab7a29a9e7eb` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:15.718784 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a4ae6-612c-4971-ad82-7bf846529ca3 None admin] RBAC: Authorizing `identity:get_project(project_id=f4610a4df84b4edbbef0ab7a29a9e7eb)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:15.724492 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a4ae6-612c-4971-ad82-7bf846529ca3 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:15.731892 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 47/93] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:15 2022] GET /identity/v3/projects/f4610a4df84b4edbbef0ab7a29a9e7eb => generated 312 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:15.732800 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a4ae6-612c-4971-ad82-7bf846529ca3 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:15.754274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492233e-001a-4547-bada-631db6a0f879 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:15.804272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3534f-5138-4f0f-8c92-f938ef7a54e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:15.805165 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3534f-5138-4f0f-8c92-f938ef7a54e4 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:15.805625 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3534f-5138-4f0f-8c92-f938ef7a54e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:15.806087 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3534f-5138-4f0f-8c92-f938ef7a54e4 None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:15.808025 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3534f-5138-4f0f-8c92-f938ef7a54e4 None admin] RBAC: Authorizing `identity:get_project(project_id=40b14549caef48dfb5996de78e97302f)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:15.809655 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3534f-5138-4f0f-8c92-f938ef7a54e4 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:15.811449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 47/94] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:15 2022] GET /identity/v3/projects/40b14549caef48dfb5996de78e97302f => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:15.812389 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3534f-5138-4f0f-8c92-f938ef7a54e4 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:15.862755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a4ae6-612c-4971-ad82-7bf846529ca3 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:15.908852 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad4531-0eda-4493-bb45-c3ad5e5f55a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:15.910827 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad4531-0eda-4493-bb45-c3ad5e5f55a5 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:15.911387 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad4531-0eda-4493-bb45-c3ad5e5f55a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:15.912510 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad4531-0eda-4493-bb45-c3ad5e5f55a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:15.913561 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad4531-0eda-4493-bb45-c3ad5e5f55a5 None admin] RBAC: Adding query filter params (role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a, scope.project.id=40b14549caef48dfb5996de78e97302f, user.id=10fb21e5e3c84511bf4f1b659ae7154b) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:15.915286 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad4531-0eda-4493-bb45-c3ad5e5f55a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:15.918277 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad4531-0eda-4493-bb45-c3ad5e5f55a5 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:15.929683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 48/95] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:33:15 2022] GET /identity/v3/role_assignments?user.id=10fb21e5e3c84511bf4f1b659ae7154b&scope.project.id=40b14549caef48dfb5996de78e97302f&role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:15.932628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad4531-0eda-4493-bb45-c3ad5e5f55a5 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:15.938062 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:16.033648 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3534f-5138-4f0f-8c92-f938ef7a54e4 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:16.054141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:16.113011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a9961-8305-42a9-8430-65405f6affe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:16.114024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a9961-8305-42a9-8430-65405f6affe8 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:16.114479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a9961-8305-42a9-8430-65405f6affe8 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:16.114912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a9961-8305-42a9-8430-65405f6affe8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:16.115942 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a9961-8305-42a9-8430-65405f6affe8 None admin] RBAC: Adding query filter params (role.id=f63dc07e563f4ffb9f88aa95c528da47, scope.project.id=f4610a4df84b4edbbef0ab7a29a9e7eb, user.id=8fbbf46ece0240fd9bd840b4ccefeeaf) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:16.116434 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a9961-8305-42a9-8430-65405f6affe8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:16.118063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a9961-8305-42a9-8430-65405f6affe8 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:16.131011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 48/96] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:33:15 2022] GET /identity/v3/role_assignments?user.id=8fbbf46ece0240fd9bd840b4ccefeeaf&scope.project.id=f4610a4df84b4edbbef0ab7a29a9e7eb&role.id=f63dc07e563f4ffb9f88aa95c528da47 => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:16.173702 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad4531-0eda-4493-bb45-c3ad5e5f55a5 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:16.224992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef33f9-77ed-4ef8-a90d-9861fc5ed670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:16.225646 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef33f9-77ed-4ef8-a90d-9861fc5ed670 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:16.225928 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef33f9-77ed-4ef8-a90d-9861fc5ed670 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:16.226205 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef33f9-77ed-4ef8-a90d-9861fc5ed670 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:16.226950 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef33f9-77ed-4ef8-a90d-9861fc5ed670 None admin] RBAC: Adding query filter params (role.id=fd65be88941941298be36b142df9b505, scope.project.id=40b14549caef48dfb5996de78e97302f, user.id=8fbbf46ece0240fd9bd840b4ccefeeaf) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:16.227262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef33f9-77ed-4ef8-a90d-9861fc5ed670 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:16.228791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef33f9-77ed-4ef8-a90d-9861fc5ed670 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:16.235930 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 49/97] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:33:15 2022] GET /identity/v3/role_assignments?user.id=8fbbf46ece0240fd9bd840b4ccefeeaf&scope.project.id=40b14549caef48dfb5996de78e97302f&role.id=fd65be88941941298be36b142df9b505 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:16.518737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d95f8-99fc-4843-b25b-9f58d5527225 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:16.519028 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d95f8-99fc-4843-b25b-9f58d5527225 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:16.519314 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d95f8-99fc-4843-b25b-9f58d5527225 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:16.521446 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 49/98] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:16.527971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8c5d6-7fbb-4612-a35c-b4fee6716ece None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:16.528267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8c5d6-7fbb-4612-a35c-b4fee6716ece None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:16.528554 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8c5d6-7fbb-4612-a35c-b4fee6716ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:16.553302 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-74f8c5d6-7fbb-4612-a35c-b4fee6716ece None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:16.554563 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-74f8c5d6-7fbb-4612-a35c-b4fee6716ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:16.646086 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 50/99] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:16.866603 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfae5c-eb89-4176-80b7-358b0433f8b0 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:16.867101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfae5c-eb89-4176-80b7-358b0433f8b0 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:16.867171 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfae5c-eb89-4176-80b7-358b0433f8b0 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:16.868697 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 50/100] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:16.876078 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633293d1-1c9b-4765-9674-90e605e14a26 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:16.876486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633293d1-1c9b-4765-9674-90e605e14a26 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:16.876652 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633293d1-1c9b-4765-9674-90e605e14a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:16.903938 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-633293d1-1c9b-4765-9674-90e605e14a26 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:16.905188 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-633293d1-1c9b-4765-9674-90e605e14a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:16.957279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:16.996660 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 51/101] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:17.021036 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfae5c-eb89-4176-80b7-358b0433f8b0 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:17.167203 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfae5c-eb89-4176-80b7-358b0433f8b0 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:17.191098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:17.208252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa083d3-d694-40cb-9463-769089d556ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:17.208958 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa083d3-d694-40cb-9463-769089d556ba None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:17.209239 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa083d3-d694-40cb-9463-769089d556ba None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:17.209514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa083d3-d694-40cb-9463-769089d556ba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:17.228355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa083d3-d694-40cb-9463-769089d556ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:17.234518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-9aa083d3-d694-40cb-9463-769089d556ba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 19:33:17.234518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:17.234518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:17.234518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:17.234518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:17.234518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:17.234518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:17.234518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:17.234518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:17.234518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:17.234518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:17.234518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:17.234518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:17.234518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:17.234518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:17.234518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:17.235443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:17.235443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:17.235443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:17.235443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:17.235443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:17.235443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:17.235443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:17.235443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:17.235443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:17.235443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:17.235443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:17.235443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:17.235443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:17.235443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:17.235443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:17.235443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:17.236221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:17.236221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:17.236221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:17.236221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:17.236221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:17.236221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:17.236221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:17.236221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:17.236221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:17.236221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:17.236221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 19:33:17.236221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:17.236221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 51/102] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:17.243187 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633293d1-1c9b-4765-9674-90e605e14a26 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:17.389426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633293d1-1c9b-4765-9674-90e605e14a26 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:17.440413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be6302-e386-48a3-b34b-b329f2bb6639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:17.440961 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be6302-e386-48a3-b34b-b329f2bb6639 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:17.441242 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be6302-e386-48a3-b34b-b329f2bb6639 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:17.441519 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be6302-e386-48a3-b34b-b329f2bb6639 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:17.442195 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be6302-e386-48a3-b34b-b329f2bb6639 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:17.442505 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be6302-e386-48a3-b34b-b329f2bb6639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:17.443910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be6302-e386-48a3-b34b-b329f2bb6639 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:17.455575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 52/103] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:17.461595 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa083d3-d694-40cb-9463-769089d556ba None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:17.491571 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be6302-e386-48a3-b34b-b329f2bb6639 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:17.561866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:17.591483 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa083d3-d694-40cb-9463-769089d556ba None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:17.631495 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1710d-aa72-4a90-97b1-ed7f9cae45fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:17.632167 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1710d-aa72-4a90-97b1-ed7f9cae45fe None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:17.632455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1710d-aa72-4a90-97b1-ed7f9cae45fe None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:17.632732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1710d-aa72-4a90-97b1-ed7f9cae45fe None admin] PATH_INFO: `/v3/users/87f669af2258454fadb832ca4bac14bc` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:17.648773 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1710d-aa72-4a90-97b1-ed7f9cae45fe None admin] RBAC: Authorizing `identity:get_user(user_id=87f669af2258454fadb832ca4bac14bc)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:17.650259 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1710d-aa72-4a90-97b1-ed7f9cae45fe None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:17.652343 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 52/104] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:17 2022] GET /identity/v3/users/87f669af2258454fadb832ca4bac14bc => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:17.660907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1710d-aa72-4a90-97b1-ed7f9cae45fe None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:17.716198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be6302-e386-48a3-b34b-b329f2bb6639 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:17.731914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:17.827237 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1710d-aa72-4a90-97b1-ed7f9cae45fe None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:17.829173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5f38a-1572-4719-9110-dfbfc744a230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:17.829833 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5f38a-1572-4719-9110-dfbfc744a230 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:17.830117 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5f38a-1572-4719-9110-dfbfc744a230 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:17.830392 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5f38a-1572-4719-9110-dfbfc744a230 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:17.836237 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5f38a-1572-4719-9110-dfbfc744a230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:17.837691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5f38a-1572-4719-9110-dfbfc744a230 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:17.839993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 53/105] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:33:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:17.845492 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5f38a-1572-4719-9110-dfbfc744a230 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:17.912662 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa404d-fc45-4ca3-bf9b-f1e6b1cf3f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:17.913353 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa404d-fc45-4ca3-bf9b-f1e6b1cf3f4b None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:17.913796 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa404d-fc45-4ca3-bf9b-f1e6b1cf3f4b None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:17.914352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa404d-fc45-4ca3-bf9b-f1e6b1cf3f4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:18.030147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:18.032802 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa404d-fc45-4ca3-bf9b-f1e6b1cf3f4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:18.034506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa404d-fc45-4ca3-bf9b-f1e6b1cf3f4b None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:18.037483 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5f38a-1572-4719-9110-dfbfc744a230 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:18.097294 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23365bac-185e-44b5-bbc8-d563287e011d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:18.097924 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23365bac-185e-44b5-bbc8-d563287e011d None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:18.098210 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23365bac-185e-44b5-bbc8-d563287e011d None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:18.098490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23365bac-185e-44b5-bbc8-d563287e011d None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:18.099169 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23365bac-185e-44b5-bbc8-d563287e011d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:18.100647 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23365bac-185e-44b5-bbc8-d563287e011d None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:18.107890 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:18.203056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 53/106] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:33:18.208554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa404d-fc45-4ca3-bf9b-f1e6b1cf3f4b None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:18.237581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 54/107] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Sep 14 19:33:17 2022] POST /identity/v3/projects => generated 302 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:33:18.333322 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa404d-fc45-4ca3-bf9b-f1e6b1cf3f4b None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:18.370744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bb95c-e22e-4973-9f52-4b8bb0497d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:18.371907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bb95c-e22e-4973-9f52-4b8bb0497d3e None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:18.371907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bb95c-e22e-4973-9f52-4b8bb0497d3e None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:18.372046 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bb95c-e22e-4973-9f52-4b8bb0497d3e None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:18.375771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bb95c-e22e-4973-9f52-4b8bb0497d3e None admin] RBAC: Authorizing `identity:get_project(project_id=40b14549caef48dfb5996de78e97302f)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:18.375771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bb95c-e22e-4973-9f52-4b8bb0497d3e None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:18.379073 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 54/108] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:18 2022] GET /identity/v3/projects/40b14549caef48dfb5996de78e97302f => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:18.385952 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23365bac-185e-44b5-bbc8-d563287e011d None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:18.521697 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23365bac-185e-44b5-bbc8-d563287e011d None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:18.571207 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c30ccd-0de3-4a51-a1bf-cf2f1569a5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:18.571912 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c30ccd-0de3-4a51-a1bf-cf2f1569a5cd None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:18.572258 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c30ccd-0de3-4a51-a1bf-cf2f1569a5cd None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:18.572574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c30ccd-0de3-4a51-a1bf-cf2f1569a5cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:18.574122 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c30ccd-0de3-4a51-a1bf-cf2f1569a5cd None admin] RBAC: Adding query filter params (role.id=44508e6bd9ba4b1b826ac09f102b2782, scope.project.id=40b14549caef48dfb5996de78e97302f, user.id=87f669af2258454fadb832ca4bac14bc) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:18.574951 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c30ccd-0de3-4a51-a1bf-cf2f1569a5cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:18.577279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c30ccd-0de3-4a51-a1bf-cf2f1569a5cd None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:18.588078 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 55/109] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:33:18 2022] GET /identity/v3/role_assignments?user.id=87f669af2258454fadb832ca4bac14bc&scope.project.id=40b14549caef48dfb5996de78e97302f&role.id=44508e6bd9ba4b1b826ac09f102b2782 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:19.247257 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb1e09-bec9-4118-9f96-19f03189c95c None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:19.247848 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb1e09-bec9-4118-9f96-19f03189c95c None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:19.247848 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb1e09-bec9-4118-9f96-19f03189c95c None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:19.249275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 55/110] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:19.254951 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b660884-c738-433e-8b52-1fb67b629d8e None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:19.255373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b660884-c738-433e-8b52-1fb67b629d8e None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:19.255570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b660884-c738-433e-8b52-1fb67b629d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:19.278675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74904fe6-078a-4158-af01-16f6afaa34df None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:19.278675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74904fe6-078a-4158-af01-16f6afaa34df None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:19.278675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74904fe6-078a-4158-af01-16f6afaa34df None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:19.278675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 56/111] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:19.284916 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16940c-4757-44b3-8af1-995d8cf61151 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:19.287894 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16940c-4757-44b3-8af1-995d8cf61151 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:19.288001 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-3b660884-c738-433e-8b52-1fb67b629d8e None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:19.288092 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16940c-4757-44b3-8af1-995d8cf61151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:19.288166 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-3b660884-c738-433e-8b52-1fb67b629d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:19.303312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:19.306342 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:19.313831 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-1d16940c-4757-44b3-8af1-995d8cf61151 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:19.316670 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1d16940c-4757-44b3-8af1-995d8cf61151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:19.405461 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 56/112] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:19.407197 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa6f5b-7c4c-48b0-a473-9cd2a1f93651 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:19.407711 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa6f5b-7c4c-48b0-a473-9cd2a1f93651 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:19.408190 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa6f5b-7c4c-48b0-a473-9cd2a1f93651 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:19.409736 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 57/113] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:19.422856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526d327-2207-4bb5-ace3-e3befb0d3c98 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:19.423460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526d327-2207-4bb5-ace3-e3befb0d3c98 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:19.424443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526d327-2207-4bb5-ace3-e3befb0d3c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:19.445384 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-5526d327-2207-4bb5-ace3-e3befb0d3c98 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:19.446919 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-5526d327-2207-4bb5-ace3-e3befb0d3c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:19.450161 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 57/114] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:19.526957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d004a53-6cf3-4e07-ba81-d6043466772d None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:19.527447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d004a53-6cf3-4e07-ba81-d6043466772d None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:19.527886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d004a53-6cf3-4e07-ba81-d6043466772d None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:19.529300 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 58/115] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:33:19.533450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 58/116] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:33:19.534488 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae936c74-b642-4b0f-8a44-53d69945f8c4 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:19.534781 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae936c74-b642-4b0f-8a44-53d69945f8c4 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:19.535058 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae936c74-b642-4b0f-8a44-53d69945f8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:19.571853 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-ae936c74-b642-4b0f-8a44-53d69945f8c4 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:19.573117 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ae936c74-b642-4b0f-8a44-53d69945f8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:19.669264 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 59/117] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:33:19.718913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526d327-2207-4bb5-ace3-e3befb0d3c98 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:19.801595 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae936c74-b642-4b0f-8a44-53d69945f8c4 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:19.821317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:19.848740 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526d327-2207-4bb5-ace3-e3befb0d3c98 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:19.888173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbe8b4-0fdf-4428-8fe2-f898a97b94d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:19.889220 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbe8b4-0fdf-4428-8fe2-f898a97b94d7 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:19.889990 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbe8b4-0fdf-4428-8fe2-f898a97b94d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:19.890484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbe8b4-0fdf-4428-8fe2-f898a97b94d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:19.904782 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbe8b4-0fdf-4428-8fe2-f898a97b94d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:19.910381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-aefbe8b4-0fdf-4428-8fe2-f898a97b94d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:33:19.910381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:19.910381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:19.910381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:19.910381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:19.910381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:19.910381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:19.910381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:19.910381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:19.910381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:19.910381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:19.910381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:19.910381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:19.910381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:19.910381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:19.910381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:19.911245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:19.911245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:19.911245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:19.911245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:19.911245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:19.911245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:19.911245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:19.911245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:19.911245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:19.911245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:19.911245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:19.911245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:19.911245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:19.911245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:19.911245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:19.911245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:19.912056 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:19.912056 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:19.912056 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:19.912056 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:19.912056 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:19.912056 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:19.912056 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:19.912056 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:19.912056 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:19.912056 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:19.912056 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:33:19.912056 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:33:19.914457 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 59/118] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:33:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:19.920689 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbe8b4-0fdf-4428-8fe2-f898a97b94d7 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:19.954310 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:20.020467 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae936c74-b642-4b0f-8a44-53d69945f8c4 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:20.053581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbe8b4-0fdf-4428-8fe2-f898a97b94d7 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:20.073034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b3c89-4f38-4d7f-93da-ddfd8fa41789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:20.073717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b3c89-4f38-4d7f-93da-ddfd8fa41789 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:20.074041 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b3c89-4f38-4d7f-93da-ddfd8fa41789 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:20.074388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b3c89-4f38-4d7f-93da-ddfd8fa41789 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:20.085788 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b3c89-4f38-4d7f-93da-ddfd8fa41789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:20.091567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-0a1b3c89-4f38-4d7f-93da-ddfd8fa41789 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:20.091567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:20.091567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:20.091567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:20.091567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:20.091567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:20.091567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:20.091567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:20.091567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:20.091567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:20.091567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:20.091567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:20.091567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:20.091567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:20.091567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:20.091567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:20.092415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:20.092415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:20.092415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:20.092415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:20.092415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:20.092415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:20.092415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:20.092415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:20.092415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:20.092415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:20.092415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:20.092415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:20.092415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:20.092415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:20.092415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:20.092415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:20.093168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:20.093168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:20.093168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:20.093168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:20.093168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:20.093168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:20.093168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:20.093168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:20.093168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:20.093168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:20.093168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:20.093168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:20.093168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 60/119] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:20.093786 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b3c89-4f38-4d7f-93da-ddfd8fa41789 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:20.104366 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6fdc9-47f2-40a5-a92e-1e35d4929541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:20.104366 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6fdc9-47f2-40a5-a92e-1e35d4929541 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:20.104366 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6fdc9-47f2-40a5-a92e-1e35d4929541 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:20.104366 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6fdc9-47f2-40a5-a92e-1e35d4929541 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:20.105362 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6fdc9-47f2-40a5-a92e-1e35d4929541 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:20.105362 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6fdc9-47f2-40a5-a92e-1e35d4929541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:20.105362 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6fdc9-47f2-40a5-a92e-1e35d4929541 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:20.106845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:20.114444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 60/120] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:20.119675 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6fdc9-47f2-40a5-a92e-1e35d4929541 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:20.210989 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b3c89-4f38-4d7f-93da-ddfd8fa41789 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:20.229187 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6fdc9-47f2-40a5-a92e-1e35d4929541 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:20.239886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:20.250328 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0d134-d46d-4890-8846-908ceb0cf67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:20.251345 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0d134-d46d-4890-8846-908ceb0cf67d None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:20.251345 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0d134-d46d-4890-8846-908ceb0cf67d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:20.256593 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0d134-d46d-4890-8846-908ceb0cf67d None admin] PATH_INFO: `/v3/roles/member` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:20.263440 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0d134-d46d-4890-8846-908ceb0cf67d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:20.266615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b782b7-fd26-427e-be5f-ac90c0ccc82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:20.267741 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b782b7-fd26-427e-be5f-ac90c0ccc82c None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:20.268173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b782b7-fd26-427e-be5f-ac90c0ccc82c None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:20.268585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b782b7-fd26-427e-be5f-ac90c0ccc82c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:20.268769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-c2b0d134-d46d-4890-8846-908ceb0cf67d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:20.268769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:20.268769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:20.268769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:20.268769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:20.268769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:20.268769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:20.268769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:20.268769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:20.268769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:20.268769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:20.268769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:20.268769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:20.268769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:20.268769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:20.268769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:20.269762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:20.269762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:20.269762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:20.269762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:20.269762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:20.269762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:20.269762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:20.269762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:20.269762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:20.269762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:20.269762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:20.269762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:20.269762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:20.269762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:20.269762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:20.269762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:20.270576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:20.270576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:20.270576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:20.270576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:20.270576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:20.270576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:20.270576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:20.270576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:20.270576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:20.270576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:20.270576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:20.270576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:20.270576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 61/121] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:20.271200 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0d134-d46d-4890-8846-908ceb0cf67d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:20.291632 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b782b7-fd26-427e-be5f-ac90c0ccc82c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:20.300039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-75b782b7-fd26-427e-be5f-ac90c0ccc82c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:33:20.300039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:20.300039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:20.300039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:20.300039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:20.300039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:20.300039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:20.300039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:20.300039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:20.300039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:20.300039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:20.300039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:20.300039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:20.300039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:20.300039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:20.300039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:20.301092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:20.301092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:20.301092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:20.301092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:20.301092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:20.301092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:20.301092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:20.301092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:20.301092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:20.301092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:20.301092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:20.301092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:20.301092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:20.301092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:20.301092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:20.301092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:20.302055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:20.302055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:20.302055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:20.302055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:20.302055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:20.302055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:20.302055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:20.302055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:20.302055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:20.302055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:20.302055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:33:20.302055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:33:20.303264 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 61/122] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:33:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:20.304855 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b782b7-fd26-427e-be5f-ac90c0ccc82c None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:20.384846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:20.412100 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0d134-d46d-4890-8846-908ceb0cf67d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:20.445680 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b782b7-fd26-427e-be5f-ac90c0ccc82c None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:20.450777 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1909f1-f1d1-4334-8723-b3a3be7dde91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:20.451611 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1909f1-f1d1-4334-8723-b3a3be7dde91 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:20.452047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1909f1-f1d1-4334-8723-b3a3be7dde91 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:20.452457 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1909f1-f1d1-4334-8723-b3a3be7dde91 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:20.453285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1909f1-f1d1-4334-8723-b3a3be7dde91 None admin] RBAC: Adding query filter params (name=member) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:20.453590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1909f1-f1d1-4334-8723-b3a3be7dde91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:20.454983 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1909f1-f1d1-4334-8723-b3a3be7dde91 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:20.465280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 62/123] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:20.466379 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1909f1-f1d1-4334-8723-b3a3be7dde91 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:20.490915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98008381-3930-4b97-b057-9170c5260119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:20.491605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98008381-3930-4b97-b057-9170c5260119 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:20.492142 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98008381-3930-4b97-b057-9170c5260119 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:20.492432 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98008381-3930-4b97-b057-9170c5260119 None admin] PATH_INFO: `/v3/users/10fb21e5e3c84511bf4f1b659ae7154b` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:20.493868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98008381-3930-4b97-b057-9170c5260119 None admin] RBAC: Authorizing `identity:get_user(user_id=10fb21e5e3c84511bf4f1b659ae7154b)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:20.496447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98008381-3930-4b97-b057-9170c5260119 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:20.498693 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 62/124] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:20 2022] GET /identity/v3/users/10fb21e5e3c84511bf4f1b659ae7154b => generated 247 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:20.500677 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98008381-3930-4b97-b057-9170c5260119 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:20.535930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:20.579601 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1909f1-f1d1-4334-8723-b3a3be7dde91 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:20.623523 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474757b8-19de-4d8d-8f36-def58ec6834c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:20.624795 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474757b8-19de-4d8d-8f36-def58ec6834c None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:20.625535 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474757b8-19de-4d8d-8f36-def58ec6834c None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:20.626421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474757b8-19de-4d8d-8f36-def58ec6834c None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:20.627642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474757b8-19de-4d8d-8f36-def58ec6834c None admin] RBAC: Adding query filter params (name=member) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:20.628150 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474757b8-19de-4d8d-8f36-def58ec6834c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:20.628949 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98008381-3930-4b97-b057-9170c5260119 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:20.630032 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474757b8-19de-4d8d-8f36-def58ec6834c None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:20.641879 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 63/125] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:20.643799 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474757b8-19de-4d8d-8f36-def58ec6834c None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:20.662395 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:20.674075 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73934f7e-0c70-4713-b054-a5ce36c30a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:20.675361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73934f7e-0c70-4713-b054-a5ce36c30a54 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:20.675525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73934f7e-0c70-4713-b054-a5ce36c30a54 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:20.675828 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73934f7e-0c70-4713-b054-a5ce36c30a54 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:20.676506 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73934f7e-0c70-4713-b054-a5ce36c30a54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:20.676823 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73934f7e-0c70-4713-b054-a5ce36c30a54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:20.678740 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73934f7e-0c70-4713-b054-a5ce36c30a54 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:20.690374 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 63/126] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:33:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:20.692399 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73934f7e-0c70-4713-b054-a5ce36c30a54 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:20.783229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474757b8-19de-4d8d-8f36-def58ec6834c None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:20.797497 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:20.817993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73934f7e-0c70-4713-b054-a5ce36c30a54 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:20.828651 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8a310-e81c-4548-a993-ff4230b8fcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:20.829694 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8a310-e81c-4548-a993-ff4230b8fcc7 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:20.830636 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8a310-e81c-4548-a993-ff4230b8fcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:20.831163 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8a310-e81c-4548-a993-ff4230b8fcc7 None admin] PATH_INFO: `/v3/users/8fbbf46ece0240fd9bd840b4ccefeeaf` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:20.833282 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8a310-e81c-4548-a993-ff4230b8fcc7 None admin] RBAC: Authorizing `identity:get_user(user_id=8fbbf46ece0240fd9bd840b4ccefeeaf)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:20.835717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8a310-e81c-4548-a993-ff4230b8fcc7 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:20.838124 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 64/127] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:20 2022] GET /identity/v3/users/8fbbf46ece0240fd9bd840b4ccefeeaf => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:20.839733 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8a310-e81c-4548-a993-ff4230b8fcc7 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:20.860097 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625e67a-a2f6-4dc6-9ab6-3b703a239b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:20.860761 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625e67a-a2f6-4dc6-9ab6-3b703a239b2b None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:20.861423 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625e67a-a2f6-4dc6-9ab6-3b703a239b2b None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:20.861770 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625e67a-a2f6-4dc6-9ab6-3b703a239b2b None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:20.863140 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625e67a-a2f6-4dc6-9ab6-3b703a239b2b None admin] RBAC: Authorizing `identity:get_project(project_id=40b14549caef48dfb5996de78e97302f)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:20.865071 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625e67a-a2f6-4dc6-9ab6-3b703a239b2b None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:20.866758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 64/128] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:20 2022] GET /identity/v3/projects/40b14549caef48dfb5996de78e97302f => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:20.867665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625e67a-a2f6-4dc6-9ab6-3b703a239b2b None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:20.951973 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:20.990868 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8a310-e81c-4548-a993-ff4230b8fcc7 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:21.012525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625e67a-a2f6-4dc6-9ab6-3b703a239b2b None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:21.032578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff73ca-ea7d-4e39-b770-98fce6abebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:21.033241 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff73ca-ea7d-4e39-b770-98fce6abebf6 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:21.033528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff73ca-ea7d-4e39-b770-98fce6abebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:21.033805 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff73ca-ea7d-4e39-b770-98fce6abebf6 None admin] PATH_INFO: `/v3/users/8fbbf46ece0240fd9bd840b4ccefeeaf` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:21.034938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff73ca-ea7d-4e39-b770-98fce6abebf6 None admin] RBAC: Authorizing `identity:get_user(user_id=8fbbf46ece0240fd9bd840b4ccefeeaf)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:21.036434 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff73ca-ea7d-4e39-b770-98fce6abebf6 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:21.038405 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 65/129] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:20 2022] GET /identity/v3/users/8fbbf46ece0240fd9bd840b4ccefeeaf => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:21.038866 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff73ca-ea7d-4e39-b770-98fce6abebf6 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:21.053837 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3389096-2315-4a03-807e-f2127aed6b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:21.054883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3389096-2315-4a03-807e-f2127aed6b81 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:21.055528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3389096-2315-4a03-807e-f2127aed6b81 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:21.056420 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3389096-2315-4a03-807e-f2127aed6b81 None admin] PATH_INFO: `/v3/users/8fbbf46ece0240fd9bd840b4ccefeeaf` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:21.058853 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3389096-2315-4a03-807e-f2127aed6b81 None admin] RBAC: Authorizing `identity:get_user(user_id=8fbbf46ece0240fd9bd840b4ccefeeaf)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:21.060683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3389096-2315-4a03-807e-f2127aed6b81 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:21.062864 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 65/130] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:20 2022] GET /identity/v3/users/8fbbf46ece0240fd9bd840b4ccefeeaf => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:21.064068 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3389096-2315-4a03-807e-f2127aed6b81 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:21.094926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:21.154160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff73ca-ea7d-4e39-b770-98fce6abebf6 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:21.190053 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3389096-2315-4a03-807e-f2127aed6b81 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:21.192869 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5a937-acbe-477c-b417-4e20e4aa4972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:21.193772 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5a937-acbe-477c-b417-4e20e4aa4972 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:21.194251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5a937-acbe-477c-b417-4e20e4aa4972 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:21.194765 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5a937-acbe-477c-b417-4e20e4aa4972 None admin] PATH_INFO: `/v3/projects/f4610a4df84b4edbbef0ab7a29a9e7eb` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:21.196147 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5a937-acbe-477c-b417-4e20e4aa4972 None admin] RBAC: Authorizing `identity:get_project(project_id=f4610a4df84b4edbbef0ab7a29a9e7eb)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:21.197806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5a937-acbe-477c-b417-4e20e4aa4972 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:21.200483 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 66/131] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:21 2022] GET /identity/v3/projects/f4610a4df84b4edbbef0ab7a29a9e7eb => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:21.201626 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5a937-acbe-477c-b417-4e20e4aa4972 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:21.218888 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:21.231848 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9e147-c672-4844-a295-e287f5581b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:21.232481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9e147-c672-4844-a295-e287f5581b9b None admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:21.239470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9e147-c672-4844-a295-e287f5581b9b None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:21.239470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9e147-c672-4844-a295-e287f5581b9b None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f/users/10fb21e5e3c84511bf4f1b659ae7154b/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:21.239470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9e147-c672-4844-a295-e287f5581b9b None admin] RBAC: Authorizing `identity:create_grant(project_id=40b14549caef48dfb5996de78e97302f, user_id=10fb21e5e3c84511bf4f1b659ae7154b, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:21.239470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9e147-c672-4844-a295-e287f5581b9b None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:21.313857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5a937-acbe-477c-b417-4e20e4aa4972 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:21.329414 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:21.333659 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 66/132] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:33:21 2022] PUT /identity/v3/projects/40b14549caef48dfb5996de78e97302f/users/10fb21e5e3c84511bf4f1b659ae7154b/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:33:21.335109 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9e147-c672-4844-a295-e287f5581b9b None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:21.382161 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293a12f-4a42-41e3-a078-622ffdd306fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:21.382573 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293a12f-4a42-41e3-a078-622ffdd306fc None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:21.382840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293a12f-4a42-41e3-a078-622ffdd306fc None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:21.389869 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293a12f-4a42-41e3-a078-622ffdd306fc None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:21.389869 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293a12f-4a42-41e3-a078-622ffdd306fc None admin] RBAC: Authorizing `identity:get_project(project_id=40b14549caef48dfb5996de78e97302f)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:21.390169 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293a12f-4a42-41e3-a078-622ffdd306fc None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:21.392690 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 67/133] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:21 2022] GET /identity/v3/projects/40b14549caef48dfb5996de78e97302f => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:21.393569 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293a12f-4a42-41e3-a078-622ffdd306fc None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:21.474072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9e147-c672-4844-a295-e287f5581b9b None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:21.517633 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f2e59-8192-4798-968c-e23824948608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:21.518371 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f2e59-8192-4798-968c-e23824948608 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:21.518565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f2e59-8192-4798-968c-e23824948608 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:21.518837 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f2e59-8192-4798-968c-e23824948608 None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:21.520030 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f2e59-8192-4798-968c-e23824948608 None admin] RBAC: Authorizing `identity:get_project(project_id=40b14549caef48dfb5996de78e97302f)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:21.521501 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f2e59-8192-4798-968c-e23824948608 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:21.523348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 67/134] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:21 2022] GET /identity/v3/projects/40b14549caef48dfb5996de78e97302f => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:21.523951 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f2e59-8192-4798-968c-e23824948608 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:21.582745 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:21.586437 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293a12f-4a42-41e3-a078-622ffdd306fc None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:21.624668 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4df5f-88b3-485f-8cd1-0f44c0984289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:21.625259 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4df5f-88b3-485f-8cd1-0f44c0984289 None admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:21.625614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4df5f-88b3-485f-8cd1-0f44c0984289 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:21.625846 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4df5f-88b3-485f-8cd1-0f44c0984289 None admin] PATH_INFO: `/v3/projects/f4610a4df84b4edbbef0ab7a29a9e7eb/users/8fbbf46ece0240fd9bd840b4ccefeeaf/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:21.627782 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4df5f-88b3-485f-8cd1-0f44c0984289 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4610a4df84b4edbbef0ab7a29a9e7eb, user_id=8fbbf46ece0240fd9bd840b4ccefeeaf, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:21.629236 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4df5f-88b3-485f-8cd1-0f44c0984289 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:21.639688 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f2e59-8192-4798-968c-e23824948608 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:21.675000 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56affd54-10b1-4efe-a802-ca4004394d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:21.675723 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56affd54-10b1-4efe-a802-ca4004394d8c None admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:21.676083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56affd54-10b1-4efe-a802-ca4004394d8c None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:21.676365 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56affd54-10b1-4efe-a802-ca4004394d8c None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f/users/8fbbf46ece0240fd9bd840b4ccefeeaf/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:21.678277 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56affd54-10b1-4efe-a802-ca4004394d8c None admin] RBAC: Authorizing `identity:create_grant(project_id=40b14549caef48dfb5996de78e97302f, user_id=8fbbf46ece0240fd9bd840b4ccefeeaf, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:21.679741 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56affd54-10b1-4efe-a802-ca4004394d8c None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:21.729897 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 68/135] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:33:21 2022] PUT /identity/v3/projects/f4610a4df84b4edbbef0ab7a29a9e7eb/users/8fbbf46ece0240fd9bd840b4ccefeeaf/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:33:21.731236 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16ccd0-cd7a-4f00-8626-3c2c2c712e5f None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:21.731523 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16ccd0-cd7a-4f00-8626-3c2c2c712e5f None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:21.731826 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16ccd0-cd7a-4f00-8626-3c2c2c712e5f None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:21.733270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 69/136] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:21.737334 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206526c3-204b-4655-bbde-297bbe34ffd2 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:21.737864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206526c3-204b-4655-bbde-297bbe34ffd2 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:21.738207 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206526c3-204b-4655-bbde-297bbe34ffd2 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:21.739833 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 70/137] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:21.744823 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206526c3-204b-4655-bbde-297bbe34ffd2 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:21.763093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 68/138] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:33:21 2022] PUT /identity/v3/projects/40b14549caef48dfb5996de78e97302f/users/8fbbf46ece0240fd9bd840b4ccefeeaf/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:33:21.765124 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66b8d1-dee5-43fb-b4b5-f2c6b63e3f0a None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:21.765766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66b8d1-dee5-43fb-b4b5-f2c6b63e3f0a None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:21.766322 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66b8d1-dee5-43fb-b4b5-f2c6b63e3f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:21.788539 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-2b66b8d1-dee5-43fb-b4b5-f2c6b63e3f0a None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:21.790340 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2b66b8d1-dee5-43fb-b4b5-f2c6b63e3f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:21.804699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:21.894034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 69/139] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:21.898161 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d268da-db9c-4b91-85dd-ada7e33d415a None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:21.898445 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d268da-db9c-4b91-85dd-ada7e33d415a None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:21.898720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d268da-db9c-4b91-85dd-ada7e33d415a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:21.909291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206526c3-204b-4655-bbde-297bbe34ffd2 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:21.942847 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-03d268da-db9c-4b91-85dd-ada7e33d415a None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:21.944136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-03d268da-db9c-4b91-85dd-ada7e33d415a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:22.014494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0703aa9-d97b-4910-a727-66ab6a8a7836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:22.015190 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0703aa9-d97b-4910-a727-66ab6a8a7836 None admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:22.015504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0703aa9-d97b-4910-a727-66ab6a8a7836 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:22.015808 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0703aa9-d97b-4910-a727-66ab6a8a7836 None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f/users/8fbbf46ece0240fd9bd840b4ccefeeaf/roles/fd65be88941941298be36b142df9b505` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:22.024892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0703aa9-d97b-4910-a727-66ab6a8a7836 None admin] RBAC: Authorizing `identity:create_grant(project_id=40b14549caef48dfb5996de78e97302f, user_id=8fbbf46ece0240fd9bd840b4ccefeeaf, role_id=fd65be88941941298be36b142df9b505)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:22.025915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0703aa9-d97b-4910-a727-66ab6a8a7836 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:22.028438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:22.072945 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 70/140] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:22.139426 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 71/141] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:33:21 2022] PUT /identity/v3/projects/40b14549caef48dfb5996de78e97302f/users/8fbbf46ece0240fd9bd840b4ccefeeaf/roles/fd65be88941941298be36b142df9b505 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:33:22.216024 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d268da-db9c-4b91-85dd-ada7e33d415a None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:22.327566 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d268da-db9c-4b91-85dd-ada7e33d415a None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:22.377866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a790cb3-ddc9-485b-a9af-51b0bf13228c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:22.378584 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a790cb3-ddc9-485b-a9af-51b0bf13228c None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:22.378879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a790cb3-ddc9-485b-a9af-51b0bf13228c None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:22.379151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a790cb3-ddc9-485b-a9af-51b0bf13228c None admin] PATH_INFO: `/v3/domains/default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:22.380287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a790cb3-ddc9-485b-a9af-51b0bf13228c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:22.381766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a790cb3-ddc9-485b-a9af-51b0bf13228c None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:22.383426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 71/142] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:33:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:22.389650 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0703aa9-d97b-4910-a727-66ab6a8a7836 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:22.483281 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a790cb3-ddc9-485b-a9af-51b0bf13228c None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:22.540267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:22.565725 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0703aa9-d97b-4910-a727-66ab6a8a7836 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:22.567592 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:22.626082 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a790cb3-ddc9-485b-a9af-51b0bf13228c None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:22.626902 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a36512-038f-4840-a43f-2d5427dd9c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:22.627582 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a36512-038f-4840-a43f-2d5427dd9c6b None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:22.627869 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a36512-038f-4840-a43f-2d5427dd9c6b None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:22.628139 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a36512-038f-4840-a43f-2d5427dd9c6b None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:22.630254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a36512-038f-4840-a43f-2d5427dd9c6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:22.631740 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a36512-038f-4840-a43f-2d5427dd9c6b None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:22.700267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29796af9-7b2d-4b8a-a097-a0c763ad3b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:22.700927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29796af9-7b2d-4b8a-a097-a0c763ad3b42 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:22.701209 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29796af9-7b2d-4b8a-a097-a0c763ad3b42 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:22.701480 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29796af9-7b2d-4b8a-a097-a0c763ad3b42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:22.715811 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29796af9-7b2d-4b8a-a097-a0c763ad3b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:22.720729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-29796af9-7b2d-4b8a-a097-a0c763ad3b42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 19:33:22.720729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:22.720729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:22.720729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:22.720729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:22.720729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:22.720729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:22.720729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:22.720729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:22.720729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:22.720729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:22.720729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:22.720729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:22.720729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:22.720729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:22.720729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:22.721581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:22.721581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:22.721581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:22.721581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:22.721581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:22.721581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:22.721581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:22.721581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:22.721581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:22.721581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:22.721581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:22.721581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:22.721581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:22.721581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:22.721581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:22.721581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:22.722316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:22.722316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:22.722316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:22.722316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:22.722316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:22.722316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:22.722316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:22.722316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:22.722316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:22.722316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:22.722316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 19:33:22.722316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:33:22.722316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 72/143] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:22.727367 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29796af9-7b2d-4b8a-a097-a0c763ad3b42 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:22.759464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 72/144] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Sep 14 19:33:22 2022] POST /identity/v3/users => generated 283 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:33:22.902279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:22.906009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29796af9-7b2d-4b8a-a097-a0c763ad3b42 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:22.964997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58156a-fa03-4e09-ab71-a4df6b1cb300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:22.965757 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58156a-fa03-4e09-ab71-a4df6b1cb300 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:22.966034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58156a-fa03-4e09-ab71-a4df6b1cb300 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:22.966301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58156a-fa03-4e09-ab71-a4df6b1cb300 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:22.966982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58156a-fa03-4e09-ab71-a4df6b1cb300 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:22.967286 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58156a-fa03-4e09-ab71-a4df6b1cb300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:22.968747 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58156a-fa03-4e09-ab71-a4df6b1cb300 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:22.984793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 73/145] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:22.990726 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a36512-038f-4840-a43f-2d5427dd9c6b None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:23.112612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a36512-038f-4840-a43f-2d5427dd9c6b None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:23.149341 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3870930-54b2-4daf-a98d-d455e9eaae08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:23.150334 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3870930-54b2-4daf-a98d-d455e9eaae08 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:23.150830 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3870930-54b2-4daf-a98d-d455e9eaae08 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:23.151295 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3870930-54b2-4daf-a98d-d455e9eaae08 None admin] PATH_INFO: `/v3/users/87f669af2258454fadb832ca4bac14bc` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:23.153002 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3870930-54b2-4daf-a98d-d455e9eaae08 None admin] RBAC: Authorizing `identity:get_user(user_id=87f669af2258454fadb832ca4bac14bc)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:23.154851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3870930-54b2-4daf-a98d-d455e9eaae08 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:23.156982 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 73/146] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:22 2022] GET /identity/v3/users/87f669af2258454fadb832ca4bac14bc => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:23.162182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58156a-fa03-4e09-ab71-a4df6b1cb300 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:23.270730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58156a-fa03-4e09-ab71-a4df6b1cb300 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:23.306781 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad3aab-c33f-4fa7-9c7d-999dd5ccf050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:23.308369 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad3aab-c33f-4fa7-9c7d-999dd5ccf050 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:23.308946 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad3aab-c33f-4fa7-9c7d-999dd5ccf050 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:23.309455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad3aab-c33f-4fa7-9c7d-999dd5ccf050 None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:23.310813 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad3aab-c33f-4fa7-9c7d-999dd5ccf050 None admin] RBAC: Authorizing `identity:get_project(project_id=40b14549caef48dfb5996de78e97302f)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:23.312511 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad3aab-c33f-4fa7-9c7d-999dd5ccf050 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:23.314362 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 74/147] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:23 2022] GET /identity/v3/projects/40b14549caef48dfb5996de78e97302f => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:23.320201 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3870930-54b2-4daf-a98d-d455e9eaae08 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:23.356078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:23.446393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3870930-54b2-4daf-a98d-d455e9eaae08 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:23.489246 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d43b8-eaf8-439c-8fdf-e7ec6bced725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:23.489998 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d43b8-eaf8-439c-8fdf-e7ec6bced725 None admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:23.490328 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d43b8-eaf8-439c-8fdf-e7ec6bced725 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:23.490604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d43b8-eaf8-439c-8fdf-e7ec6bced725 None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f/users/87f669af2258454fadb832ca4bac14bc/roles/44508e6bd9ba4b1b826ac09f102b2782` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:23.492674 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d43b8-eaf8-439c-8fdf-e7ec6bced725 None admin] RBAC: Authorizing `identity:create_grant(project_id=40b14549caef48dfb5996de78e97302f, user_id=87f669af2258454fadb832ca4bac14bc, role_id=44508e6bd9ba4b1b826ac09f102b2782)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:23.494208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d43b8-eaf8-439c-8fdf-e7ec6bced725 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:23.567791 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 74/148] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:33:23 2022] PUT /identity/v3/projects/40b14549caef48dfb5996de78e97302f/users/87f669af2258454fadb832ca4bac14bc/roles/44508e6bd9ba4b1b826ac09f102b2782 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:33:24.492419 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04644f9f-4149-411a-a68e-817f4ff543d8 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:24.492920 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04644f9f-4149-411a-a68e-817f4ff543d8 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:24.492992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04644f9f-4149-411a-a68e-817f4ff543d8 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:24.494560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 75/149] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:24.501222 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94439fee-b18d-42e0-9b17-d0cb97e2bdd7 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:24.501654 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94439fee-b18d-42e0-9b17-d0cb97e2bdd7 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:24.501841 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94439fee-b18d-42e0-9b17-d0cb97e2bdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:24.525292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-94439fee-b18d-42e0-9b17-d0cb97e2bdd7 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:24.526487 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-94439fee-b18d-42e0-9b17-d0cb97e2bdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:24.561311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785d80b-40e5-4a38-967a-536de87e3168 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:24.561605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785d80b-40e5-4a38-967a-536de87e3168 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:24.561856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785d80b-40e5-4a38-967a-536de87e3168 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:24.563444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 76/150] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:24.568911 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c25b95-3238-4684-9555-33da9c2ac4f2 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:24.569194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c25b95-3238-4684-9555-33da9c2ac4f2 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:24.569467 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c25b95-3238-4684-9555-33da9c2ac4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:24.607028 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-58c25b95-3238-4684-9555-33da9c2ac4f2 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:24.610081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-58c25b95-3238-4684-9555-33da9c2ac4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:24.674888 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:24.676921 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 75/151] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:24.731372 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 77/152] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:33:25.188459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94439fee-b18d-42e0-9b17-d0cb97e2bdd7 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:25.213545 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:25.317667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94439fee-b18d-42e0-9b17-d0cb97e2bdd7 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:25.356319 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c25b95-3238-4684-9555-33da9c2ac4f2 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:25.370354 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab12875-a7ec-4cb9-a00e-9985d55d3c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:25.371347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab12875-a7ec-4cb9-a00e-9985d55d3c85 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:25.371626 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab12875-a7ec-4cb9-a00e-9985d55d3c85 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:25.371908 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab12875-a7ec-4cb9-a00e-9985d55d3c85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:25.396756 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab12875-a7ec-4cb9-a00e-9985d55d3c85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:25.402112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-6ab12875-a7ec-4cb9-a00e-9985d55d3c85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:33:25.402112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:25.402112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:25.402112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:25.402112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:25.402112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:25.402112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:25.402112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:25.402112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:25.402112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:25.402112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:25.402112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:25.402112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:25.402112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:25.402112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:25.402112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:25.403903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:25.403903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:25.403903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:25.403903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:25.403903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:25.403903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:25.403903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:25.403903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:25.403903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:25.403903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:25.403903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:25.403903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:25.403903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:25.403903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:25.403903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:25.403903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:25.404737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:25.404737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:25.404737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:25.404737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:25.404737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:25.404737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:25.404737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:25.404737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:25.404737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:25.404737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:25.404737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:33:25.404737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:25.404737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 76/153] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:33:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:25.416475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab12875-a7ec-4cb9-a00e-9985d55d3c85 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:25.583350 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:25.594865 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c25b95-3238-4684-9555-33da9c2ac4f2 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:25.624416 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab12875-a7ec-4cb9-a00e-9985d55d3c85 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:25.672858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e9e26-9a4f-4e18-9cf9-bd32b2f0e0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:25.673935 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e9e26-9a4f-4e18-9cf9-bd32b2f0e0a1 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:25.674417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e9e26-9a4f-4e18-9cf9-bd32b2f0e0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:25.674889 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e9e26-9a4f-4e18-9cf9-bd32b2f0e0a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:25.685464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db3522-4681-4ec0-b197-3c5ff5d10080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:25.686125 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db3522-4681-4ec0-b197-3c5ff5d10080 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:25.686593 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db3522-4681-4ec0-b197-3c5ff5d10080 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:25.687065 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db3522-4681-4ec0-b197-3c5ff5d10080 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:25.690800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db3522-4681-4ec0-b197-3c5ff5d10080 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:25.690800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db3522-4681-4ec0-b197-3c5ff5d10080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:25.690800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db3522-4681-4ec0-b197-3c5ff5d10080 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:25.697416 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e9e26-9a4f-4e18-9cf9-bd32b2f0e0a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:25.702999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-de6e9e26-9a4f-4e18-9cf9-bd32b2f0e0a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:25.702999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:25.702999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:25.702999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:25.702999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:25.702999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:25.702999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:25.702999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:25.702999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:25.702999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:25.702999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:25.702999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:25.702999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:25.702999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:25.702999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:25.702999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:25.704014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:25.704014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:25.704014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:25.704014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:25.704014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:25.704014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:25.704014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:25.704014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:25.704014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:25.704014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:25.704014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:25.704014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:25.704014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:25.704014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:25.704014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:25.704014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:25.704802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:25.704802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:25.704802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:25.704802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:25.704802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:25.704802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:25.704802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:25.704802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:25.704802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:25.704802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:25.704802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:25.704802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:33:25.707367 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 78/154] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:25.708805 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de53e0b-0ced-4da2-b52d-4779a66bf1d6 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:25.709290 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de53e0b-0ced-4da2-b52d-4779a66bf1d6 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:25.709583 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 77/155] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:25.710525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de53e0b-0ced-4da2-b52d-4779a66bf1d6 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:25.715619 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db3522-4681-4ec0-b197-3c5ff5d10080 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:25.716548 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 79/156] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:25.719350 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de53e0b-0ced-4da2-b52d-4779a66bf1d6 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:25.756942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:25.882656 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de53e0b-0ced-4da2-b52d-4779a66bf1d6 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:25.940924 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db3522-4681-4ec0-b197-3c5ff5d10080 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:25.965150 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f839e-e133-4045-aaba-daeccc4de78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:25.965677 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f839e-e133-4045-aaba-daeccc4de78e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:25.965962 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f839e-e133-4045-aaba-daeccc4de78e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:25.966241 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f839e-e133-4045-aaba-daeccc4de78e None admin] PATH_INFO: `/v3/users/10fb21e5e3c84511bf4f1b659ae7154b` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:25.972278 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f839e-e133-4045-aaba-daeccc4de78e None admin] RBAC: Authorizing `identity:get_user(user_id=10fb21e5e3c84511bf4f1b659ae7154b)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:25.973767 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f839e-e133-4045-aaba-daeccc4de78e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:25.975378 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 80/157] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:25 2022] GET /identity/v3/users/10fb21e5e3c84511bf4f1b659ae7154b => generated 247 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:25.976962 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c25efe-96f3-42d3-a505-7a66d6d97de4 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:25.976962 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c25efe-96f3-42d3-a505-7a66d6d97de4 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:25.977250 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c25efe-96f3-42d3-a505-7a66d6d97de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:25.986320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07483e40-c125-4ab7-826a-ef3dc87c98ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:25.987364 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07483e40-c125-4ab7-826a-ef3dc87c98ec None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:25.987888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07483e40-c125-4ab7-826a-ef3dc87c98ec None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:25.988363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07483e40-c125-4ab7-826a-ef3dc87c98ec None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:25.989308 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07483e40-c125-4ab7-826a-ef3dc87c98ec None admin] RBAC: Adding query filter params (name=member) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:25.989872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07483e40-c125-4ab7-826a-ef3dc87c98ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:25.991502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07483e40-c125-4ab7-826a-ef3dc87c98ec None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:25.997678 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:26.002959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 78/158] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:26.004117 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07483e40-c125-4ab7-826a-ef3dc87c98ec None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:26.008942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-80c25efe-96f3-42d3-a505-7a66d6d97de4 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:26.010159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-80c25efe-96f3-42d3-a505-7a66d6d97de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:26.153795 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 81/159] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:26.155519 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4ac1a-93eb-4b6a-bcab-2986c4ae42f5 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:26.156810 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4ac1a-93eb-4b6a-bcab-2986c4ae42f5 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:26.158036 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4ac1a-93eb-4b6a-bcab-2986c4ae42f5 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:26.159700 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 82/160] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:26.160687 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4ac1a-93eb-4b6a-bcab-2986c4ae42f5 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:26.168740 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07483e40-c125-4ab7-826a-ef3dc87c98ec None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:26.190190 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:26.242290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bc6ec-3508-426a-8ff8-b87bd369feaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:26.243286 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bc6ec-3508-426a-8ff8-b87bd369feaa None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:26.243845 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bc6ec-3508-426a-8ff8-b87bd369feaa None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:26.244974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bc6ec-3508-426a-8ff8-b87bd369feaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:26.359913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4ac1a-93eb-4b6a-bcab-2986c4ae42f5 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:26.399089 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:26.403262 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5bc6ec-3508-426a-8ff8-b87bd369feaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:26.410982 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5bc6ec-3508-426a-8ff8-b87bd369feaa None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:26.456267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ed75b-b887-4ec6-8091-50c7615e6685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:26.456917 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ed75b-b887-4ec6-8091-50c7615e6685 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:26.457323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ed75b-b887-4ec6-8091-50c7615e6685 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:26.457604 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ed75b-b887-4ec6-8091-50c7615e6685 None admin] PATH_INFO: `/v3/users/8fbbf46ece0240fd9bd840b4ccefeeaf` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:26.458873 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ed75b-b887-4ec6-8091-50c7615e6685 None admin] RBAC: Authorizing `identity:get_user(user_id=8fbbf46ece0240fd9bd840b4ccefeeaf)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:26.460363 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ed75b-b887-4ec6-8091-50c7615e6685 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:26.467824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 83/161] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:26 2022] GET /identity/v3/users/8fbbf46ece0240fd9bd840b4ccefeeaf => generated 275 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:26.467824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325ab09-1e13-43fc-8868-27e1a3e34849 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:26.467824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325ab09-1e13-43fc-8868-27e1a3e34849 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:26.467824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325ab09-1e13-43fc-8868-27e1a3e34849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:26.505093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-0325ab09-1e13-43fc-8868-27e1a3e34849 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:26.506287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-0325ab09-1e13-43fc-8868-27e1a3e34849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:26.575122 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 79/162] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:33:26.576471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bc6ec-3508-426a-8ff8-b87bd369feaa None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:26.674123 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 84/163] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:26.674847 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325ab09-1e13-43fc-8868-27e1a3e34849 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:26.703521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:26.729348 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:26.733393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bc6ec-3508-426a-8ff8-b87bd369feaa None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:26.788779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef61272-f639-499c-a422-a9add88f901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:26.789395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef61272-f639-499c-a422-a9add88f901c None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:26.789666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef61272-f639-499c-a422-a9add88f901c None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:26.789930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef61272-f639-499c-a422-a9add88f901c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:26.810296 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325ab09-1e13-43fc-8868-27e1a3e34849 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:26.939096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4abd61-d92c-4f5b-835c-076de223e96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:26.939687 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4abd61-d92c-4f5b-835c-076de223e96a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:26.939969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4abd61-d92c-4f5b-835c-076de223e96a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:26.940247 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4abd61-d92c-4f5b-835c-076de223e96a None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:26.941581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4abd61-d92c-4f5b-835c-076de223e96a None admin] RBAC: Authorizing `identity:get_project(project_id=40b14549caef48dfb5996de78e97302f)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:26.942998 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef61272-f639-499c-a422-a9add88f901c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:26.943105 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4abd61-d92c-4f5b-835c-076de223e96a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:26.945936 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 85/164] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:26 2022] GET /identity/v3/projects/40b14549caef48dfb5996de78e97302f => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:26.945936 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4abd61-d92c-4f5b-835c-076de223e96a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:26.947582 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef61272-f639-499c-a422-a9add88f901c None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:27.075895 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:27.100148 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4abd61-d92c-4f5b-835c-076de223e96a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:27.133818 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:27.138401 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 80/165] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:33:27.139056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef61272-f639-499c-a422-a9add88f901c None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:27.150881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47374f-4a9e-49bb-9e26-e8ee2a511b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:27.151589 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47374f-4a9e-49bb-9e26-e8ee2a511b21 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:27.151877 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47374f-4a9e-49bb-9e26-e8ee2a511b21 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:27.152670 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47374f-4a9e-49bb-9e26-e8ee2a511b21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:27.173691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47374f-4a9e-49bb-9e26-e8ee2a511b21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:27.185986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-1d47374f-4a9e-49bb-9e26-e8ee2a511b21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:33:27.185986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:27.185986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:27.185986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:27.185986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:27.185986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:27.185986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:27.185986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:27.185986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:27.185986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:27.185986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:27.185986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:27.185986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:27.185986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:27.185986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:27.185986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:27.186884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:27.186884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:27.186884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:27.186884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:27.186884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:27.186884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:27.186884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:27.186884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:27.186884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:27.186884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:27.186884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:27.186884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:27.186884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:27.186884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:27.186884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:27.186884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:27.187905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:27.187905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:27.187905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:27.187905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:27.187905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:27.187905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:27.187905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:27.187905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:27.187905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:27.187905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:27.187905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:33:27.187905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:33:27.187905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 86/166] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:33:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:27.188547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47374f-4a9e-49bb-9e26-e8ee2a511b21 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:27.353006 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef61272-f639-499c-a422-a9add88f901c None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:27.401490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47374f-4a9e-49bb-9e26-e8ee2a511b21 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:27.425753 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5405722-f3b3-408e-a611-6015c7301d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:27.427368 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5405722-f3b3-408e-a611-6015c7301d6e None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:27.427665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5405722-f3b3-408e-a611-6015c7301d6e None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:27.427934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5405722-f3b3-408e-a611-6015c7301d6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:27.428664 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5405722-f3b3-408e-a611-6015c7301d6e None admin] RBAC: Adding query filter params (role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a, scope.project.id=40b14549caef48dfb5996de78e97302f, user.id=10fb21e5e3c84511bf4f1b659ae7154b) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:27.428967 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5405722-f3b3-408e-a611-6015c7301d6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:27.430405 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5405722-f3b3-408e-a611-6015c7301d6e None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:27.444961 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 81/167] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:33:27 2022] GET /identity/v3/role_assignments?user.id=10fb21e5e3c84511bf4f1b659ae7154b&scope.project.id=40b14549caef48dfb5996de78e97302f&role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 608 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:27.445793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5405722-f3b3-408e-a611-6015c7301d6e None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:27.461837 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eef6be-016d-473c-9a3a-4ffa2fa45ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:27.462482 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eef6be-016d-473c-9a3a-4ffa2fa45ad8 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:27.462761 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eef6be-016d-473c-9a3a-4ffa2fa45ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:27.463033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eef6be-016d-473c-9a3a-4ffa2fa45ad8 None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:27.464178 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eef6be-016d-473c-9a3a-4ffa2fa45ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=40b14549caef48dfb5996de78e97302f)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:27.465718 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eef6be-016d-473c-9a3a-4ffa2fa45ad8 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:27.476066 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 87/168] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:27 2022] GET /identity/v3/projects/40b14549caef48dfb5996de78e97302f => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:27.477240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eef6be-016d-473c-9a3a-4ffa2fa45ad8 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:27.498453 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:27.568757 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:27.592933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eef6be-016d-473c-9a3a-4ffa2fa45ad8 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:27.630824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b367d97-8c6c-4adb-ac1b-4df5a003ff7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:27.631372 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b367d97-8c6c-4adb-ac1b-4df5a003ff7d None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:27.631700 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b367d97-8c6c-4adb-ac1b-4df5a003ff7d None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:27.631946 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b367d97-8c6c-4adb-ac1b-4df5a003ff7d None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:27.632631 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b367d97-8c6c-4adb-ac1b-4df5a003ff7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:27.632931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b367d97-8c6c-4adb-ac1b-4df5a003ff7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:27.634340 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b367d97-8c6c-4adb-ac1b-4df5a003ff7d None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:27.638082 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5405722-f3b3-408e-a611-6015c7301d6e None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:27.644407 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 88/169] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:33:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:27.645682 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63ae75-46da-4804-a94e-29a12f56eddc None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:27.645961 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63ae75-46da-4804-a94e-29a12f56eddc None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:27.646228 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63ae75-46da-4804-a94e-29a12f56eddc None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:27.647600 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 89/170] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:27.648144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63ae75-46da-4804-a94e-29a12f56eddc None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:27.705417 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f530a84-841f-487a-895a-9e4dd98c4b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:27.706131 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f530a84-841f-487a-895a-9e4dd98c4b69 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:27.706430 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f530a84-841f-487a-895a-9e4dd98c4b69 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:27.706740 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f530a84-841f-487a-895a-9e4dd98c4b69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:27.729467 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f530a84-841f-487a-895a-9e4dd98c4b69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:27.737969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:27.741580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-5f530a84-841f-487a-895a-9e4dd98c4b69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:27.741580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:27.741580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:27.741580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:27.741580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:27.741580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:27.741580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:27.741580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:27.741580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:27.741580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:27.741580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:27.741580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:27.741580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:27.741580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:27.741580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:27.741580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:27.742478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:27.742478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:27.742478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:27.742478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:27.742478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:27.742478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:27.742478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:27.742478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:27.742478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:27.742478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:27.742478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:27.742478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:27.742478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:27.742478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:27.742478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:27.742478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:27.743254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:27.743254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:27.743254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:27.743254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:27.743254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:27.743254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:27.743254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:27.743254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:27.743254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:27.743254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:27.743254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:27.743254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:27.755268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 82/171] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:27.755268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c30065-1901-45ce-bf12-ee19f303823b None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:27.755268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c30065-1901-45ce-bf12-ee19f303823b None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:27.755268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c30065-1901-45ce-bf12-ee19f303823b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:27.769160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63ae75-46da-4804-a94e-29a12f56eddc None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:27.787055 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-84c30065-1901-45ce-bf12-ee19f303823b None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:27.788544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-84c30065-1901-45ce-bf12-ee19f303823b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:27.809943 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5be311-dc01-410b-a0d9-7f695ad91083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:27.810722 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5be311-dc01-410b-a0d9-7f695ad91083 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:27.811114 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5be311-dc01-410b-a0d9-7f695ad91083 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:27.811523 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5be311-dc01-410b-a0d9-7f695ad91083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:27.812405 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5be311-dc01-410b-a0d9-7f695ad91083 None admin] RBAC: Adding query filter params (role.id=f63dc07e563f4ffb9f88aa95c528da47, scope.project.id=40b14549caef48dfb5996de78e97302f, user.id=8fbbf46ece0240fd9bd840b4ccefeeaf) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:27.812813 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5be311-dc01-410b-a0d9-7f695ad91083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:27.814563 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5be311-dc01-410b-a0d9-7f695ad91083 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:27.821708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 90/172] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:33:27 2022] GET /identity/v3/role_assignments?user.id=8fbbf46ece0240fd9bd840b4ccefeeaf&scope.project.id=40b14549caef48dfb5996de78e97302f&role.id=f63dc07e563f4ffb9f88aa95c528da47 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:27.828582 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5be311-dc01-410b-a0d9-7f695ad91083 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:27.931789 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 83/173] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:27.932947 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c30065-1901-45ce-bf12-ee19f303823b None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:27.983216 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5be311-dc01-410b-a0d9-7f695ad91083 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:28.024453 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72afd5-0339-4344-9f06-f144a948d512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:28.025230 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72afd5-0339-4344-9f06-f144a948d512 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:28.025605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72afd5-0339-4344-9f06-f144a948d512 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:28.025973 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72afd5-0339-4344-9f06-f144a948d512 None admin] PATH_INFO: `/v3/users/8fbbf46ece0240fd9bd840b4ccefeeaf` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:28.027260 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72afd5-0339-4344-9f06-f144a948d512 None admin] RBAC: Authorizing `identity:get_user(user_id=8fbbf46ece0240fd9bd840b4ccefeeaf)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:28.031919 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72afd5-0339-4344-9f06-f144a948d512 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:28.031919 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 91/174] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:27 2022] GET /identity/v3/users/8fbbf46ece0240fd9bd840b4ccefeeaf => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:28.031919 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6058d16-6549-4fcf-919b-fb839d520215 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:28.032460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6058d16-6549-4fcf-919b-fb839d520215 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:28.034221 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6058d16-6549-4fcf-919b-fb839d520215 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:28.034221 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 92/175] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:28.040559 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6058d16-6549-4fcf-919b-fb839d520215 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:28.056730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:28.060039 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:28.170187 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c30065-1901-45ce-bf12-ee19f303823b None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:28.236753 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26673596-9103-4e19-9e3a-e794f3ae97f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:28.237302 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26673596-9103-4e19-9e3a-e794f3ae97f1 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:28.237577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26673596-9103-4e19-9e3a-e794f3ae97f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:28.237848 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26673596-9103-4e19-9e3a-e794f3ae97f1 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:28.238525 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26673596-9103-4e19-9e3a-e794f3ae97f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:28.238826 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26673596-9103-4e19-9e3a-e794f3ae97f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:28.240319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26673596-9103-4e19-9e3a-e794f3ae97f1 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:28.258702 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 84/176] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:28.262057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17400a-14d3-4d66-affa-1762c7ad7163 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:28.262407 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17400a-14d3-4d66-affa-1762c7ad7163 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:28.263192 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17400a-14d3-4d66-affa-1762c7ad7163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:28.286571 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-4a17400a-14d3-4d66-affa-1762c7ad7163 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:28.287754 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-4a17400a-14d3-4d66-affa-1762c7ad7163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:28.304371 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6058d16-6549-4fcf-919b-fb839d520215 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:28.362750 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35107a80-5381-4ac4-8920-f78fc224963f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:28.363376 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35107a80-5381-4ac4-8920-f78fc224963f None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:28.363693 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35107a80-5381-4ac4-8920-f78fc224963f None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:28.363967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35107a80-5381-4ac4-8920-f78fc224963f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:28.391420 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 85/177] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:28.393654 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17400a-14d3-4d66-affa-1762c7ad7163 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:28.461299 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:28.483785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35107a80-5381-4ac4-8920-f78fc224963f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:28.486476 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35107a80-5381-4ac4-8920-f78fc224963f None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:28.497566 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:28.519403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17400a-14d3-4d66-affa-1762c7ad7163 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:28.557038 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72394783-7bb4-49fd-bb15-9ac87e876700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:28.557695 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72394783-7bb4-49fd-bb15-9ac87e876700 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:28.558026 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72394783-7bb4-49fd-bb15-9ac87e876700 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:28.558296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72394783-7bb4-49fd-bb15-9ac87e876700 None admin] PATH_INFO: `/v3/users/8fbbf46ece0240fd9bd840b4ccefeeaf` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:28.559570 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72394783-7bb4-49fd-bb15-9ac87e876700 None admin] RBAC: Authorizing `identity:get_user(user_id=8fbbf46ece0240fd9bd840b4ccefeeaf)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:28.561130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72394783-7bb4-49fd-bb15-9ac87e876700 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:28.563071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 86/178] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:28 2022] GET /identity/v3/users/8fbbf46ece0240fd9bd840b4ccefeeaf => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:28.564346 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c053ce7-e3d0-421c-8713-2f27c70ac97d None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:28.564626 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c053ce7-e3d0-421c-8713-2f27c70ac97d None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:28.564895 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c053ce7-e3d0-421c-8713-2f27c70ac97d None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:28.570323 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 87/179] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:28.571115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c053ce7-e3d0-421c-8713-2f27c70ac97d None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:28.617765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 93/180] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:33:28.617765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35107a80-5381-4ac4-8920-f78fc224963f None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:28.700896 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c053ce7-e3d0-421c-8713-2f27c70ac97d None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:28.715948 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:28.731240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35107a80-5381-4ac4-8920-f78fc224963f None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:28.736272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c91427-9bcb-4bc0-9254-d1deb829ce93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:28.736913 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c91427-9bcb-4bc0-9254-d1deb829ce93 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:28.737188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c91427-9bcb-4bc0-9254-d1deb829ce93 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:28.737461 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c91427-9bcb-4bc0-9254-d1deb829ce93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:28.739579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:28.748266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c91427-9bcb-4bc0-9254-d1deb829ce93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:28.753404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-77c91427-9bcb-4bc0-9254-d1deb829ce93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:33:28.753404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:28.753404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:28.753404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:28.753404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:28.753404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:28.753404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:28.753404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:28.753404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:28.753404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:28.753404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:28.753404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:28.753404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:28.753404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:28.753404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:28.753404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:28.754439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:28.754439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:28.754439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:28.754439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:28.754439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:28.754439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:28.754439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:28.754439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:28.754439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:28.754439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:28.754439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:28.754439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:28.754439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:28.754439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:28.754439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:28.754439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:28.755475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:28.755475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:28.755475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:28.755475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:28.755475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:28.755475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:28.755475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:28.755475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:28.755475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:28.755475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:28.755475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:33:28.755475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:28.755475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 88/181] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:33:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:28.756373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d246cb-c31c-4b2d-bc39-4393b71171e9 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:28.756602 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d246cb-c31c-4b2d-bc39-4393b71171e9 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:28.756985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d246cb-c31c-4b2d-bc39-4393b71171e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:28.769828 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c76f71-faa3-4edb-8891-57a13b29c73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:28.770444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c76f71-faa3-4edb-8891-57a13b29c73c None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:28.770731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c76f71-faa3-4edb-8891-57a13b29c73c None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:28.771005 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c76f71-faa3-4edb-8891-57a13b29c73c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:28.775606 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-06d246cb-c31c-4b2d-bc39-4393b71171e9 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:28.776788 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-06d246cb-c31c-4b2d-bc39-4393b71171e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:28.840640 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c76f71-faa3-4edb-8891-57a13b29c73c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:28.843492 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c76f71-faa3-4edb-8891-57a13b29c73c None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:28.857680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 89/182] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:28.858637 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d246cb-c31c-4b2d-bc39-4393b71171e9 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:28.953743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 94/183] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:33:28.954806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c76f71-faa3-4edb-8891-57a13b29c73c None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:28.965329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:28.969625 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d246cb-c31c-4b2d-bc39-4393b71171e9 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:28.974039 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:29.010273 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b8b5e-e5cd-45fe-8a8d-a3f9d677a7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:29.010846 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b8b5e-e5cd-45fe-8a8d-a3f9d677a7d4 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:29.011121 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b8b5e-e5cd-45fe-8a8d-a3f9d677a7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:29.011510 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b8b5e-e5cd-45fe-8a8d-a3f9d677a7d4 None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:29.017017 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b8b5e-e5cd-45fe-8a8d-a3f9d677a7d4 None admin] RBAC: Authorizing `identity:get_project(project_id=40b14549caef48dfb5996de78e97302f)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:29.017017 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b8b5e-e5cd-45fe-8a8d-a3f9d677a7d4 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:29.017017 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 90/184] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:28 2022] GET /identity/v3/projects/40b14549caef48dfb5996de78e97302f => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:29.020762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb045d5-4b65-4662-a9e0-8082ae07a3c3 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:29.021897 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb045d5-4b65-4662-a9e0-8082ae07a3c3 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:29.022811 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb045d5-4b65-4662-a9e0-8082ae07a3c3 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:29.028212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 91/185] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:29.028212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb045d5-4b65-4662-a9e0-8082ae07a3c3 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:29.071339 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c76f71-faa3-4edb-8891-57a13b29c73c None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:29.108078 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54d0b8-76d5-44f9-a1fa-4c84c3963c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:29.109308 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54d0b8-76d5-44f9-a1fa-4c84c3963c3d None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:29.110211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54d0b8-76d5-44f9-a1fa-4c84c3963c3d None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:29.110828 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54d0b8-76d5-44f9-a1fa-4c84c3963c3d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:29.125620 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54d0b8-76d5-44f9-a1fa-4c84c3963c3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:29.129537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb045d5-4b65-4662-a9e0-8082ae07a3c3 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:29.132854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-cb54d0b8-76d5-44f9-a1fa-4c84c3963c3d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 19:33:29.132854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:29.132854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:29.132854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:29.132854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:29.132854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:29.132854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:29.132854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:29.132854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:29.132854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:29.132854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:29.132854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:29.132854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:29.132854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:29.132854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:29.132854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:29.133890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:29.133890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:29.133890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:29.133890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:29.133890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:29.133890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:29.133890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:29.133890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:29.133890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:29.133890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:29.133890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:29.133890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:29.133890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:29.133890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:29.133890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:29.133890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:29.134858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:29.134858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:29.134858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:29.134858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:29.134858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:29.134858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:29.134858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:29.134858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:29.134858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:29.134858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:29.134858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 19:33:29.134858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:33:29.136970 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 95/186] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:29.137771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54d0b8-76d5-44f9-a1fa-4c84c3963c3d None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:29.166167 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db614af-1191-462f-ae7b-89c47b35b419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:29.167252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db614af-1191-462f-ae7b-89c47b35b419 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:29.167524 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db614af-1191-462f-ae7b-89c47b35b419 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:29.168522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db614af-1191-462f-ae7b-89c47b35b419 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:29.169208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db614af-1191-462f-ae7b-89c47b35b419 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:29.169506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db614af-1191-462f-ae7b-89c47b35b419 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:29.171077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db614af-1191-462f-ae7b-89c47b35b419 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:29.189254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 92/187] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:29.189254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db614af-1191-462f-ae7b-89c47b35b419 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:29.218154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:29.226326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:29.260075 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54d0b8-76d5-44f9-a1fa-4c84c3963c3d None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:29.286652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db614af-1191-462f-ae7b-89c47b35b419 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:29.295460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2de3b-63af-44fc-8496-04a27efb5ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:29.296114 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2de3b-63af-44fc-8496-04a27efb5ad2 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:29.296398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2de3b-63af-44fc-8496-04a27efb5ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:29.296656 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2de3b-63af-44fc-8496-04a27efb5ad2 None admin] PATH_INFO: `/v3/projects/f4610a4df84b4edbbef0ab7a29a9e7eb` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:29.297779 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2de3b-63af-44fc-8496-04a27efb5ad2 None admin] RBAC: Authorizing `identity:get_project(project_id=f4610a4df84b4edbbef0ab7a29a9e7eb)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:29.299198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2de3b-63af-44fc-8496-04a27efb5ad2 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:29.300843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 96/188] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:29 2022] GET /identity/v3/projects/f4610a4df84b4edbbef0ab7a29a9e7eb => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:29.306722 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56085cbf-d41e-4f72-8ba5-09ebb16b7250 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:29.307001 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56085cbf-d41e-4f72-8ba5-09ebb16b7250 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:29.307273 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56085cbf-d41e-4f72-8ba5-09ebb16b7250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:29.320402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f133498-0fdf-468f-930c-64be95b556f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:29.321021 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f133498-0fdf-468f-930c-64be95b556f5 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:29.321300 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f133498-0fdf-468f-930c-64be95b556f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:29.321570 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f133498-0fdf-468f-930c-64be95b556f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:29.322406 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f133498-0fdf-468f-930c-64be95b556f5 None admin] RBAC: Adding query filter params (role.id=fd65be88941941298be36b142df9b505, scope.project.id=40b14549caef48dfb5996de78e97302f, user.id=8fbbf46ece0240fd9bd840b4ccefeeaf) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:29.322718 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f133498-0fdf-468f-930c-64be95b556f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:29.324201 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f133498-0fdf-468f-930c-64be95b556f5 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:29.324702 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-56085cbf-d41e-4f72-8ba5-09ebb16b7250 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:29.325899 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-56085cbf-d41e-4f72-8ba5-09ebb16b7250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:29.329946 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 93/189] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:33:29 2022] GET /identity/v3/role_assignments?user.id=8fbbf46ece0240fd9bd840b4ccefeeaf&scope.project.id=40b14549caef48dfb5996de78e97302f&role.id=fd65be88941941298be36b142df9b505 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:29.330719 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f133498-0fdf-468f-930c-64be95b556f5 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:29.409985 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 97/190] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:29.419759 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56085cbf-d41e-4f72-8ba5-09ebb16b7250 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:29.471143 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:29.475650 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f133498-0fdf-468f-930c-64be95b556f5 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:29.495910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:29.528749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b05f4d-65ae-47e3-a95d-f5db0739e12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:29.529416 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b05f4d-65ae-47e3-a95d-f5db0739e12d None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:29.529698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b05f4d-65ae-47e3-a95d-f5db0739e12d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:29.529970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b05f4d-65ae-47e3-a95d-f5db0739e12d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:29.545367 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b05f4d-65ae-47e3-a95d-f5db0739e12d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:29.545547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56085cbf-d41e-4f72-8ba5-09ebb16b7250 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:29.550604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-c8b05f4d-65ae-47e3-a95d-f5db0739e12d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:33:29.550604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:29.550604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:29.550604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:29.550604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:29.550604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:29.550604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:29.550604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:29.550604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:29.550604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:29.550604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:29.550604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:29.550604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:29.550604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:29.550604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:29.550604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:29.551490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:29.551490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:29.551490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:29.551490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:29.551490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:29.551490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:29.551490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:29.551490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:29.551490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:29.551490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:29.551490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:29.551490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:29.551490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:29.551490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:29.551490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:29.551490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:29.552689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:29.552689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:29.552689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:29.552689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:29.552689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:29.552689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:29.552689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:29.552689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:29.552689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:29.552689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:29.552689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:33:29.552689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:29.552689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 94/191] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:33:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:29.553339 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b05f4d-65ae-47e3-a95d-f5db0739e12d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:29.589346 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf712e-5eae-4e96-85ff-79040673e74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:29.590674 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf712e-5eae-4e96-85ff-79040673e74f None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:29.591073 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf712e-5eae-4e96-85ff-79040673e74f None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:29.591575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf712e-5eae-4e96-85ff-79040673e74f None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:29.592668 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf712e-5eae-4e96-85ff-79040673e74f None admin] RBAC: Adding query filter params (name=reader) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:29.593110 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf712e-5eae-4e96-85ff-79040673e74f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:29.594746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf712e-5eae-4e96-85ff-79040673e74f None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:29.606496 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 98/192] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:29.607337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf712e-5eae-4e96-85ff-79040673e74f None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:29.682869 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b05f4d-65ae-47e3-a95d-f5db0739e12d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:29.717597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b6620-8005-4b00-b89a-06ce957b9aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:29.718233 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b6620-8005-4b00-b89a-06ce957b9aec None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:29.718513 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b6620-8005-4b00-b89a-06ce957b9aec None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:29.718784 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b6620-8005-4b00-b89a-06ce957b9aec None admin] PATH_INFO: `/v3/users/20106f7b2b6743a599a645de7dbde044` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:29.725342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf712e-5eae-4e96-85ff-79040673e74f None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:29.732435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b6620-8005-4b00-b89a-06ce957b9aec None admin] RBAC: Authorizing `identity:get_user(user_id=20106f7b2b6743a599a645de7dbde044)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:29.733903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b6620-8005-4b00-b89a-06ce957b9aec None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:29.735530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 95/193] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:29 2022] GET /identity/v3/users/20106f7b2b6743a599a645de7dbde044 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:29.738619 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b6620-8005-4b00-b89a-06ce957b9aec None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:29.752206 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:29.755855 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:29.760828 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca4a3f-9979-4c06-afa1-c117d01bb070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:29.761444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca4a3f-9979-4c06-afa1-c117d01bb070 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:29.766401 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca4a3f-9979-4c06-afa1-c117d01bb070 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:29.766401 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca4a3f-9979-4c06-afa1-c117d01bb070 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:29.766401 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca4a3f-9979-4c06-afa1-c117d01bb070 None admin] RBAC: Adding query filter params (role.id=f63dc07e563f4ffb9f88aa95c528da47, scope.project.id=f4610a4df84b4edbbef0ab7a29a9e7eb, user.id=8fbbf46ece0240fd9bd840b4ccefeeaf) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:29.766401 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca4a3f-9979-4c06-afa1-c117d01bb070 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:29.766401 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca4a3f-9979-4c06-afa1-c117d01bb070 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:29.770887 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 99/194] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:33:29 2022] GET /identity/v3/role_assignments?user.id=8fbbf46ece0240fd9bd840b4ccefeeaf&scope.project.id=f4610a4df84b4edbbef0ab7a29a9e7eb&role.id=f63dc07e563f4ffb9f88aa95c528da47 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:29.771696 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca4a3f-9979-4c06-afa1-c117d01bb070 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:29.850168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b6620-8005-4b00-b89a-06ce957b9aec None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:29.889860 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1b96a-0b0b-44a8-a37b-e3652a387b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:29.890551 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1b96a-0b0b-44a8-a37b-e3652a387b1e None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:29.890794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1b96a-0b0b-44a8-a37b-e3652a387b1e None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:29.891064 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1b96a-0b0b-44a8-a37b-e3652a387b1e None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:29.891729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca4a3f-9979-4c06-afa1-c117d01bb070 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:29.891828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1b96a-0b0b-44a8-a37b-e3652a387b1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:29.892062 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1b96a-0b0b-44a8-a37b-e3652a387b1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:29.893760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1b96a-0b0b-44a8-a37b-e3652a387b1e None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:29.903362 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 96/195] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:33:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:29.908998 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1b96a-0b0b-44a8-a37b-e3652a387b1e None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:29.931579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3970ea-501e-456d-ad5a-9c12162ec7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:29.932249 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3970ea-501e-456d-ad5a-9c12162ec7ae None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:29.932531 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3970ea-501e-456d-ad5a-9c12162ec7ae None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:29.932810 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3970ea-501e-456d-ad5a-9c12162ec7ae None admin] PATH_INFO: `/v3/users/87f669af2258454fadb832ca4bac14bc` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:29.934553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3970ea-501e-456d-ad5a-9c12162ec7ae None admin] RBAC: Authorizing `identity:get_user(user_id=87f669af2258454fadb832ca4bac14bc)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:29.936086 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3970ea-501e-456d-ad5a-9c12162ec7ae None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:29.942420 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 100/196] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:29 2022] GET /identity/v3/users/87f669af2258454fadb832ca4bac14bc => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:29.942420 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3970ea-501e-456d-ad5a-9c12162ec7ae None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:30.007998 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:30.013511 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:30.033323 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1b96a-0b0b-44a8-a37b-e3652a387b1e None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:30.056508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3970ea-501e-456d-ad5a-9c12162ec7ae None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:30.068518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698a667-1695-4029-adf6-e61a1eb98df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:30.069151 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698a667-1695-4029-adf6-e61a1eb98df3 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:30.069425 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698a667-1695-4029-adf6-e61a1eb98df3 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:30.069692 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698a667-1695-4029-adf6-e61a1eb98df3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:30.070784 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698a667-1695-4029-adf6-e61a1eb98df3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:30.072260 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698a667-1695-4029-adf6-e61a1eb98df3 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:30.073820 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 97/197] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:33:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:30.075262 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698a667-1695-4029-adf6-e61a1eb98df3 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:30.092377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481b85c-f4ab-452c-8191-431d9be487ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:30.092990 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481b85c-f4ab-452c-8191-431d9be487ce None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:30.093278 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481b85c-f4ab-452c-8191-431d9be487ce None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:30.093541 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481b85c-f4ab-452c-8191-431d9be487ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:30.161376 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481b85c-f4ab-452c-8191-431d9be487ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:30.162775 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481b85c-f4ab-452c-8191-431d9be487ce None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:30.176323 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698a667-1695-4029-adf6-e61a1eb98df3 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:30.210541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad18fc-17e6-448d-a8d2-c0f6fc33a442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:30.211175 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad18fc-17e6-448d-a8d2-c0f6fc33a442 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:30.211450 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad18fc-17e6-448d-a8d2-c0f6fc33a442 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:30.211751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad18fc-17e6-448d-a8d2-c0f6fc33a442 None admin] PATH_INFO: `/v3/users/20106f7b2b6743a599a645de7dbde044` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:30.212889 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad18fc-17e6-448d-a8d2-c0f6fc33a442 None admin] RBAC: Authorizing `identity:get_user(user_id=20106f7b2b6743a599a645de7dbde044)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:30.214348 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad18fc-17e6-448d-a8d2-c0f6fc33a442 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:30.216588 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 98/198] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:30 2022] GET /identity/v3/users/20106f7b2b6743a599a645de7dbde044 => generated 283 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:30.217435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad18fc-17e6-448d-a8d2-c0f6fc33a442 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:30.226208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:30.232893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:30.268595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 101/199] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:33:30.268595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481b85c-f4ab-452c-8191-431d9be487ce None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:30.315895 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad18fc-17e6-448d-a8d2-c0f6fc33a442 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:30.350316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788431a8-d71c-4635-b9cc-97db01ad5d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:30.350925 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788431a8-d71c-4635-b9cc-97db01ad5d0a None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:30.351206 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788431a8-d71c-4635-b9cc-97db01ad5d0a None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:30.351475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788431a8-d71c-4635-b9cc-97db01ad5d0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:30.368158 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481b85c-f4ab-452c-8191-431d9be487ce None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:30.402064 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfdadb-3135-446a-8555-7c2ba3adf50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:30.402730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfdadb-3135-446a-8555-7c2ba3adf50e None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:30.402998 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfdadb-3135-446a-8555-7c2ba3adf50e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:30.403265 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfdadb-3135-446a-8555-7c2ba3adf50e None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:30.403948 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfdadb-3135-446a-8555-7c2ba3adf50e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:30.405385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfdadb-3135-446a-8555-7c2ba3adf50e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:30.422807 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788431a8-d71c-4635-b9cc-97db01ad5d0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:30.424327 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788431a8-d71c-4635-b9cc-97db01ad5d0a None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:30.439695 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:30.499622 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 102/200] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Sep 14 19:33:30 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:33:30.500857 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfdadb-3135-446a-8555-7c2ba3adf50e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:30.520108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:30.532360 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 99/201] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:33:30.533161 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788431a8-d71c-4635-b9cc-97db01ad5d0a None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:30.618623 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfdadb-3135-446a-8555-7c2ba3adf50e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:30.649643 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788431a8-d71c-4635-b9cc-97db01ad5d0a None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:30.655907 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1c318-b0c5-4e54-8c37-eaeb4af44ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:30.656544 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1c318-b0c5-4e54-8c37-eaeb4af44ac9 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:30.656822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1c318-b0c5-4e54-8c37-eaeb4af44ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:30.657191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1c318-b0c5-4e54-8c37-eaeb4af44ac9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:30.665284 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:30.690638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac56f89-c99b-438d-b47b-0f8e2fa328e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:30.691813 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac56f89-c99b-438d-b47b-0f8e2fa328e4 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:30.691813 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac56f89-c99b-438d-b47b-0f8e2fa328e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:30.691813 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac56f89-c99b-438d-b47b-0f8e2fa328e4 None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:30.693109 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac56f89-c99b-438d-b47b-0f8e2fa328e4 None admin] RBAC: Authorizing `identity:get_project(project_id=c0309156ef604b44ad1f70081379b00e)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:30.694745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac56f89-c99b-438d-b47b-0f8e2fa328e4 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:30.696456 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 100/202] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:30 2022] GET /identity/v3/projects/c0309156ef604b44ad1f70081379b00e => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:30.697222 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac56f89-c99b-438d-b47b-0f8e2fa328e4 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:30.742378 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1c318-b0c5-4e54-8c37-eaeb4af44ac9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:30.744661 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1c318-b0c5-4e54-8c37-eaeb4af44ac9 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:30.760818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:30.831380 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac56f89-c99b-438d-b47b-0f8e2fa328e4 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:30.860368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 103/203] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:33:30.861667 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1c318-b0c5-4e54-8c37-eaeb4af44ac9 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:30.871042 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6c963-e7cc-436b-8111-1cdd9eca1904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:30.872381 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6c963-e7cc-436b-8111-1cdd9eca1904 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:30.872810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6c963-e7cc-436b-8111-1cdd9eca1904 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:30.873088 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6c963-e7cc-436b-8111-1cdd9eca1904 None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:30.874267 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6c963-e7cc-436b-8111-1cdd9eca1904 None admin] RBAC: Authorizing `identity:get_project(project_id=40b14549caef48dfb5996de78e97302f)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:30.875812 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6c963-e7cc-436b-8111-1cdd9eca1904 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:30.877595 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 101/204] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:30 2022] GET /identity/v3/projects/40b14549caef48dfb5996de78e97302f => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:30.878220 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6c963-e7cc-436b-8111-1cdd9eca1904 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:30.942081 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:30.992631 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1c318-b0c5-4e54-8c37-eaeb4af44ac9 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:31.008793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:31.009125 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6c963-e7cc-436b-8111-1cdd9eca1904 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:31.036123 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bc757-e7bb-418a-b4f3-5872c41dca59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:31.036750 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bc757-e7bb-418a-b4f3-5872c41dca59 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:31.037027 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bc757-e7bb-418a-b4f3-5872c41dca59 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:31.037298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bc757-e7bb-418a-b4f3-5872c41dca59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:31.038393 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bc757-e7bb-418a-b4f3-5872c41dca59 None admin] RBAC: Adding query filter params (role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a, scope.project.id=c0309156ef604b44ad1f70081379b00e, user.id=20106f7b2b6743a599a645de7dbde044) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:31.038711 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bc757-e7bb-418a-b4f3-5872c41dca59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:31.040541 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bc757-e7bb-418a-b4f3-5872c41dca59 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:31.055587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 104/205] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:33:30 2022] GET /identity/v3/role_assignments?user.id=20106f7b2b6743a599a645de7dbde044&scope.project.id=c0309156ef604b44ad1f70081379b00e&role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:31.055587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bc757-e7bb-418a-b4f3-5872c41dca59 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:31.061126 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719605c-fd96-488d-b3dc-43cbaf438ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:31.062086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719605c-fd96-488d-b3dc-43cbaf438ad8 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:31.062576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719605c-fd96-488d-b3dc-43cbaf438ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:31.063110 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719605c-fd96-488d-b3dc-43cbaf438ad8 None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:31.068482 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719605c-fd96-488d-b3dc-43cbaf438ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=c0309156ef604b44ad1f70081379b00e)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:31.070326 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719605c-fd96-488d-b3dc-43cbaf438ad8 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:31.072794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 102/206] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:30 2022] GET /identity/v3/projects/c0309156ef604b44ad1f70081379b00e => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:31.079772 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719605c-fd96-488d-b3dc-43cbaf438ad8 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:31.173019 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bc757-e7bb-418a-b4f3-5872c41dca59 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:31.263774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719605c-fd96-488d-b3dc-43cbaf438ad8 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:31.277494 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8c6cc-7b5c-4c10-ad1d-a1251645ce2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:31.278137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8c6cc-7b5c-4c10-ad1d-a1251645ce2e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:31.278576 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8c6cc-7b5c-4c10-ad1d-a1251645ce2e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:31.278862 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8c6cc-7b5c-4c10-ad1d-a1251645ce2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:31.279636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8c6cc-7b5c-4c10-ad1d-a1251645ce2e None admin] RBAC: Adding query filter params (role.id=44508e6bd9ba4b1b826ac09f102b2782, scope.project.id=40b14549caef48dfb5996de78e97302f, user.id=87f669af2258454fadb832ca4bac14bc) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:31.279955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8c6cc-7b5c-4c10-ad1d-a1251645ce2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:31.281458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8c6cc-7b5c-4c10-ad1d-a1251645ce2e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:31.284710 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:31.301810 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 105/207] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:33:31 2022] GET /identity/v3/role_assignments?user.id=87f669af2258454fadb832ca4bac14bc&scope.project.id=40b14549caef48dfb5996de78e97302f&role.id=44508e6bd9ba4b1b826ac09f102b2782 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:31.310239 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f3c23-a0bd-4dc1-a011-196199baacf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:31.311251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f3c23-a0bd-4dc1-a011-196199baacf7 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:31.311854 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f3c23-a0bd-4dc1-a011-196199baacf7 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:31.312324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f3c23-a0bd-4dc1-a011-196199baacf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:31.313321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f3c23-a0bd-4dc1-a011-196199baacf7 None admin] RBAC: Adding query filter params (role.id=fd65be88941941298be36b142df9b505, scope.project.id=c0309156ef604b44ad1f70081379b00e, user.id=20106f7b2b6743a599a645de7dbde044) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:31.313837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f3c23-a0bd-4dc1-a011-196199baacf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:31.315642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f3c23-a0bd-4dc1-a011-196199baacf7 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:31.322631 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 103/208] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:33:31 2022] GET /identity/v3/role_assignments?user.id=20106f7b2b6743a599a645de7dbde044&scope.project.id=c0309156ef604b44ad1f70081379b00e&role.id=fd65be88941941298be36b142df9b505 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:32.964414 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5fde1-a978-4d5b-9533-655a7ac37faf None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:32.964960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5fde1-a978-4d5b-9533-655a7ac37faf None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:32.964960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5fde1-a978-4d5b-9533-655a7ac37faf None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:32.967086 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 106/209] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:32.972665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7b685-a030-4dff-874a-e7f73cfedf32 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:32.973120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7b685-a030-4dff-874a-e7f73cfedf32 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:32.973208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7b685-a030-4dff-874a-e7f73cfedf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:32.974519 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2002a46-36c5-41ff-92ad-90cf310b7b7b None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:32.974797 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2002a46-36c5-41ff-92ad-90cf310b7b7b None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:32.975068 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2002a46-36c5-41ff-92ad-90cf310b7b7b None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:32.979066 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 107/210] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:32.984722 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba4217-e5be-4d39-beb9-6a50d54a6df0 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:32.985093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba4217-e5be-4d39-beb9-6a50d54a6df0 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:32.985448 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba4217-e5be-4d39-beb9-6a50d54a6df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:32.997864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-0ee7b685-a030-4dff-874a-e7f73cfedf32 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:32.999858 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0ee7b685-a030-4dff-874a-e7f73cfedf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:33.004528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-57ba4217-e5be-4d39-beb9-6a50d54a6df0 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:33.005793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-57ba4217-e5be-4d39-beb9-6a50d54a6df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:33.051905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:33.088699 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 108/211] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:33:33.091708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 104/212] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:33:33.369019 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba4217-e5be-4d39-beb9-6a50d54a6df0 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:33.370378 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7b685-a030-4dff-874a-e7f73cfedf32 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:33.492852 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba4217-e5be-4d39-beb9-6a50d54a6df0 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:33.499512 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7b685-a030-4dff-874a-e7f73cfedf32 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:33.513343 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:33.532482 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773c995-d773-4b8a-9c28-3abf4f02e22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:33.533125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773c995-d773-4b8a-9c28-3abf4f02e22a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:33.533402 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773c995-d773-4b8a-9c28-3abf4f02e22a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:33.533673 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773c995-d773-4b8a-9c28-3abf4f02e22a None admin] PATH_INFO: `/v3/roles/member` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:33.535298 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f6786-9809-4471-a869-114d960f6c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:33.535964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f6786-9809-4471-a869-114d960f6c1e None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:33.536238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f6786-9809-4471-a869-114d960f6c1e None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:33.536518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f6786-9809-4471-a869-114d960f6c1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:33.537632 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f6786-9809-4471-a869-114d960f6c1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:33.539117 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f6786-9809-4471-a869-114d960f6c1e None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:33.540867 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 105/213] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:33:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:33.545347 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773c995-d773-4b8a-9c28-3abf4f02e22a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:33.547241 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78431d18-4530-4c72-9d01-4a681717cf25 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:33.547673 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78431d18-4530-4c72-9d01-4a681717cf25 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:33.548106 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78431d18-4530-4c72-9d01-4a681717cf25 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:33.553847 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 106/214] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:33.553971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-c773c995-d773-4b8a-9c28-3abf4f02e22a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:33.553971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:33.553971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:33.553971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:33.553971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:33.553971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:33.553971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:33.553971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:33.553971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:33.553971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:33.553971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:33.553971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:33.553971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:33.553971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:33.553971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:33.553971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:33.554802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:33.554802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:33.554802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:33.554802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:33.554802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:33.554802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:33.554802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:33.554802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:33.554802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:33.554802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:33.554802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:33.554802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:33.554802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:33.554802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:33.554802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:33.554802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:33.555590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:33.555590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:33.555590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:33.555590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:33.555590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:33.555590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:33.555590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:33.555590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:33.555590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:33.555590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:33.555590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:33.555590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:33:33.556180 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78431d18-4530-4c72-9d01-4a681717cf25 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:33.556255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 109/215] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:33.557577 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f1204-7dea-472b-8646-41e6e045238d None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:33.557863 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f1204-7dea-472b-8646-41e6e045238d None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:33.558141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f1204-7dea-472b-8646-41e6e045238d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:33.576888 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-ea9f1204-7dea-472b-8646-41e6e045238d None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:33.578086 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ea9f1204-7dea-472b-8646-41e6e045238d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:33.604920 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:33.645826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 110/216] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:33.646586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f1204-7dea-472b-8646-41e6e045238d None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:33.669631 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78431d18-4530-4c72-9d01-4a681717cf25 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:33.704917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea586d-471e-4407-891a-12b1801f1803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:33.705552 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea586d-471e-4407-891a-12b1801f1803 None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:33.705785 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea586d-471e-4407-891a-12b1801f1803 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:33.706060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea586d-471e-4407-891a-12b1801f1803 None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:33.706706 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea586d-471e-4407-891a-12b1801f1803 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:33.708174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea586d-471e-4407-891a-12b1801f1803 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:33.751729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f1204-7dea-472b-8646-41e6e045238d None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:33.792750 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 107/217] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Sep 14 19:33:33 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:33:33.792750 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cb74c-c2f2-47a3-96ea-a1be72c0f395 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:33.792750 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cb74c-c2f2-47a3-96ea-a1be72c0f395 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:33.792750 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cb74c-c2f2-47a3-96ea-a1be72c0f395 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:33.792750 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 108/218] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:33.794677 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12169de3-87fa-4550-ba2e-8e8a87d81ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:33.795323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12169de3-87fa-4550-ba2e-8e8a87d81ae8 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:33.795564 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545b194-726f-424f-a100-d802666b9390 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:33.795682 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12169de3-87fa-4550-ba2e-8e8a87d81ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:33.795895 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12169de3-87fa-4550-ba2e-8e8a87d81ae8 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:33.796114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545b194-726f-424f-a100-d802666b9390 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:33.796487 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545b194-726f-424f-a100-d802666b9390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:33.796649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12169de3-87fa-4550-ba2e-8e8a87d81ae8 None admin] RBAC: Adding query filter params (name=member) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:33.796962 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12169de3-87fa-4550-ba2e-8e8a87d81ae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:33.798516 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12169de3-87fa-4550-ba2e-8e8a87d81ae8 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:33.810047 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 111/219] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:33.816327 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12169de3-87fa-4550-ba2e-8e8a87d81ae8 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:33.818015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-1545b194-726f-424f-a100-d802666b9390 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:33.819486 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1545b194-726f-424f-a100-d802666b9390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:33.846824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:33.856295 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:33.912805 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 109/220] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:33.916401 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545b194-726f-424f-a100-d802666b9390 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:33.958109 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12169de3-87fa-4550-ba2e-8e8a87d81ae8 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:34.003330 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63e2d8-908e-49e4-a41f-6f01206f9018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:34.004047 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63e2d8-908e-49e4-a41f-6f01206f9018 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:34.004344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63e2d8-908e-49e4-a41f-6f01206f9018 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:34.004592 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63e2d8-908e-49e4-a41f-6f01206f9018 None admin] PATH_INFO: `/v3/users/a030a87100c44ff0844da1633661a7c1` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:34.024077 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63e2d8-908e-49e4-a41f-6f01206f9018 None admin] RBAC: Authorizing `identity:get_user(user_id=a030a87100c44ff0844da1633661a7c1)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:34.026598 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63e2d8-908e-49e4-a41f-6f01206f9018 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:34.027620 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 112/221] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:33 2022] GET /identity/v3/users/a030a87100c44ff0844da1633661a7c1 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:34.033342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63e2d8-908e-49e4-a41f-6f01206f9018 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:34.049527 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545b194-726f-424f-a100-d802666b9390 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:34.089182 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e2c78-1deb-40b0-96e3-25812691f546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:34.089840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e2c78-1deb-40b0-96e3-25812691f546 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:34.090115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e2c78-1deb-40b0-96e3-25812691f546 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:34.090740 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e2c78-1deb-40b0-96e3-25812691f546 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:34.102843 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e2c78-1deb-40b0-96e3-25812691f546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:34.108475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-e60e2c78-1deb-40b0-96e3-25812691f546 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:33:34.108475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:34.108475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:34.108475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:34.108475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:34.108475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:34.108475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:34.108475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:34.108475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:34.108475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:34.108475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:34.108475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:34.108475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:34.108475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:34.108475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:34.108475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:34.116717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:34.116717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:34.116717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:34.116717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:34.116717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:34.116717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:34.116717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:34.116717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:34.116717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:34.116717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:34.116717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:34.116717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:34.116717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:34.116717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:34.116717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:34.116717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:34.117507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:34.117507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:34.117507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:34.117507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:34.117507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:34.117507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:34.117507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:34.117507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:34.117507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:34.117507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:34.117507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:33:34.117507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:34.117507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 110/222] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:33:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:33:34.120547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e2c78-1deb-40b0-96e3-25812691f546 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:34.139424 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:34.158798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:34.161085 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63e2d8-908e-49e4-a41f-6f01206f9018 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:34.341832 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e107b-e73b-4f9c-87b2-2fba80d4bfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:34.342469 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e107b-e73b-4f9c-87b2-2fba80d4bfd6 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:34.342754 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e107b-e73b-4f9c-87b2-2fba80d4bfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:34.343028 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e107b-e73b-4f9c-87b2-2fba80d4bfd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:34.384885 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e2c78-1deb-40b0-96e3-25812691f546 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:34.414240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e107b-e73b-4f9c-87b2-2fba80d4bfd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:34.415741 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e107b-e73b-4f9c-87b2-2fba80d4bfd6 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:34.424633 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560507b-b1a9-4bc3-b88d-e15c77fb12f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:34.425261 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560507b-b1a9-4bc3-b88d-e15c77fb12f1 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:34.425541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560507b-b1a9-4bc3-b88d-e15c77fb12f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:34.425815 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560507b-b1a9-4bc3-b88d-e15c77fb12f1 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:34.426504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560507b-b1a9-4bc3-b88d-e15c77fb12f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:34.426903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560507b-b1a9-4bc3-b88d-e15c77fb12f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:34.428569 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560507b-b1a9-4bc3-b88d-e15c77fb12f1 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:34.439036 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 111/223] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:34.439966 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560507b-b1a9-4bc3-b88d-e15c77fb12f1 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:34.499727 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:34.519942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 113/224] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 19:33:34.520954 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e107b-e73b-4f9c-87b2-2fba80d4bfd6 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:34.541465 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:34.554211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560507b-b1a9-4bc3-b88d-e15c77fb12f1 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:34.596100 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ec087-ffea-4d84-9f05-7055045bc0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:34.596664 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ec087-ffea-4d84-9f05-7055045bc0bd None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:34.596951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ec087-ffea-4d84-9f05-7055045bc0bd None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:34.597233 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ec087-ffea-4d84-9f05-7055045bc0bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:34.610357 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ec087-ffea-4d84-9f05-7055045bc0bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:34.617793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-6c4ec087-ffea-4d84-9f05-7055045bc0bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:33:34.617793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:34.617793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:34.617793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:34.617793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:34.617793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:34.617793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:34.617793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:34.617793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:34.617793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:34.617793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:34.617793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:34.617793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:34.617793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:34.617793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:34.617793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:34.618857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:34.618857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:34.618857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:34.618857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:34.618857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:34.618857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:34.618857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:34.618857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:34.618857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:34.618857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:34.618857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:34.618857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:34.618857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:34.618857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:34.618857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:34.618857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:34.619898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:34.619898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:34.619898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:34.619898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:34.619898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:34.619898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:34.619898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:34.619898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:34.619898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:34.619898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:34.619898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:33:34.619898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:34.619898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 112/225] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:33:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:34.620818 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ec087-ffea-4d84-9f05-7055045bc0bd None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:34.632119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e107b-e73b-4f9c-87b2-2fba80d4bfd6 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:34.669607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84df9aa-a3e0-4592-9560-25e5eef51c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:34.670275 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84df9aa-a3e0-4592-9560-25e5eef51c24 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:34.670550 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84df9aa-a3e0-4592-9560-25e5eef51c24 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:34.670819 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84df9aa-a3e0-4592-9560-25e5eef51c24 None admin] PATH_INFO: `/v3/users/20106f7b2b6743a599a645de7dbde044` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:34.672003 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84df9aa-a3e0-4592-9560-25e5eef51c24 None admin] RBAC: Authorizing `identity:get_user(user_id=20106f7b2b6743a599a645de7dbde044)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:34.673446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84df9aa-a3e0-4592-9560-25e5eef51c24 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:34.675323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 114/226] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:34 2022] GET /identity/v3/users/20106f7b2b6743a599a645de7dbde044 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:34.676223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84df9aa-a3e0-4592-9560-25e5eef51c24 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:34.729743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:34.764672 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ec087-ffea-4d84-9f05-7055045bc0bd None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:34.788208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84df9aa-a3e0-4592-9560-25e5eef51c24 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:34.803352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c406255-9094-44bc-95a0-e778969a4a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:34.804170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c406255-9094-44bc-95a0-e778969a4a22 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:34.804523 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c406255-9094-44bc-95a0-e778969a4a22 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:34.804863 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c406255-9094-44bc-95a0-e778969a4a22 None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:34.806070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c406255-9094-44bc-95a0-e778969a4a22 None admin] RBAC: Authorizing `identity:get_project(project_id=c0309156ef604b44ad1f70081379b00e)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:34.807632 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c406255-9094-44bc-95a0-e778969a4a22 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:34.809480 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 113/227] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:34 2022] GET /identity/v3/projects/c0309156ef604b44ad1f70081379b00e => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:34.810737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c406255-9094-44bc-95a0-e778969a4a22 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:34.835824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7767dd-a654-44fb-889a-5528bec70b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:34.837199 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7767dd-a654-44fb-889a-5528bec70b6e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:34.837632 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7767dd-a654-44fb-889a-5528bec70b6e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:34.838313 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7767dd-a654-44fb-889a-5528bec70b6e None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:34.839298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7767dd-a654-44fb-889a-5528bec70b6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:34.839786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7767dd-a654-44fb-889a-5528bec70b6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:34.841981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7767dd-a654-44fb-889a-5528bec70b6e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:34.843934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:34.853186 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 115/228] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:33:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:34.854039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7767dd-a654-44fb-889a-5528bec70b6e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:34.923085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c406255-9094-44bc-95a0-e778969a4a22 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:34.968371 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdb73d-e390-4c24-b9fd-6d92ca142553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:34.969030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdb73d-e390-4c24-b9fd-6d92ca142553 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:34.969314 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdb73d-e390-4c24-b9fd-6d92ca142553 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:34.969697 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdb73d-e390-4c24-b9fd-6d92ca142553 None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:34.971383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdb73d-e390-4c24-b9fd-6d92ca142553 None admin] RBAC: Authorizing `identity:get_project(project_id=c0309156ef604b44ad1f70081379b00e)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:34.973720 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdb73d-e390-4c24-b9fd-6d92ca142553 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:34.976365 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 114/229] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:34 2022] GET /identity/v3/projects/c0309156ef604b44ad1f70081379b00e => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:34.976790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7767dd-a654-44fb-889a-5528bec70b6e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:34.977845 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdb73d-e390-4c24-b9fd-6d92ca142553 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:34.993551 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:35.018322 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49011f78-038a-4f60-8fb5-884b47bb2979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:35.020132 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49011f78-038a-4f60-8fb5-884b47bb2979 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:35.020634 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49011f78-038a-4f60-8fb5-884b47bb2979 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:35.021103 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49011f78-038a-4f60-8fb5-884b47bb2979 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:35.022023 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49011f78-038a-4f60-8fb5-884b47bb2979 None admin] RBAC: Adding query filter params (role.id=f63dc07e563f4ffb9f88aa95c528da47, scope.project.id=c0309156ef604b44ad1f70081379b00e, user.id=a030a87100c44ff0844da1633661a7c1) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:35.022619 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49011f78-038a-4f60-8fb5-884b47bb2979 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:35.024385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49011f78-038a-4f60-8fb5-884b47bb2979 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:35.030731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 116/230] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:33:34 2022] GET /identity/v3/role_assignments?user.id=a030a87100c44ff0844da1633661a7c1&scope.project.id=c0309156ef604b44ad1f70081379b00e&role.id=f63dc07e563f4ffb9f88aa95c528da47 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:35.031878 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49011f78-038a-4f60-8fb5-884b47bb2979 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:35.120025 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:35.148979 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdb73d-e390-4c24-b9fd-6d92ca142553 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:35.155343 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49011f78-038a-4f60-8fb5-884b47bb2979 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:35.195030 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744a5c3-894b-4e93-be33-19a635d696af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:35.195750 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744a5c3-894b-4e93-be33-19a635d696af None admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:35.196032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744a5c3-894b-4e93-be33-19a635d696af None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:35.196305 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744a5c3-894b-4e93-be33-19a635d696af None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e/users/20106f7b2b6743a599a645de7dbde044/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:35.198874 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744a5c3-894b-4e93-be33-19a635d696af None admin] RBAC: Authorizing `identity:create_grant(project_id=c0309156ef604b44ad1f70081379b00e, user_id=20106f7b2b6743a599a645de7dbde044, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:35.200680 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744a5c3-894b-4e93-be33-19a635d696af None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:35.214983 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a866e-f0df-40d9-8571-1e8f3b854650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:35.217000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a866e-f0df-40d9-8571-1e8f3b854650 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:35.221083 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a866e-f0df-40d9-8571-1e8f3b854650 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:35.221083 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a866e-f0df-40d9-8571-1e8f3b854650 None admin] PATH_INFO: `/v3/users/20106f7b2b6743a599a645de7dbde044` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:35.221083 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a866e-f0df-40d9-8571-1e8f3b854650 None admin] RBAC: Authorizing `identity:get_user(user_id=20106f7b2b6743a599a645de7dbde044)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:35.221083 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a866e-f0df-40d9-8571-1e8f3b854650 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:35.222099 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 115/231] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:34 2022] GET /identity/v3/users/20106f7b2b6743a599a645de7dbde044 => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:35.227742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a866e-f0df-40d9-8571-1e8f3b854650 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:35.294645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 117/232] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:33:35 2022] PUT /identity/v3/projects/c0309156ef604b44ad1f70081379b00e/users/20106f7b2b6743a599a645de7dbde044/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:33:35.355053 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a866e-f0df-40d9-8571-1e8f3b854650 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:35.425454 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86552f-a7d9-478c-aae0-3daf93bf84fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:35.426130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86552f-a7d9-478c-aae0-3daf93bf84fa None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:35.426409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86552f-a7d9-478c-aae0-3daf93bf84fa None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:35.426684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86552f-a7d9-478c-aae0-3daf93bf84fa None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:35.427887 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86552f-a7d9-478c-aae0-3daf93bf84fa None admin] RBAC: Authorizing `identity:get_project(project_id=c0309156ef604b44ad1f70081379b00e)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:35.429387 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86552f-a7d9-478c-aae0-3daf93bf84fa None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:35.431479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 116/233] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:35 2022] GET /identity/v3/projects/c0309156ef604b44ad1f70081379b00e => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:35.438939 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744a5c3-894b-4e93-be33-19a635d696af None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:35.516752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:35.594119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744a5c3-894b-4e93-be33-19a635d696af None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:35.635962 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd618e-d9df-489e-a734-683232374b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:35.636982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd618e-d9df-489e-a734-683232374b62 None admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:35.637990 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd618e-d9df-489e-a734-683232374b62 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:35.638463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd618e-d9df-489e-a734-683232374b62 None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e/users/20106f7b2b6743a599a645de7dbde044/roles/fd65be88941941298be36b142df9b505` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:35.641040 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd618e-d9df-489e-a734-683232374b62 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0309156ef604b44ad1f70081379b00e, user_id=20106f7b2b6743a599a645de7dbde044, role_id=fd65be88941941298be36b142df9b505)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:35.642777 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd618e-d9df-489e-a734-683232374b62 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:35.740684 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 118/234] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:33:35 2022] PUT /identity/v3/projects/c0309156ef604b44ad1f70081379b00e/users/20106f7b2b6743a599a645de7dbde044/roles/fd65be88941941298be36b142df9b505 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:33:36.454829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f07651-6c9b-4edb-ad42-094fce5ec6c0 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:36.455331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f07651-6c9b-4edb-ad42-094fce5ec6c0 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:36.455405 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f07651-6c9b-4edb-ad42-094fce5ec6c0 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:36.456874 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 117/235] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:36.475362 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a93ee-8060-4d8c-8dcd-87c5888729b4 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:36.475870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a93ee-8060-4d8c-8dcd-87c5888729b4 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:36.475943 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a93ee-8060-4d8c-8dcd-87c5888729b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:36.503916 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-f11a93ee-8060-4d8c-8dcd-87c5888729b4 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:36.505126 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f11a93ee-8060-4d8c-8dcd-87c5888729b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:36.605520 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 119/236] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:33:36.666416 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad7188-b5c6-4595-8a6a-8cdc8ebbf106 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:36.666696 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad7188-b5c6-4595-8a6a-8cdc8ebbf106 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:36.666896 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad7188-b5c6-4595-8a6a-8cdc8ebbf106 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:36.668558 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 118/237] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:36.673955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7ddce-b333-4e55-b536-f3fe108966ac None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:36.674248 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7ddce-b333-4e55-b536-f3fe108966ac None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:36.674525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7ddce-b333-4e55-b536-f3fe108966ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:36.693200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-85a7ddce-b333-4e55-b536-f3fe108966ac None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:36.694392 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-85a7ddce-b333-4e55-b536-f3fe108966ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:36.715096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:36.779680 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 120/238] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:37.011144 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad7188-b5c6-4595-8a6a-8cdc8ebbf106 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:37.034232 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:37.106950 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7ddce-b333-4e55-b536-f3fe108966ac None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:37.167904 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad7188-b5c6-4595-8a6a-8cdc8ebbf106 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:37.211166 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7ddce-b333-4e55-b536-f3fe108966ac None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:37.249018 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d9673-ccd1-40ea-9c45-162700c56f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:37.250015 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d9673-ccd1-40ea-9c45-162700c56f4a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:37.250499 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d9673-ccd1-40ea-9c45-162700c56f4a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:37.250986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d9673-ccd1-40ea-9c45-162700c56f4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:37.256240 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b90454-7276-4f4c-8d40-859a4eff228d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:37.256887 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b90454-7276-4f4c-8d40-859a4eff228d None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:37.257161 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b90454-7276-4f4c-8d40-859a4eff228d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:37.257432 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b90454-7276-4f4c-8d40-859a4eff228d None admin] PATH_INFO: `/v3/domains/default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:37.258585 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b90454-7276-4f4c-8d40-859a4eff228d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:37.260079 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b90454-7276-4f4c-8d40-859a4eff228d None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:37.261695 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 119/239] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:33:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:37.264540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d9673-ccd1-40ea-9c45-162700c56f4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:37.268399 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b90454-7276-4f4c-8d40-859a4eff228d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:37.270570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-900d9673-ccd1-40ea-9c45-162700c56f4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 19:33:37.270570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:37.270570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:37.270570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:37.270570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:37.270570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:37.270570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:37.270570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:37.270570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:37.270570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:37.270570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:37.270570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:37.270570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:37.270570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:37.270570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:37.270570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:37.271426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:37.271426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:37.271426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:37.271426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:37.271426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:37.271426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:37.271426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:37.271426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:37.271426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:37.271426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:37.271426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:37.271426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:37.271426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:37.271426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:37.271426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:37.271426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:37.272252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:37.272252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:37.272252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:37.272252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:37.272252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:37.272252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:37.272252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:37.272252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:37.272252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:37.272252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:37.272252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 19:33:37.272252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:33:37.274781 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 121/240] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:33:37.280768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d9673-ccd1-40ea-9c45-162700c56f4a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:37.300730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:37.392818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d9673-ccd1-40ea-9c45-162700c56f4a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:37.427975 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062c109-53e0-492b-bd7d-e3d0119d743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:37.429072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062c109-53e0-492b-bd7d-e3d0119d743d None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:37.429547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062c109-53e0-492b-bd7d-e3d0119d743d None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:37.430011 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062c109-53e0-492b-bd7d-e3d0119d743d None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:37.430894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062c109-53e0-492b-bd7d-e3d0119d743d None admin] RBAC: Adding query filter params (name=reader) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:37.431392 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062c109-53e0-492b-bd7d-e3d0119d743d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:37.433013 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062c109-53e0-492b-bd7d-e3d0119d743d None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:37.442642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 122/241] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:37.448582 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062c109-53e0-492b-bd7d-e3d0119d743d None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:37.503019 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:37.527728 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b90454-7276-4f4c-8d40-859a4eff228d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:37.532925 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:37.573823 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062c109-53e0-492b-bd7d-e3d0119d743d None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:37.609471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f647b6-84cd-4fd0-b464-e195c25e1bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:37.610127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f647b6-84cd-4fd0-b464-e195c25e1bc5 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:37.610409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f647b6-84cd-4fd0-b464-e195c25e1bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:37.610686 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f647b6-84cd-4fd0-b464-e195c25e1bc5 None admin] PATH_INFO: `/v3/users/f11b0b96a8054a6a8deb0549ed86fb28` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:37.625921 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f647b6-84cd-4fd0-b464-e195c25e1bc5 None admin] RBAC: Authorizing `identity:get_user(user_id=f11b0b96a8054a6a8deb0549ed86fb28)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:37.627423 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f647b6-84cd-4fd0-b464-e195c25e1bc5 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:37.629588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 123/242] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:37 2022] GET /identity/v3/users/f11b0b96a8054a6a8deb0549ed86fb28 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:37.632399 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0d8a3-7501-4def-9896-f73883920e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:37.633034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0d8a3-7501-4def-9896-f73883920e95 None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:37.633306 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0d8a3-7501-4def-9896-f73883920e95 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:37.633571 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0d8a3-7501-4def-9896-f73883920e95 None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:37.634323 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0d8a3-7501-4def-9896-f73883920e95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:37.635099 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f647b6-84cd-4fd0-b464-e195c25e1bc5 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:37.635821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0d8a3-7501-4def-9896-f73883920e95 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:37.716716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 120/243] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Sep 14 19:33:37 2022] POST /identity/v3/users => generated 293 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:33:37.718380 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18be4d-7e76-4460-82b2-5f6bf4206ccc None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:37.719130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18be4d-7e76-4460-82b2-5f6bf4206ccc None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:37.719659 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18be4d-7e76-4460-82b2-5f6bf4206ccc None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:37.725628 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 121/244] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:37.727397 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b0c34-d19d-46c2-b141-85c2206fe936 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:37.727923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b0c34-d19d-46c2-b141-85c2206fe936 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:37.728399 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b0c34-d19d-46c2-b141-85c2206fe936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:37.748448 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-388b0c34-d19d-46c2-b141-85c2206fe936 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:37.750058 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-388b0c34-d19d-46c2-b141-85c2206fe936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:37.752403 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f647b6-84cd-4fd0-b464-e195c25e1bc5 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:37.801014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbb1b7-823c-4842-b467-93ff2fd79e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:37.801638 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbb1b7-823c-4842-b467-93ff2fd79e60 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:37.801919 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbb1b7-823c-4842-b467-93ff2fd79e60 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:37.802188 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbb1b7-823c-4842-b467-93ff2fd79e60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:37.807185 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:37.830717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 122/245] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:37.887240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbb1b7-823c-4842-b467-93ff2fd79e60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:37.889309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbb1b7-823c-4842-b467-93ff2fd79e60 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:38.007855 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 124/246] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:33:38.009587 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b0c34-d19d-46c2-b141-85c2206fe936 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:38.092029 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:38.119294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b0c34-d19d-46c2-b141-85c2206fe936 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:38.133209 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbb1b7-823c-4842-b467-93ff2fd79e60 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:38.168847 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1e851-06e8-4b96-9258-761a67d8d936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:38.170126 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1e851-06e8-4b96-9258-761a67d8d936 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:38.170642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1e851-06e8-4b96-9258-761a67d8d936 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:38.171120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1e851-06e8-4b96-9258-761a67d8d936 None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:38.172629 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1e851-06e8-4b96-9258-761a67d8d936 None admin] RBAC: Authorizing `identity:get_project(project_id=c0309156ef604b44ad1f70081379b00e)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:38.174440 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1e851-06e8-4b96-9258-761a67d8d936 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:38.176428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 123/247] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:38 2022] GET /identity/v3/projects/c0309156ef604b44ad1f70081379b00e => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:38.185914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1e851-06e8-4b96-9258-761a67d8d936 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:38.188176 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:38.274211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbb1b7-823c-4842-b467-93ff2fd79e60 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:38.305724 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1e851-06e8-4b96-9258-761a67d8d936 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:38.322075 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b88ac5-aa2e-47e0-919d-28d8e5469609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:38.322861 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b88ac5-aa2e-47e0-919d-28d8e5469609 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:38.322988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b88ac5-aa2e-47e0-919d-28d8e5469609 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:38.323258 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b88ac5-aa2e-47e0-919d-28d8e5469609 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:38.336001 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b88ac5-aa2e-47e0-919d-28d8e5469609 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:38.342444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-72b88ac5-aa2e-47e0-919d-28d8e5469609 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:38.342444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:38.342444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:38.342444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:38.342444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:38.342444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:38.342444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:38.342444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:38.342444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:38.342444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:38.342444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:38.342444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:38.342444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:38.342444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:38.342444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:38.342444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:38.343323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:38.343323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:38.343323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:38.343323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:38.343323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:38.343323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:38.343323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:38.343323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:38.343323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:38.343323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:38.343323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:38.343323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:38.343323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:38.343323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:38.343323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:38.343323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:38.344151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:38.344151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:38.344151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:38.344151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:38.344151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:38.344151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:38.344151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:38.344151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:38.344151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:38.344151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:38.344151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:38.344151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:33:38.344151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 125/248] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:38.345870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74863fd8-94f3-429c-aeba-b37f620a8ba1 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:38.346160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74863fd8-94f3-429c-aeba-b37f620a8ba1 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:38.346438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74863fd8-94f3-429c-aeba-b37f620a8ba1 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:38.349400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713e01e-b34b-416e-a56c-268dbfa2d88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:38.350259 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713e01e-b34b-416e-a56c-268dbfa2d88f None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:38.350748 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713e01e-b34b-416e-a56c-268dbfa2d88f None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:38.351232 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713e01e-b34b-416e-a56c-268dbfa2d88f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:38.351709 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 126/249] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:38.352408 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713e01e-b34b-416e-a56c-268dbfa2d88f None admin] RBAC: Adding query filter params (role.id=44508e6bd9ba4b1b826ac09f102b2782, scope.project.id=c0309156ef604b44ad1f70081379b00e, user.id=f11b0b96a8054a6a8deb0549ed86fb28) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:38.352512 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74863fd8-94f3-429c-aeba-b37f620a8ba1 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:38.353103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713e01e-b34b-416e-a56c-268dbfa2d88f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:38.355112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713e01e-b34b-416e-a56c-268dbfa2d88f None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:38.362592 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 124/250] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:33:38 2022] GET /identity/v3/role_assignments?user.id=f11b0b96a8054a6a8deb0549ed86fb28&scope.project.id=c0309156ef604b44ad1f70081379b00e&role.id=44508e6bd9ba4b1b826ac09f102b2782 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:38.367577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fcf32-7dc7-4dd5-b8d7-0a7ae2eac9d0 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:38.367577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fcf32-7dc7-4dd5-b8d7-0a7ae2eac9d0 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:38.367577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fcf32-7dc7-4dd5-b8d7-0a7ae2eac9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:38.394760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:38.401834 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-c56fcf32-7dc7-4dd5-b8d7-0a7ae2eac9d0 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:38.404848 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-c56fcf32-7dc7-4dd5-b8d7-0a7ae2eac9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:38.499676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 125/251] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:38.504882 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:38.512859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74863fd8-94f3-429c-aeba-b37f620a8ba1 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:38.553561 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91390d5a-e9a1-4e47-8bc5-5ce9ba087fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:38.555065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91390d5a-e9a1-4e47-8bc5-5ce9ba087fea None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:38.555628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91390d5a-e9a1-4e47-8bc5-5ce9ba087fea None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:38.556156 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91390d5a-e9a1-4e47-8bc5-5ce9ba087fea None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:38.557176 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91390d5a-e9a1-4e47-8bc5-5ce9ba087fea None admin] RBAC: Adding query filter params (name=member) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:38.557714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91390d5a-e9a1-4e47-8bc5-5ce9ba087fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:38.559463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91390d5a-e9a1-4e47-8bc5-5ce9ba087fea None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:38.570013 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f9100-8869-4afd-877f-3042bc9fe779 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:38.570536 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f9100-8869-4afd-877f-3042bc9fe779 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:38.570536 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f9100-8869-4afd-877f-3042bc9fe779 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:38.571997 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 126/252] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:33:38.572287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 127/253] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:38.578652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101def-51d7-4fa0-8527-0840937ea97f None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:38.578929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101def-51d7-4fa0-8527-0840937ea97f None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:38.579199 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101def-51d7-4fa0-8527-0840937ea97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:38.579621 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91390d5a-e9a1-4e47-8bc5-5ce9ba087fea None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:38.602455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-58101def-51d7-4fa0-8527-0840937ea97f None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:38.603585 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-58101def-51d7-4fa0-8527-0840937ea97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:38.718453 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91390d5a-e9a1-4e47-8bc5-5ce9ba087fea None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:38.738487 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 127/254] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:33:38.760623 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5655c8-fe03-4dd3-bf2e-bdea588b0b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:38.761270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5655c8-fe03-4dd3-bf2e-bdea588b0b1e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:38.761546 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5655c8-fe03-4dd3-bf2e-bdea588b0b1e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:38.761817 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5655c8-fe03-4dd3-bf2e-bdea588b0b1e None admin] PATH_INFO: `/v3/users/a030a87100c44ff0844da1633661a7c1` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:38.763077 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5655c8-fe03-4dd3-bf2e-bdea588b0b1e None admin] RBAC: Authorizing `identity:get_user(user_id=a030a87100c44ff0844da1633661a7c1)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:38.764919 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5655c8-fe03-4dd3-bf2e-bdea588b0b1e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:38.766865 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 128/255] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:38 2022] GET /identity/v3/users/a030a87100c44ff0844da1633661a7c1 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:38.772642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58101def-51d7-4fa0-8527-0840937ea97f None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:38.845368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5655c8-fe03-4dd3-bf2e-bdea588b0b1e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:38.846674 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:38.876664 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:38.886053 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58101def-51d7-4fa0-8527-0840937ea97f None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:38.924585 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799cf247-4a28-420e-9f77-599234ff8a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:38.925230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cf247-4a28-420e-9f77-599234ff8a1e None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:38.925505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cf247-4a28-420e-9f77-599234ff8a1e None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:38.925775 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cf247-4a28-420e-9f77-599234ff8a1e None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:38.927016 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799cf247-4a28-420e-9f77-599234ff8a1e None admin] RBAC: Authorizing `identity:get_project(project_id=c0309156ef604b44ad1f70081379b00e)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:38.928702 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799cf247-4a28-420e-9f77-599234ff8a1e None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:38.930555 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 128/256] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:38 2022] GET /identity/v3/projects/c0309156ef604b44ad1f70081379b00e => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:38.940071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799cf247-4a28-420e-9f77-599234ff8a1e None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:38.966950 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5655c8-fe03-4dd3-bf2e-bdea588b0b1e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:39.003979 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3be98-bf95-4080-8f18-acc7664b39c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:39.005071 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3be98-bf95-4080-8f18-acc7664b39c1 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:39.005550 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3be98-bf95-4080-8f18-acc7664b39c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:39.006018 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3be98-bf95-4080-8f18-acc7664b39c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:39.017437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3be98-bf95-4080-8f18-acc7664b39c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:39.024052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-36d3be98-bf95-4080-8f18-acc7664b39c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:33:39.024052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:39.024052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:39.024052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:39.024052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:39.024052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:39.024052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:39.024052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:39.024052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:39.024052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:39.024052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:39.024052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:39.024052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:39.024052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:39.024052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:39.024052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:39.024927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:39.024927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:39.024927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:39.024927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:39.024927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:39.024927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:39.024927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:39.024927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:39.024927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:39.024927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:39.024927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:39.024927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:39.024927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:39.024927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:39.024927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:39.024927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:39.025708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:39.025708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:39.025708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:39.025708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:39.025708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:39.025708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:39.025708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:39.025708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:39.025708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:39.025708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:39.025708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:33:39.025708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:33:39.028919 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 129/257] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:33:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:33:39.034894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3be98-bf95-4080-8f18-acc7664b39c1 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:39.056464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799cf247-4a28-420e-9f77-599234ff8a1e None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:39.114583 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67cf1f-68e8-406a-a4f3-4a22a073f5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:39.115258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67cf1f-68e8-406a-a4f3-4a22a073f5ea None admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:39.115535 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67cf1f-68e8-406a-a4f3-4a22a073f5ea None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:39.115833 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67cf1f-68e8-406a-a4f3-4a22a073f5ea None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e/users/a030a87100c44ff0844da1633661a7c1/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:39.120774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb67cf1f-68e8-406a-a4f3-4a22a073f5ea None admin] RBAC: Authorizing `identity:create_grant(project_id=c0309156ef604b44ad1f70081379b00e, user_id=a030a87100c44ff0844da1633661a7c1, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:39.122549 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb67cf1f-68e8-406a-a4f3-4a22a073f5ea None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:39.125480 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:39.133025 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:39.149897 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3be98-bf95-4080-8f18-acc7664b39c1 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:39.188211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa761a-14f7-4f94-a273-1ae4cb996cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:39.189204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa761a-14f7-4f94-a273-1ae4cb996cd3 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:39.189758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa761a-14f7-4f94-a273-1ae4cb996cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:39.190324 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa761a-14f7-4f94-a273-1ae4cb996cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:39.191188 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa761a-14f7-4f94-a273-1ae4cb996cd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:39.191767 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa761a-14f7-4f94-a273-1ae4cb996cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:39.193384 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa761a-14f7-4f94-a273-1ae4cb996cd3 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:39.202771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 130/258] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:39.209237 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa761a-14f7-4f94-a273-1ae4cb996cd3 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:39.215411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 129/259] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:33:38 2022] PUT /identity/v3/projects/c0309156ef604b44ad1f70081379b00e/users/a030a87100c44ff0844da1633661a7c1/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:33:39.279038 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67cf1f-68e8-406a-a4f3-4a22a073f5ea None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:39.398138 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa761a-14f7-4f94-a273-1ae4cb996cd3 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:39.468086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67cf1f-68e8-406a-a4f3-4a22a073f5ea None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:39.476890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07491889-d568-4683-8271-a7c413aa5080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:39.477870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07491889-d568-4683-8271-a7c413aa5080 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:39.478201 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07491889-d568-4683-8271-a7c413aa5080 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:39.478581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07491889-d568-4683-8271-a7c413aa5080 None admin] PATH_INFO: `/v3/users/20106f7b2b6743a599a645de7dbde044` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:39.484438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07491889-d568-4683-8271-a7c413aa5080 None admin] RBAC: Authorizing `identity:get_user(user_id=20106f7b2b6743a599a645de7dbde044)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:39.486191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07491889-d568-4683-8271-a7c413aa5080 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:39.488310 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 131/260] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:39 2022] GET /identity/v3/users/20106f7b2b6743a599a645de7dbde044 => generated 283 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:39.494166 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07491889-d568-4683-8271-a7c413aa5080 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:39.509123 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd050ad-852b-4626-872c-5484f91188b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:39.510019 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd050ad-852b-4626-872c-5484f91188b7 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:39.510445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd050ad-852b-4626-872c-5484f91188b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:39.510862 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd050ad-852b-4626-872c-5484f91188b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:39.523673 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd050ad-852b-4626-872c-5484f91188b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:39.526729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:39.529303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-9fd050ad-852b-4626-872c-5484f91188b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:33:39.529303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:39.529303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:39.529303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:39.529303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:39.529303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:39.529303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:39.529303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:39.529303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:39.529303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:39.529303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:39.529303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:39.529303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:39.529303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:39.529303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:39.529303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:39.530229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:39.530229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:39.530229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:39.530229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:39.530229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:39.530229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:39.530229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:39.530229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:39.530229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:39.530229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:39.530229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:39.530229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:39.530229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:39.530229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:39.530229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:39.530229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:39.531000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:39.531000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:39.531000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:39.531000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:39.531000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:39.531000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:39.531000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:39.531000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:39.531000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:39.531000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:39.531000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:33:39.531000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:39.531000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 130/261] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:33:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:39.538113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd050ad-852b-4626-872c-5484f91188b7 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:39.620722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:39.658573 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07491889-d568-4683-8271-a7c413aa5080 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:39.702038 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd050ad-852b-4626-872c-5484f91188b7 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:39.702435 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89192b98-f290-4f0b-a9e9-ed470784c2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:39.703340 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89192b98-f290-4f0b-a9e9-ed470784c2aa None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:39.704089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89192b98-f290-4f0b-a9e9-ed470784c2aa None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:39.704575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89192b98-f290-4f0b-a9e9-ed470784c2aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:39.757665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d1805-e790-4d25-831d-32c8d9cbe9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:39.758551 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d1805-e790-4d25-831d-32c8d9cbe9be None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:39.758681 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d1805-e790-4d25-831d-32c8d9cbe9be None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:39.758885 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d1805-e790-4d25-831d-32c8d9cbe9be None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:39.759627 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d1805-e790-4d25-831d-32c8d9cbe9be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:39.759902 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d1805-e790-4d25-831d-32c8d9cbe9be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:39.761293 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d1805-e790-4d25-831d-32c8d9cbe9be None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:39.779807 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 131/262] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:33:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:39.784950 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d1805-e790-4d25-831d-32c8d9cbe9be None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:39.791128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89192b98-f290-4f0b-a9e9-ed470784c2aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:39.792901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89192b98-f290-4f0b-a9e9-ed470784c2aa None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:39.816919 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:39.915034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 132/263] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 19:33:39.920867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89192b98-f290-4f0b-a9e9-ed470784c2aa None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:39.992434 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d1805-e790-4d25-831d-32c8d9cbe9be None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:40.027901 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:40.057663 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f69bd-58a3-486e-8994-9695266febf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:40.058671 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f69bd-58a3-486e-8994-9695266febf4 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:40.059179 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f69bd-58a3-486e-8994-9695266febf4 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:40.059775 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f69bd-58a3-486e-8994-9695266febf4 None admin] PATH_INFO: `/v3/users/20106f7b2b6743a599a645de7dbde044` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:40.061969 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f69bd-58a3-486e-8994-9695266febf4 None admin] RBAC: Authorizing `identity:get_user(user_id=20106f7b2b6743a599a645de7dbde044)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:40.065290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f69bd-58a3-486e-8994-9695266febf4 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:40.070458 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 132/264] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:39 2022] GET /identity/v3/users/20106f7b2b6743a599a645de7dbde044 => generated 283 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:40.073880 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f69bd-58a3-486e-8994-9695266febf4 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:40.114072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89192b98-f290-4f0b-a9e9-ed470784c2aa None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:40.145670 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:40.187802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec60a3-d148-4c3d-971b-089bfbb1fa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:40.187802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec60a3-d148-4c3d-971b-089bfbb1fa94 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:40.187802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec60a3-d148-4c3d-971b-089bfbb1fa94 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:40.187802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec60a3-d148-4c3d-971b-089bfbb1fa94 None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:40.188167 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec60a3-d148-4c3d-971b-089bfbb1fa94 None admin] RBAC: Authorizing `identity:get_project(project_id=c0309156ef604b44ad1f70081379b00e)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:40.189299 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec60a3-d148-4c3d-971b-089bfbb1fa94 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:40.197657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 133/265] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:39 2022] GET /identity/v3/projects/c0309156ef604b44ad1f70081379b00e => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:40.199274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec60a3-d148-4c3d-971b-089bfbb1fa94 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:40.242936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f69bd-58a3-486e-8994-9695266febf4 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:40.300253 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc4543-3d9e-4ac5-b57d-0dd639945fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:40.301221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc4543-3d9e-4ac5-b57d-0dd639945fec None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:40.301718 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc4543-3d9e-4ac5-b57d-0dd639945fec None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:40.302204 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc4543-3d9e-4ac5-b57d-0dd639945fec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:40.404305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:40.415261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec60a3-d148-4c3d-971b-089bfbb1fa94 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:40.433574 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc4543-3d9e-4ac5-b57d-0dd639945fec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:40.435923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc4543-3d9e-4ac5-b57d-0dd639945fec None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:40.500343 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039ad23-16bb-4138-9b75-e3dc90f67cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:40.500894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039ad23-16bb-4138-9b75-e3dc90f67cdd None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:40.501179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039ad23-16bb-4138-9b75-e3dc90f67cdd None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:40.501455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039ad23-16bb-4138-9b75-e3dc90f67cdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:40.502193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039ad23-16bb-4138-9b75-e3dc90f67cdd None admin] RBAC: Adding query filter params (role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a, scope.project.id=c0309156ef604b44ad1f70081379b00e, user.id=20106f7b2b6743a599a645de7dbde044) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:40.502495 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039ad23-16bb-4138-9b75-e3dc90f67cdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:40.503968 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039ad23-16bb-4138-9b75-e3dc90f67cdd None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:40.520360 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 134/266] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:33:40 2022] GET /identity/v3/role_assignments?user.id=20106f7b2b6743a599a645de7dbde044&scope.project.id=c0309156ef604b44ad1f70081379b00e&role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:40.579818 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 133/267] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:33:40.585526 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039ad23-16bb-4138-9b75-e3dc90f67cdd None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:40.667259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:40.728966 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039ad23-16bb-4138-9b75-e3dc90f67cdd None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:40.783666 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ed0a0-9593-4259-8d91-da057a29df5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:40.784443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ed0a0-9593-4259-8d91-da057a29df5b None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:40.784724 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ed0a0-9593-4259-8d91-da057a29df5b None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:40.785000 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ed0a0-9593-4259-8d91-da057a29df5b None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:40.792414 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ed0a0-9593-4259-8d91-da057a29df5b None admin] RBAC: Authorizing `identity:get_project(project_id=c0309156ef604b44ad1f70081379b00e)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:40.794010 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ed0a0-9593-4259-8d91-da057a29df5b None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:40.796893 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 135/268] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:40 2022] GET /identity/v3/projects/c0309156ef604b44ad1f70081379b00e => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:40.802466 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc4543-3d9e-4ac5-b57d-0dd639945fec None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:40.906164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:40.923769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc4543-3d9e-4ac5-b57d-0dd639945fec None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:40.972472 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce536a-d321-4e38-b85f-14e1f7985021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:40.973108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce536a-d321-4e38-b85f-14e1f7985021 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:40.973397 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce536a-d321-4e38-b85f-14e1f7985021 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:40.973646 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce536a-d321-4e38-b85f-14e1f7985021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:40.974394 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce536a-d321-4e38-b85f-14e1f7985021 None admin] RBAC: Adding query filter params (role.id=fd65be88941941298be36b142df9b505, scope.project.id=c0309156ef604b44ad1f70081379b00e, user.id=20106f7b2b6743a599a645de7dbde044) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:40.974700 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce536a-d321-4e38-b85f-14e1f7985021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:40.976246 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce536a-d321-4e38-b85f-14e1f7985021 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:40.990120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 134/269] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:33:40 2022] GET /identity/v3/role_assignments?user.id=20106f7b2b6743a599a645de7dbde044&scope.project.id=c0309156ef604b44ad1f70081379b00e&role.id=fd65be88941941298be36b142df9b505 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:41.500342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff104a-6579-4d2c-81dd-e77e0bd1ef12 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:41.501031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff104a-6579-4d2c-81dd-e77e0bd1ef12 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:41.501528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff104a-6579-4d2c-81dd-e77e0bd1ef12 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:41.503396 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 136/270] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:41.509126 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95e80e-50d8-4a7b-b8e0-ca2c685991de None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:41.509652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95e80e-50d8-4a7b-b8e0-ca2c685991de None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:41.510125 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95e80e-50d8-4a7b-b8e0-ca2c685991de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:41.529565 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-bd95e80e-50d8-4a7b-b8e0-ca2c685991de None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:41.531091 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-bd95e80e-50d8-4a7b-b8e0-ca2c685991de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:41.605442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 135/271] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:41.609870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd71c01-11fd-4348-aa22-84db6dcd1e36 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:41.610158 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd71c01-11fd-4348-aa22-84db6dcd1e36 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:41.610445 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd71c01-11fd-4348-aa22-84db6dcd1e36 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:41.611828 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 137/272] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:41.617916 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2aa81-fa10-451e-9cf3-1ea55f2b99c5 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:41.618205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2aa81-fa10-451e-9cf3-1ea55f2b99c5 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:41.618481 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2aa81-fa10-451e-9cf3-1ea55f2b99c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:41.636804 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-34a2aa81-fa10-451e-9cf3-1ea55f2b99c5 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:41.638451 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-34a2aa81-fa10-451e-9cf3-1ea55f2b99c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:41.715657 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 136/273] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:41.876036 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09989df5-e69a-46ae-961b-6989bf7127b8 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:41.876531 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09989df5-e69a-46ae-961b-6989bf7127b8 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:41.876772 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09989df5-e69a-46ae-961b-6989bf7127b8 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:41.878283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 138/274] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:41.883318 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafd2f6-1abb-4323-9f9d-fcc9457b644c None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:41.884135 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafd2f6-1abb-4323-9f9d-fcc9457b644c None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:41.884577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafd2f6-1abb-4323-9f9d-fcc9457b644c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:41.903908 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-cbafd2f6-1abb-4323-9f9d-fcc9457b644c None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:41.905324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-cbafd2f6-1abb-4323-9f9d-fcc9457b644c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:41.907474 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:41.913729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09989df5-e69a-46ae-961b-6989bf7127b8 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:41.989562 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 137/275] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:42.006400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafd2f6-1abb-4323-9f9d-fcc9457b644c None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:42.032651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09989df5-e69a-46ae-961b-6989bf7127b8 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:42.051623 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:42.073775 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86343eac-6773-4169-9eda-3c2f3099148a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:42.074517 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86343eac-6773-4169-9eda-3c2f3099148a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:42.074869 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86343eac-6773-4169-9eda-3c2f3099148a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:42.075219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86343eac-6773-4169-9eda-3c2f3099148a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:42.088702 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86343eac-6773-4169-9eda-3c2f3099148a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:42.096121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-86343eac-6773-4169-9eda-3c2f3099148a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 19:33:42.096121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:42.096121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:42.096121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:42.096121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:42.096121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:42.096121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:42.096121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:42.096121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:42.096121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:42.096121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:42.096121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:42.096121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:42.096121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:42.096121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:42.096121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:42.097059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:42.097059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:42.097059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:42.097059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:42.097059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:42.097059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:42.097059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:42.097059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:42.097059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:42.097059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:42.097059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:42.097059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:42.097059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:42.097059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:42.097059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:42.097059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:42.097845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:42.097845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:42.097845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:42.097845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:42.097845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:42.097845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:42.097845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:42.097845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:42.097845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:42.097845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:42.097845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 19:33:42.097845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:33:42.098434 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 139/276] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:33:42.104434 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86343eac-6773-4169-9eda-3c2f3099148a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:42.124534 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafd2f6-1abb-4323-9f9d-fcc9457b644c None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:42.161051 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225d03e-425c-40bb-a2f9-f01f7827c232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:42.161715 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225d03e-425c-40bb-a2f9-f01f7827c232 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:42.162071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225d03e-425c-40bb-a2f9-f01f7827c232 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:42.162425 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225d03e-425c-40bb-a2f9-f01f7827c232 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:42.173400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225d03e-425c-40bb-a2f9-f01f7827c232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:42.178620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-3225d03e-425c-40bb-a2f9-f01f7827c232 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:42.178620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:42.178620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:42.178620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:42.178620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:42.178620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:42.178620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:42.178620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:42.178620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:42.178620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:42.178620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:42.178620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:42.178620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:42.178620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:42.178620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:42.178620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:42.179493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:42.179493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:42.179493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:42.179493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:42.179493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:42.179493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:42.179493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:42.179493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:42.179493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:42.179493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:42.179493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:42.179493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:42.179493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:42.179493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:42.179493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:42.179493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:42.180311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:42.180311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:42.180311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:42.180311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:42.180311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:42.180311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:42.180311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:42.180311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:42.180311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:42.180311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:42.180311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:42.180311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:42.180311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:42.184694 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 138/277] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:33:42.186496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225d03e-425c-40bb-a2f9-f01f7827c232 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:42.217451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86343eac-6773-4169-9eda-3c2f3099148a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:42.256042 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1e7bf-f9b3-4ef1-9ea8-a820bff43962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:42.256667 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1e7bf-f9b3-4ef1-9ea8-a820bff43962 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:42.256950 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1e7bf-f9b3-4ef1-9ea8-a820bff43962 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:42.257301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1e7bf-f9b3-4ef1-9ea8-a820bff43962 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:42.258001 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1e7bf-f9b3-4ef1-9ea8-a820bff43962 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:42.258308 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1e7bf-f9b3-4ef1-9ea8-a820bff43962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:42.259707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1e7bf-f9b3-4ef1-9ea8-a820bff43962 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:42.269189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 140/278] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:42.270820 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a097b-ec2e-474d-abcf-09b053f7bf5f None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:42.271109 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a097b-ec2e-474d-abcf-09b053f7bf5f None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:42.271384 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a097b-ec2e-474d-abcf-09b053f7bf5f None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:42.272610 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 141/279] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:42.277289 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a097b-ec2e-474d-abcf-09b053f7bf5f None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:42.299656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225d03e-425c-40bb-a2f9-f01f7827c232 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:42.318495 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:42.333427 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c917cab-1187-4bee-acfe-2ad1d1e6357f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:42.334027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c917cab-1187-4bee-acfe-2ad1d1e6357f None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:42.334348 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c917cab-1187-4bee-acfe-2ad1d1e6357f None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:42.334561 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c917cab-1187-4bee-acfe-2ad1d1e6357f None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:42.335216 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c917cab-1187-4bee-acfe-2ad1d1e6357f None admin] RBAC: Adding query filter params (name=member) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:42.335510 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c917cab-1187-4bee-acfe-2ad1d1e6357f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:42.336897 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c917cab-1187-4bee-acfe-2ad1d1e6357f None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:42.344932 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 139/280] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:42.345777 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c917cab-1187-4bee-acfe-2ad1d1e6357f None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:42.379457 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a097b-ec2e-474d-abcf-09b053f7bf5f None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:42.405143 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:42.420432 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144c322-9f15-4fe9-bf64-fd8cf08cfba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:42.420432 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144c322-9f15-4fe9-bf64-fd8cf08cfba2 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:42.420432 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144c322-9f15-4fe9-bf64-fd8cf08cfba2 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:42.420432 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144c322-9f15-4fe9-bf64-fd8cf08cfba2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:42.420798 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144c322-9f15-4fe9-bf64-fd8cf08cfba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:42.420798 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144c322-9f15-4fe9-bf64-fd8cf08cfba2 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:42.420798 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 142/281] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:33:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:42.420798 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88131b4-8854-4918-ae97-a71bec694455 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:42.420798 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88131b4-8854-4918-ae97-a71bec694455 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:42.421082 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88131b4-8854-4918-ae97-a71bec694455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:42.438207 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-d88131b4-8854-4918-ae97-a71bec694455 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:42.439398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-d88131b4-8854-4918-ae97-a71bec694455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:42.446263 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c917cab-1187-4bee-acfe-2ad1d1e6357f None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:42.480407 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d596076-cdbc-424d-8ca9-f1056f3cde01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:42.481039 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d596076-cdbc-424d-8ca9-f1056f3cde01 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:42.481318 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d596076-cdbc-424d-8ca9-f1056f3cde01 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:42.481592 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d596076-cdbc-424d-8ca9-f1056f3cde01 None admin] PATH_INFO: `/v3/users/f11b0b96a8054a6a8deb0549ed86fb28` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:42.482854 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d596076-cdbc-424d-8ca9-f1056f3cde01 None admin] RBAC: Authorizing `identity:get_user(user_id=f11b0b96a8054a6a8deb0549ed86fb28)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:42.484337 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d596076-cdbc-424d-8ca9-f1056f3cde01 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:42.485922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 140/282] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:42 2022] GET /identity/v3/users/f11b0b96a8054a6a8deb0549ed86fb28 => generated 297 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:42.486692 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d596076-cdbc-424d-8ca9-f1056f3cde01 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:42.505584 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 143/283] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:42.506413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88131b4-8854-4918-ae97-a71bec694455 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:42.544353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:42.597108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d596076-cdbc-424d-8ca9-f1056f3cde01 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:42.614327 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88131b4-8854-4918-ae97-a71bec694455 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:42.623281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:42.630885 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05603ab6-73aa-4a3d-85bc-b1eac47125af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:42.631618 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05603ab6-73aa-4a3d-85bc-b1eac47125af None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:42.631899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05603ab6-73aa-4a3d-85bc-b1eac47125af None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:42.633592 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05603ab6-73aa-4a3d-85bc-b1eac47125af None admin] PATH_INFO: `/v3/users/9287c73e2fdb42e3a4f63051c1d8aa9e` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:42.647038 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05603ab6-73aa-4a3d-85bc-b1eac47125af None admin] RBAC: Authorizing `identity:get_user(user_id=9287c73e2fdb42e3a4f63051c1d8aa9e)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:42.648536 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05603ab6-73aa-4a3d-85bc-b1eac47125af None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:42.650181 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 141/284] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:42 2022] GET /identity/v3/users/9287c73e2fdb42e3a4f63051c1d8aa9e => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:42.651009 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05603ab6-73aa-4a3d-85bc-b1eac47125af None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:42.656948 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c80682-d855-4e41-81fa-736f38a77ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:42.657764 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c80682-d855-4e41-81fa-736f38a77ba0 None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:42.658044 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c80682-d855-4e41-81fa-736f38a77ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:42.658313 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c80682-d855-4e41-81fa-736f38a77ba0 None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:42.658965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c80682-d855-4e41-81fa-736f38a77ba0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:42.660926 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c80682-d855-4e41-81fa-736f38a77ba0 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:42.749886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05603ab6-73aa-4a3d-85bc-b1eac47125af None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:42.775287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 144/285] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Sep 14 19:33:42 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:33:42.775287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c80682-d855-4e41-81fa-736f38a77ba0 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:42.799034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdde30-f07e-4dea-a9a9-1bd1710fc5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:42.800349 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdde30-f07e-4dea-a9a9-1bd1710fc5a9 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:42.800631 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdde30-f07e-4dea-a9a9-1bd1710fc5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:42.800906 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdde30-f07e-4dea-a9a9-1bd1710fc5a9 None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:42.802178 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdde30-f07e-4dea-a9a9-1bd1710fc5a9 None admin] RBAC: Authorizing `identity:get_project(project_id=c0309156ef604b44ad1f70081379b00e)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:42.803850 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdde30-f07e-4dea-a9a9-1bd1710fc5a9 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:42.805649 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 142/286] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:42 2022] GET /identity/v3/projects/c0309156ef604b44ad1f70081379b00e => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:42.806475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdde30-f07e-4dea-a9a9-1bd1710fc5a9 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:42.873266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:42.901513 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:42.913943 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c80682-d855-4e41-81fa-736f38a77ba0 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:42.924032 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdde30-f07e-4dea-a9a9-1bd1710fc5a9 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:42.955089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71497198-fc68-4a66-88c4-b507d59ad689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:42.955783 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71497198-fc68-4a66-88c4-b507d59ad689 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:42.956063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71497198-fc68-4a66-88c4-b507d59ad689 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:42.956333 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71497198-fc68-4a66-88c4-b507d59ad689 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:42.957791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71497198-fc68-4a66-88c4-b507d59ad689 None admin] RBAC: Adding query filter params (role.id=f63dc07e563f4ffb9f88aa95c528da47, user.id=9287c73e2fdb42e3a4f63051c1d8aa9e, scope.system=all) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:42.957791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71497198-fc68-4a66-88c4-b507d59ad689 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:42.959215 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71497198-fc68-4a66-88c4-b507d59ad689 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:42.967203 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 145/287] 10.222.0.15 () {56 vars in 1308 bytes} [Wed Sep 14 19:33:42 2022] GET /identity/v3/role_assignments?user.id=9287c73e2fdb42e3a4f63051c1d8aa9e&scope.system=all&role.id=f63dc07e563f4ffb9f88aa95c528da47 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:42.967852 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71497198-fc68-4a66-88c4-b507d59ad689 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:42.970066 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43070dd-99d6-40da-ae81-c761501d742d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:42.970999 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43070dd-99d6-40da-ae81-c761501d742d None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:42.971283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43070dd-99d6-40da-ae81-c761501d742d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:42.972377 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43070dd-99d6-40da-ae81-c761501d742d None admin] PATH_INFO: `/v3/roles/member` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:42.983743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43070dd-99d6-40da-ae81-c761501d742d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:42.989436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-e43070dd-99d6-40da-ae81-c761501d742d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:42.989436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:42.989436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:42.989436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:42.989436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:42.989436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:42.989436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:42.989436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:42.989436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:42.989436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:42.989436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:42.989436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:42.989436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:42.989436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:42.989436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:42.989436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:42.990373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:42.990373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:42.990373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:42.990373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:42.990373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:42.990373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:42.990373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:42.990373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:42.990373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:42.990373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:42.990373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:42.990373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:42.990373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:42.990373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:42.990373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:42.990373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:42.991212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:42.991212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:42.991212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:42.991212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:42.991212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:42.991212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:42.991212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:42.991212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:42.991212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:42.991212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:42.991212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:42.991212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:42.991212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 143/288] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:42.996574 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43070dd-99d6-40da-ae81-c761501d742d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:43.119734 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71497198-fc68-4a66-88c4-b507d59ad689 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:43.143934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43070dd-99d6-40da-ae81-c761501d742d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:43.162523 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:43.173491 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe1a0e-e8d4-4dc9-8efc-4ed630dec2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:43.174174 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe1a0e-e8d4-4dc9-8efc-4ed630dec2d4 None admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:43.174450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe1a0e-e8d4-4dc9-8efc-4ed630dec2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:43.174716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe1a0e-e8d4-4dc9-8efc-4ed630dec2d4 None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e/users/f11b0b96a8054a6a8deb0549ed86fb28/roles/44508e6bd9ba4b1b826ac09f102b2782` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:43.176718 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe1a0e-e8d4-4dc9-8efc-4ed630dec2d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0309156ef604b44ad1f70081379b00e, user_id=f11b0b96a8054a6a8deb0549ed86fb28, role_id=44508e6bd9ba4b1b826ac09f102b2782)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:43.178163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe1a0e-e8d4-4dc9-8efc-4ed630dec2d4 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:43.192366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e0f0d-46d9-482e-9dbc-53158606ed2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:43.193228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e0f0d-46d9-482e-9dbc-53158606ed2b None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:43.193510 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e0f0d-46d9-482e-9dbc-53158606ed2b None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:43.193784 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e0f0d-46d9-482e-9dbc-53158606ed2b None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:43.194465 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e0f0d-46d9-482e-9dbc-53158606ed2b None admin] RBAC: Adding query filter params (name=member) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:43.194770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e0f0d-46d9-482e-9dbc-53158606ed2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:43.196274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e0f0d-46d9-482e-9dbc-53158606ed2b None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:43.206100 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 144/289] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:43.212040 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e0f0d-46d9-482e-9dbc-53158606ed2b None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:43.262574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 146/290] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:33:42 2022] PUT /identity/v3/projects/c0309156ef604b44ad1f70081379b00e/users/f11b0b96a8054a6a8deb0549ed86fb28/roles/44508e6bd9ba4b1b826ac09f102b2782 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:33:43.338959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e0f0d-46d9-482e-9dbc-53158606ed2b None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:43.383580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e57091-00d0-485c-8870-9d0e5d451cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:43.387040 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e57091-00d0-485c-8870-9d0e5d451cbd None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:43.387040 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e57091-00d0-485c-8870-9d0e5d451cbd None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:43.387040 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e57091-00d0-485c-8870-9d0e5d451cbd None admin] PATH_INFO: `/v3/users/a030a87100c44ff0844da1633661a7c1` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:43.387040 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e57091-00d0-485c-8870-9d0e5d451cbd None admin] RBAC: Authorizing `identity:get_user(user_id=a030a87100c44ff0844da1633661a7c1)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:43.387331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e57091-00d0-485c-8870-9d0e5d451cbd None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:43.389248 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 145/291] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:43 2022] GET /identity/v3/users/a030a87100c44ff0844da1633661a7c1 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:43.394998 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe1a0e-e8d4-4dc9-8efc-4ed630dec2d4 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:43.422347 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:43.540157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe1a0e-e8d4-4dc9-8efc-4ed630dec2d4 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:43.581262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd33dc-ccda-4d0c-b83a-33ee4bc51306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:43.581906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd33dc-ccda-4d0c-b83a-33ee4bc51306 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:43.582169 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd33dc-ccda-4d0c-b83a-33ee4bc51306 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:43.582434 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd33dc-ccda-4d0c-b83a-33ee4bc51306 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:43.658739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd33dc-ccda-4d0c-b83a-33ee4bc51306 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:43.660405 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd33dc-ccda-4d0c-b83a-33ee4bc51306 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:43.683606 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:43.766608 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 147/292] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:33:43.772088 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e57091-00d0-485c-8870-9d0e5d451cbd None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:43.837135 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:43.930882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e57091-00d0-485c-8870-9d0e5d451cbd None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:43.967295 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae59682-c59e-4b64-a33c-ce6bafe1dc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:43.968143 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae59682-c59e-4b64-a33c-ce6bafe1dc75 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:43.968420 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae59682-c59e-4b64-a33c-ce6bafe1dc75 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:43.968687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae59682-c59e-4b64-a33c-ce6bafe1dc75 None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:43.969835 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae59682-c59e-4b64-a33c-ce6bafe1dc75 None admin] RBAC: Authorizing `identity:get_project(project_id=c0309156ef604b44ad1f70081379b00e)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:43.971277 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae59682-c59e-4b64-a33c-ce6bafe1dc75 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:43.974230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 146/293] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:43 2022] GET /identity/v3/projects/c0309156ef604b44ad1f70081379b00e => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:43.981012 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd33dc-ccda-4d0c-b83a-33ee4bc51306 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:44.109335 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd33dc-ccda-4d0c-b83a-33ee4bc51306 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:44.132813 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:44.157078 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621f085-6509-49ee-87d9-029049c2bdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:44.157695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621f085-6509-49ee-87d9-029049c2bdcf None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:44.157970 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621f085-6509-49ee-87d9-029049c2bdcf None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:44.158236 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621f085-6509-49ee-87d9-029049c2bdcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:44.158953 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621f085-6509-49ee-87d9-029049c2bdcf None admin] RBAC: Adding query filter params (role.id=f63dc07e563f4ffb9f88aa95c528da47, scope.project.id=c0309156ef604b44ad1f70081379b00e, user.id=a030a87100c44ff0844da1633661a7c1) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:44.159258 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621f085-6509-49ee-87d9-029049c2bdcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:44.160720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621f085-6509-49ee-87d9-029049c2bdcf None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:44.170257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 148/294] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:33:43 2022] GET /identity/v3/role_assignments?user.id=a030a87100c44ff0844da1633661a7c1&scope.project.id=c0309156ef604b44ad1f70081379b00e&role.id=f63dc07e563f4ffb9f88aa95c528da47 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:45.456431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f1f6b-f38b-44d4-a308-9d66fda524e0 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:45.456963 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f1f6b-f38b-44d4-a308-9d66fda524e0 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:45.456963 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f1f6b-f38b-44d4-a308-9d66fda524e0 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:45.458538 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 147/295] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:45.463863 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafeaba8-50e9-44b9-99f5-ec8a6cd89734 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:45.464696 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafeaba8-50e9-44b9-99f5-ec8a6cd89734 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:45.465181 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafeaba8-50e9-44b9-99f5-ec8a6cd89734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:45.483974 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-aafeaba8-50e9-44b9-99f5-ec8a6cd89734 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:45.485479 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-aafeaba8-50e9-44b9-99f5-ec8a6cd89734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:45.530021 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00334033-28d0-4dff-a0ee-eb1171ef3831 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:45.530650 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00334033-28d0-4dff-a0ee-eb1171ef3831 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:45.531148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00334033-28d0-4dff-a0ee-eb1171ef3831 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:45.533014 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 148/296] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:45.537863 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d76d3-bf0b-4b30-aad5-e34853ba8729 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:45.538356 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d76d3-bf0b-4b30-aad5-e34853ba8729 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:45.538826 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d76d3-bf0b-4b30-aad5-e34853ba8729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:45.562278 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-340d76d3-bf0b-4b30-aad5-e34853ba8729 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:45.563848 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-340d76d3-bf0b-4b30-aad5-e34853ba8729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:45.569955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 149/297] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:45.644798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 149/298] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:45.733051 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645ed30-a6e3-47f5-933a-2eb83b978ffb None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:45.733675 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645ed30-a6e3-47f5-933a-2eb83b978ffb None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:45.734162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645ed30-a6e3-47f5-933a-2eb83b978ffb None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:45.735978 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 150/299] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:45.740978 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8e8ea-c49b-42d3-9efa-af93da63c152 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:45.741505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8e8ea-c49b-42d3-9efa-af93da63c152 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:45.741975 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8e8ea-c49b-42d3-9efa-af93da63c152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:45.761314 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-25b8e8ea-c49b-42d3-9efa-af93da63c152 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:45.762783 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-25b8e8ea-c49b-42d3-9efa-af93da63c152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:45.800854 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:45.803716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab04a-90ab-4134-a516-4e7cf68719d4 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:45.804248 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab04a-90ab-4134-a516-4e7cf68719d4 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:45.804753 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab04a-90ab-4134-a516-4e7cf68719d4 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:45.806523 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 151/300] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:45.812538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ce421-1c1e-415e-b19c-6e24aa2cedf0 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:45.813057 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ce421-1c1e-415e-b19c-6e24aa2cedf0 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:45.813496 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ce421-1c1e-415e-b19c-6e24aa2cedf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:45.832271 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-635ce421-1c1e-415e-b19c-6e24aa2cedf0 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:45.833897 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-635ce421-1c1e-415e-b19c-6e24aa2cedf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:45.836471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 150/301] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:45.876345 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8e8ea-c49b-42d3-9efa-af93da63c152 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:45.909121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 152/302] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:33:45.930558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ce421-1c1e-415e-b19c-6e24aa2cedf0 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:45.981964 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:45.984734 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8e8ea-c49b-42d3-9efa-af93da63c152 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:46.023841 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0441b-8abe-4a4d-8149-b33c96a91211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:46.024474 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0441b-8abe-4a4d-8149-b33c96a91211 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:46.024905 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0441b-8abe-4a4d-8149-b33c96a91211 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:46.025347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0441b-8abe-4a4d-8149-b33c96a91211 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:46.039205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0441b-8abe-4a4d-8149-b33c96a91211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:46.044335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-afb0441b-8abe-4a4d-8149-b33c96a91211 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:46.044335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:46.044335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:46.044335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:46.044335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:46.044335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:46.044335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:46.044335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:46.044335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:46.044335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:46.044335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:46.044335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:46.044335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:46.044335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:46.044335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:46.044335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:46.045742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:46.045742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:46.045742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:46.045742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:46.045742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:46.045742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:46.045742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:46.045742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:46.045742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:46.045742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:46.045742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:46.045742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:46.045742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:46.045742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:46.045742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:46.045742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:46.046516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:46.046516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:46.046516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:46.046516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:46.046516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:46.046516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:46.046516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:46.046516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:46.046516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:46.046516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:46.046516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:46.046516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:46.053532 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 151/303] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:33:46.054597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0441b-8abe-4a4d-8149-b33c96a91211 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:46.055584 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ce421-1c1e-415e-b19c-6e24aa2cedf0 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:46.089708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:46.095222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157fa33-3b90-49c6-87e9-b086df2a068e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:46.095905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157fa33-3b90-49c6-87e9-b086df2a068e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:46.096187 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157fa33-3b90-49c6-87e9-b086df2a068e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:46.096459 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157fa33-3b90-49c6-87e9-b086df2a068e None admin] PATH_INFO: `/v3/domains/default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:46.097577 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157fa33-3b90-49c6-87e9-b086df2a068e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:46.099012 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157fa33-3b90-49c6-87e9-b086df2a068e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:46.105166 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 153/304] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:33:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:46.106043 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157fa33-3b90-49c6-87e9-b086df2a068e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:46.173047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0441b-8abe-4a4d-8149-b33c96a91211 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:46.212685 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157fa33-3b90-49c6-87e9-b086df2a068e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:46.215188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b59a6-9289-49fb-b993-582655948c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:46.215826 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b59a6-9289-49fb-b993-582655948c27 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:46.216099 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b59a6-9289-49fb-b993-582655948c27 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:46.216364 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b59a6-9289-49fb-b993-582655948c27 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:46.217583 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b59a6-9289-49fb-b993-582655948c27 None admin] RBAC: Adding query filter params (name=member) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:46.217878 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b59a6-9289-49fb-b993-582655948c27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:46.219237 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b59a6-9289-49fb-b993-582655948c27 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:46.222749 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:46.227454 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 152/305] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:46.228298 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b59a6-9289-49fb-b993-582655948c27 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:46.251295 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c20f0b-7a0b-4630-a837-50810dd1b6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:46.251986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c20f0b-7a0b-4630-a837-50810dd1b6b9 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:46.252509 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c20f0b-7a0b-4630-a837-50810dd1b6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:46.252949 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c20f0b-7a0b-4630-a837-50810dd1b6b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:46.264068 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c20f0b-7a0b-4630-a837-50810dd1b6b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:46.268881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-d3c20f0b-7a0b-4630-a837-50810dd1b6b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 19:33:46.268881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:46.268881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:46.268881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:46.268881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:46.268881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:46.268881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:46.268881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:46.268881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:46.268881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:46.268881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:46.268881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:46.268881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:46.268881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:46.268881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:46.268881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:46.269758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:46.269758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:46.269758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:46.269758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:46.269758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:46.269758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:46.269758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:46.269758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:46.269758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:46.269758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:46.269758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:46.269758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:46.269758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:46.269758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:46.269758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:46.269758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:46.270792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:46.270792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:46.270792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:46.270792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:46.270792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:46.270792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:46.270792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:46.270792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:46.270792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:46.270792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:46.270792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 19:33:46.270792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:33:46.270792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 154/306] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:46.271439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c20f0b-7a0b-4630-a837-50810dd1b6b9 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:46.323827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:46.330060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b59a6-9289-49fb-b993-582655948c27 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:46.363309 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e371cbd-7004-4297-b5f2-ae2d2d02eacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:46.363949 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e371cbd-7004-4297-b5f2-ae2d2d02eacd None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:46.364228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e371cbd-7004-4297-b5f2-ae2d2d02eacd None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:46.364502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e371cbd-7004-4297-b5f2-ae2d2d02eacd None admin] PATH_INFO: `/v3/groups` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:46.365133 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e371cbd-7004-4297-b5f2-ae2d2d02eacd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:46.368823 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e371cbd-7004-4297-b5f2-ae2d2d02eacd None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:46.371173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c20f0b-7a0b-4630-a837-50810dd1b6b9 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:46.405432 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0f5c5-d387-4f5e-9484-9c208a15909a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:46.406100 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0f5c5-d387-4f5e-9484-9c208a15909a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:46.406380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0f5c5-d387-4f5e-9484-9c208a15909a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:46.406654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0f5c5-d387-4f5e-9484-9c208a15909a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:46.416427 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0f5c5-d387-4f5e-9484-9c208a15909a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:46.422385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-f6f0f5c5-d387-4f5e-9484-9c208a15909a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 19:33:46.422385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:46.422385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:46.422385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:46.422385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:46.422385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:46.422385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:46.422385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:46.422385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:46.422385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:46.422385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:46.422385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:46.422385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:46.422385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:46.422385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:46.422385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:46.423455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:46.423455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:46.423455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:46.423455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:46.423455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:46.423455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:46.423455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:46.423455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:46.423455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:46.423455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:46.423455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:46.423455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:46.423455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:46.423455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:46.423455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:46.423455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:46.424528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:46.424528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:46.424528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:46.424528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:46.424528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:46.424528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:46.424528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:46.424528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:46.424528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:46.424528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:46.424528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 19:33:46.424528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:33:46.427684 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 155/307] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:46.428498 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0f5c5-d387-4f5e-9484-9c208a15909a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:46.444496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 153/308] 10.222.0.15 () {60 vars in 1134 bytes} [Wed Sep 14 19:33:46 2022] POST /identity/v3/groups => generated 229 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:33:46.444496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e371cbd-7004-4297-b5f2-ae2d2d02eacd None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:46.459081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:46.549333 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0f5c5-d387-4f5e-9484-9c208a15909a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:46.556602 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e371cbd-7004-4297-b5f2-ae2d2d02eacd None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:46.588265 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ea23c-f5f1-4b7e-9435-9c485aab0df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:46.588923 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ea23c-f5f1-4b7e-9435-9c485aab0df6 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:46.589205 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ea23c-f5f1-4b7e-9435-9c485aab0df6 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:46.589692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ea23c-f5f1-4b7e-9435-9c485aab0df6 None admin] PATH_INFO: `/v3/users/9287c73e2fdb42e3a4f63051c1d8aa9e` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:46.590727 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ea23c-f5f1-4b7e-9435-9c485aab0df6 None admin] RBAC: Authorizing `identity:get_user(user_id=9287c73e2fdb42e3a4f63051c1d8aa9e)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:46.592715 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ea23c-f5f1-4b7e-9435-9c485aab0df6 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:46.599124 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 156/309] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:46 2022] GET /identity/v3/users/9287c73e2fdb42e3a4f63051c1d8aa9e => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:46.599124 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ea23c-f5f1-4b7e-9435-9c485aab0df6 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:46.600238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5ec71-f99c-4f19-abce-5ff477b843ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:46.600878 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5ec71-f99c-4f19-abce-5ff477b843ed None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:46.601152 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5ec71-f99c-4f19-abce-5ff477b843ed None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:46.601418 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5ec71-f99c-4f19-abce-5ff477b843ed None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:46.602100 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5ec71-f99c-4f19-abce-5ff477b843ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:46.602402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5ec71-f99c-4f19-abce-5ff477b843ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:46.603841 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5ec71-f99c-4f19-abce-5ff477b843ed None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:46.613929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 154/310] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:46.614672 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5ec71-f99c-4f19-abce-5ff477b843ed None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:46.636846 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:46.713437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:46.720628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ea23c-f5f1-4b7e-9435-9c485aab0df6 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:46.756726 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5ec71-f99c-4f19-abce-5ff477b843ed None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:46.757291 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016981a1-8682-43b0-944e-f39f86855245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:46.757916 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016981a1-8682-43b0-944e-f39f86855245 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:46.758236 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016981a1-8682-43b0-944e-f39f86855245 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:46.758512 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016981a1-8682-43b0-944e-f39f86855245 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:46.759177 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016981a1-8682-43b0-944e-f39f86855245 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:46.759479 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016981a1-8682-43b0-944e-f39f86855245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:46.760881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016981a1-8682-43b0-944e-f39f86855245 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:46.770090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 157/311] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:46.771057 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016981a1-8682-43b0-944e-f39f86855245 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:46.799512 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a9bef-0c99-46b8-9810-b6c6d1a01927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:46.802285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a9bef-0c99-46b8-9810-b6c6d1a01927 None admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:46.802285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a9bef-0c99-46b8-9810-b6c6d1a01927 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:46.802285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a9bef-0c99-46b8-9810-b6c6d1a01927 None admin] PATH_INFO: `/v3/system/users/9287c73e2fdb42e3a4f63051c1d8aa9e/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:46.802796 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a9bef-0c99-46b8-9810-b6c6d1a01927 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9287c73e2fdb42e3a4f63051c1d8aa9e, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:46.804337 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a9bef-0c99-46b8-9810-b6c6d1a01927 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:46.873494 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016981a1-8682-43b0-944e-f39f86855245 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:46.906484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cbb3d-cf7f-4de3-9373-cfaa6d9b6c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:46.907118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cbb3d-cf7f-4de3-9373-cfaa6d9b6c31 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:46.907396 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cbb3d-cf7f-4de3-9373-cfaa6d9b6c31 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:46.907710 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cbb3d-cf7f-4de3-9373-cfaa6d9b6c31 None admin] PATH_INFO: `/v3/users/2d0da3908ae94d21a7cec14452d65683` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:46.918682 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 155/312] 10.222.0.15 () {58 vars in 1334 bytes} [Wed Sep 14 19:33:46 2022] PUT /identity/v3/system/users/9287c73e2fdb42e3a4f63051c1d8aa9e/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:33:46.919577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a9bef-0c99-46b8-9810-b6c6d1a01927 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:46.927869 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cbb3d-cf7f-4de3-9373-cfaa6d9b6c31 None admin] RBAC: Authorizing `identity:get_user(user_id=2d0da3908ae94d21a7cec14452d65683)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:46.929788 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cbb3d-cf7f-4de3-9373-cfaa6d9b6c31 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:46.932128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 158/313] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:46 2022] GET /identity/v3/users/2d0da3908ae94d21a7cec14452d65683 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:46.938899 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cbb3d-cf7f-4de3-9373-cfaa6d9b6c31 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:46.960508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:47.054066 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:47.057172 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cbb3d-cf7f-4de3-9373-cfaa6d9b6c31 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:47.082410 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a9bef-0c99-46b8-9810-b6c6d1a01927 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:47.097782 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902f321-2ed6-4c31-9fb1-8395084e6b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:47.098198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902f321-2ed6-4c31-9fb1-8395084e6b86 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:47.098549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902f321-2ed6-4c31-9fb1-8395084e6b86 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:47.098826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902f321-2ed6-4c31-9fb1-8395084e6b86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:47.099590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902f321-2ed6-4c31-9fb1-8395084e6b86 None admin] RBAC: Adding query filter params (role.id=44508e6bd9ba4b1b826ac09f102b2782, user.id=2d0da3908ae94d21a7cec14452d65683, scope.system=all) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:47.100821 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902f321-2ed6-4c31-9fb1-8395084e6b86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:47.106459 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902f321-2ed6-4c31-9fb1-8395084e6b86 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:47.108212 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 159/314] 10.222.0.15 () {56 vars in 1308 bytes} [Wed Sep 14 19:33:46 2022] GET /identity/v3/role_assignments?user.id=2d0da3908ae94d21a7cec14452d65683&scope.system=all&role.id=44508e6bd9ba4b1b826ac09f102b2782 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:47.126754 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98b28f-3d06-45ee-9775-6523e80c1976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:47.127430 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98b28f-3d06-45ee-9775-6523e80c1976 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:47.127746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98b28f-3d06-45ee-9775-6523e80c1976 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:47.128024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98b28f-3d06-45ee-9775-6523e80c1976 None admin] PATH_INFO: `/v3/users/f11b0b96a8054a6a8deb0549ed86fb28` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:47.129285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98b28f-3d06-45ee-9775-6523e80c1976 None admin] RBAC: Authorizing `identity:get_user(user_id=f11b0b96a8054a6a8deb0549ed86fb28)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:47.130787 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98b28f-3d06-45ee-9775-6523e80c1976 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:47.132869 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 156/315] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:46 2022] GET /identity/v3/users/f11b0b96a8054a6a8deb0549ed86fb28 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:47.139363 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902f321-2ed6-4c31-9fb1-8395084e6b86 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:47.237930 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:47.259995 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902f321-2ed6-4c31-9fb1-8395084e6b86 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:47.298884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e013124-765f-4b24-959c-577415211d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:47.299508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e013124-765f-4b24-959c-577415211d52 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:47.299816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e013124-765f-4b24-959c-577415211d52 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:47.300088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e013124-765f-4b24-959c-577415211d52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:47.373960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e013124-765f-4b24-959c-577415211d52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:47.375699 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e013124-765f-4b24-959c-577415211d52 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:47.464907 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:47.485684 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 160/316] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:33:47.491604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98b28f-3d06-45ee-9775-6523e80c1976 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:47.601123 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98b28f-3d06-45ee-9775-6523e80c1976 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:47.639406 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5bdaa-cf62-404d-a86c-b22cf1ff7faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:47.640432 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5bdaa-cf62-404d-a86c-b22cf1ff7faf None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:47.640962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5bdaa-cf62-404d-a86c-b22cf1ff7faf None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:47.641535 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5bdaa-cf62-404d-a86c-b22cf1ff7faf None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:47.642883 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5bdaa-cf62-404d-a86c-b22cf1ff7faf None admin] RBAC: Authorizing `identity:get_project(project_id=c0309156ef604b44ad1f70081379b00e)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:47.644563 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5bdaa-cf62-404d-a86c-b22cf1ff7faf None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:47.646951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 157/317] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:47 2022] GET /identity/v3/projects/c0309156ef604b44ad1f70081379b00e => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:47.653127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e013124-765f-4b24-959c-577415211d52 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:47.755526 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e013124-765f-4b24-959c-577415211d52 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:47.791925 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cf4a3-f5d4-4118-8756-bdb77811b326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:47.792546 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cf4a3-f5d4-4118-8756-bdb77811b326 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:47.792826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cf4a3-f5d4-4118-8756-bdb77811b326 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:47.793088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cf4a3-f5d4-4118-8756-bdb77811b326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:47.793814 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cf4a3-f5d4-4118-8756-bdb77811b326 None admin] RBAC: Adding query filter params (role.id=44508e6bd9ba4b1b826ac09f102b2782, scope.project.id=c0309156ef604b44ad1f70081379b00e, user.id=f11b0b96a8054a6a8deb0549ed86fb28) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:47.794124 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cf4a3-f5d4-4118-8756-bdb77811b326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:47.795608 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cf4a3-f5d4-4118-8756-bdb77811b326 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:47.801968 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 161/318] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:33:47 2022] GET /identity/v3/role_assignments?user.id=f11b0b96a8054a6a8deb0549ed86fb28&scope.project.id=c0309156ef604b44ad1f70081379b00e&role.id=44508e6bd9ba4b1b826ac09f102b2782 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:48.656857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38e0d4-9294-4a10-a989-9517e200fb21 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:48.657429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38e0d4-9294-4a10-a989-9517e200fb21 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:48.657429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38e0d4-9294-4a10-a989-9517e200fb21 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:48.658750 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 158/319] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:33:48.664008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ff45-531f-4a19-9a6f-d9f9e2146268 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:48.664481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ff45-531f-4a19-9a6f-d9f9e2146268 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:48.664564 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ff45-531f-4a19-9a6f-d9f9e2146268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:48.683063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-c0b4ff45-531f-4a19-9a6f-d9f9e2146268 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:48.684260 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c0b4ff45-531f-4a19-9a6f-d9f9e2146268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:48.724211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:48.750988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 162/320] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:49.015560 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38e0d4-9294-4a10-a989-9517e200fb21 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:49.034215 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:49.130674 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38e0d4-9294-4a10-a989-9517e200fb21 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:49.170782 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b752a-f69d-4273-bf09-93a08ec0749d None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:49.171106 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b752a-f69d-4273-bf09-93a08ec0749d None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:49.171327 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b752a-f69d-4273-bf09-93a08ec0749d None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:49.173476 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 163/321] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:49.175884 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379f8ae-8cdc-4056-a6d9-21c400620824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:49.176538 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379f8ae-8cdc-4056-a6d9-21c400620824 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:49.176983 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379f8ae-8cdc-4056-a6d9-21c400620824 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:49.177167 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379f8ae-8cdc-4056-a6d9-21c400620824 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:49.180272 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dacaf-3e86-4180-b617-923b1328e287 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:49.180406 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379f8ae-8cdc-4056-a6d9-21c400620824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:49.180490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dacaf-3e86-4180-b617-923b1328e287 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:49.180490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dacaf-3e86-4180-b617-923b1328e287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:49.180628 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379f8ae-8cdc-4056-a6d9-21c400620824 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:49.183580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 159/322] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:33:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:49.188150 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379f8ae-8cdc-4056-a6d9-21c400620824 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:49.199113 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-e72dacaf-3e86-4180-b617-923b1328e287 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:49.200338 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-e72dacaf-3e86-4180-b617-923b1328e287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:49.279853 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 164/323] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:33:49.281793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:49.297939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379f8ae-8cdc-4056-a6d9-21c400620824 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:49.331327 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf6f54-d07d-49cf-8047-c963f74389b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:49.332206 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf6f54-d07d-49cf-8047-c963f74389b2 None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:49.332515 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf6f54-d07d-49cf-8047-c963f74389b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:49.332811 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf6f54-d07d-49cf-8047-c963f74389b2 None admin] PATH_INFO: `/v3/groups` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:49.333588 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf6f54-d07d-49cf-8047-c963f74389b2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:49.335519 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf6f54-d07d-49cf-8047-c963f74389b2 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:49.354769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5082630-1f62-4861-b563-5ffcb5519789 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:49.355055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5082630-1f62-4861-b563-5ffcb5519789 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:49.355328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5082630-1f62-4861-b563-5ffcb5519789 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:49.356853 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 165/324] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:33:49.362047 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bd5a2-6611-45b5-b530-61a28a6ee291 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:49.362333 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bd5a2-6611-45b5-b530-61a28a6ee291 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:49.362609 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bd5a2-6611-45b5-b530-61a28a6ee291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:49.384583 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-cd8bd5a2-6611-45b5-b530-61a28a6ee291 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:49.385746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-cd8bd5a2-6611-45b5-b530-61a28a6ee291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:49.430874 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 160/325] 10.222.0.15 () {60 vars in 1134 bytes} [Wed Sep 14 19:33:49 2022] POST /identity/v3/groups => generated 226 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:33:49.455532 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 166/326] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:33:49.543895 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf6f54-d07d-49cf-8047-c963f74389b2 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:49.653973 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf6f54-d07d-49cf-8047-c963f74389b2 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:49.689784 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1611ac0-82ee-4ee5-a739-51d77bafa289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:49.690505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1611ac0-82ee-4ee5-a739-51d77bafa289 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:49.690690 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1611ac0-82ee-4ee5-a739-51d77bafa289 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:49.690966 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1611ac0-82ee-4ee5-a739-51d77bafa289 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:49.701847 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1611ac0-82ee-4ee5-a739-51d77bafa289 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:49.707324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-c1611ac0-82ee-4ee5-a739-51d77bafa289 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:49.707324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:49.707324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:49.707324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:49.707324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:49.707324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:49.707324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:49.707324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:49.707324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:49.707324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:49.707324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:49.707324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:49.707324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:49.707324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:49.707324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:49.707324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:49.708269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:49.708269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:49.708269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:49.708269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:49.708269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:49.708269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:49.708269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:49.708269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:49.708269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:49.708269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:49.708269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:49.708269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:49.708269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:49.708269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:49.708269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:49.708269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:49.709071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:49.709071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:49.709071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:49.709071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:49.709071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:49.709071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:49.709071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:49.709071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:49.709071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:49.709071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:49.709071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:49.709071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:49.709071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 161/327] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:49.715784 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8bd5a2-6611-45b5-b530-61a28a6ee291 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:49.726710 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1611ac0-82ee-4ee5-a739-51d77bafa289 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:49.732652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:49.761453 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:49.843320 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8bd5a2-6611-45b5-b530-61a28a6ee291 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:49.853123 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1611ac0-82ee-4ee5-a739-51d77bafa289 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:49.885568 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06accb7f-6df4-47f2-9e5e-c0d23c2ac695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:49.886198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06accb7f-6df4-47f2-9e5e-c0d23c2ac695 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:49.886593 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06accb7f-6df4-47f2-9e5e-c0d23c2ac695 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:49.886876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06accb7f-6df4-47f2-9e5e-c0d23c2ac695 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:49.887686 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06accb7f-6df4-47f2-9e5e-c0d23c2ac695 None admin] RBAC: Adding query filter params (name=member) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:49.888005 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06accb7f-6df4-47f2-9e5e-c0d23c2ac695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:49.890211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06accb7f-6df4-47f2-9e5e-c0d23c2ac695 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:49.898144 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475eb4a-95f6-440d-9c10-c8fb30dde218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:49.899124 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475eb4a-95f6-440d-9c10-c8fb30dde218 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:49.899606 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475eb4a-95f6-440d-9c10-c8fb30dde218 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:49.900043 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 167/328] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:49.900228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475eb4a-95f6-440d-9c10-c8fb30dde218 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:49.906484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06accb7f-6df4-47f2-9e5e-c0d23c2ac695 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:49.916063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475eb4a-95f6-440d-9c10-c8fb30dde218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:49.922459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-5475eb4a-95f6-440d-9c10-c8fb30dde218 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 19:33:49.922459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:49.922459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:49.922459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:49.922459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:49.922459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:49.922459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:49.922459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:49.922459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:49.922459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:49.922459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:49.922459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:49.922459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:49.922459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:49.922459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:49.922459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:49.923383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:49.923383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:49.923383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:49.923383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:49.923383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:49.923383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:49.923383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:49.923383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:49.923383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:49.923383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:49.923383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:49.923383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:49.923383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:49.923383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:49.923383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:49.923383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:49.924930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:49.924930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:49.924930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:49.924930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:49.924930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:49.924930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:49.924930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:49.924930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:49.924930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:49.924930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:49.924930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 19:33:49.924930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:49.924930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 162/329] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:33:49.929287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475eb4a-95f6-440d-9c10-c8fb30dde218 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:50.019888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:50.035871 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:50.044072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06accb7f-6df4-47f2-9e5e-c0d23c2ac695 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:50.086730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475eb4a-95f6-440d-9c10-c8fb30dde218 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:50.098367 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a5b5d-2a60-4e6b-acf6-3b117b4f091a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:50.099325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a5b5d-2a60-4e6b-acf6-3b117b4f091a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:50.100273 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a5b5d-2a60-4e6b-acf6-3b117b4f091a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:50.100900 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a5b5d-2a60-4e6b-acf6-3b117b4f091a None admin] PATH_INFO: `/v3/users/9287c73e2fdb42e3a4f63051c1d8aa9e` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:50.102390 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a5b5d-2a60-4e6b-acf6-3b117b4f091a None admin] RBAC: Authorizing `identity:get_user(user_id=9287c73e2fdb42e3a4f63051c1d8aa9e)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:50.104948 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a5b5d-2a60-4e6b-acf6-3b117b4f091a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:50.112561 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 168/330] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:49 2022] GET /identity/v3/users/9287c73e2fdb42e3a4f63051c1d8aa9e => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:50.113806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a5b5d-2a60-4e6b-acf6-3b117b4f091a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:50.132285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083c505-f039-430e-a854-c2c634519aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:50.132940 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083c505-f039-430e-a854-c2c634519aa1 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:50.133218 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083c505-f039-430e-a854-c2c634519aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:50.133563 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083c505-f039-430e-a854-c2c634519aa1 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:50.134151 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083c505-f039-430e-a854-c2c634519aa1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:50.134452 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083c505-f039-430e-a854-c2c634519aa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:50.135993 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083c505-f039-430e-a854-c2c634519aa1 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:50.146564 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 163/331] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:50.153339 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083c505-f039-430e-a854-c2c634519aa1 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:50.246609 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a5b5d-2a60-4e6b-acf6-3b117b4f091a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:50.286500 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083c505-f039-430e-a854-c2c634519aa1 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:50.297123 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ec5bf-610b-4cad-90df-8a70d28a3140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:50.297792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ec5bf-610b-4cad-90df-8a70d28a3140 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:50.298294 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ec5bf-610b-4cad-90df-8a70d28a3140 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:50.298407 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ec5bf-610b-4cad-90df-8a70d28a3140 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:50.299162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ec5bf-610b-4cad-90df-8a70d28a3140 None admin] RBAC: Adding query filter params (role.id=f63dc07e563f4ffb9f88aa95c528da47, user.id=9287c73e2fdb42e3a4f63051c1d8aa9e, scope.system=all) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:50.299493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ec5bf-610b-4cad-90df-8a70d28a3140 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:50.301071 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ec5bf-610b-4cad-90df-8a70d28a3140 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:50.316892 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 169/332] 10.222.0.15 () {56 vars in 1308 bytes} [Wed Sep 14 19:33:50 2022] GET /identity/v3/role_assignments?user.id=9287c73e2fdb42e3a4f63051c1d8aa9e&scope.system=all&role.id=f63dc07e563f4ffb9f88aa95c528da47 => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:50.317561 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:50.334341 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb1f2a-3dcd-4592-95df-927b67f92073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:50.335749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb1f2a-3dcd-4592-95df-927b67f92073 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:50.335749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb1f2a-3dcd-4592-95df-927b67f92073 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:50.336033 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb1f2a-3dcd-4592-95df-927b67f92073 None admin] PATH_INFO: `/v3/users/2d0da3908ae94d21a7cec14452d65683` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:50.337436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb1f2a-3dcd-4592-95df-927b67f92073 None admin] RBAC: Authorizing `identity:get_user(user_id=2d0da3908ae94d21a7cec14452d65683)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:50.338955 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb1f2a-3dcd-4592-95df-927b67f92073 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:50.346540 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 164/333] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:50 2022] GET /identity/v3/users/2d0da3908ae94d21a7cec14452d65683 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:50.348104 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ec5bf-610b-4cad-90df-8a70d28a3140 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:50.378025 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:50.465137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ec5bf-610b-4cad-90df-8a70d28a3140 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:50.503887 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ea6be-923b-4c67-aa91-42b16ad14aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:50.504566 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ea6be-923b-4c67-aa91-42b16ad14aa6 None admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:50.504848 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ea6be-923b-4c67-aa91-42b16ad14aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:50.505120 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ea6be-923b-4c67-aa91-42b16ad14aa6 None admin] PATH_INFO: `/v3/system/users/2d0da3908ae94d21a7cec14452d65683/roles/44508e6bd9ba4b1b826ac09f102b2782` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:50.506640 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ea6be-923b-4c67-aa91-42b16ad14aa6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2d0da3908ae94d21a7cec14452d65683, role_id=44508e6bd9ba4b1b826ac09f102b2782)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:50.508149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ea6be-923b-4c67-aa91-42b16ad14aa6 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:50.576125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 170/334] 10.222.0.15 () {58 vars in 1334 bytes} [Wed Sep 14 19:33:50 2022] PUT /identity/v3/system/users/2d0da3908ae94d21a7cec14452d65683/roles/44508e6bd9ba4b1b826ac09f102b2782 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:33:51.920010 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2107a7d-fdbb-4816-82da-f4267197d378 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:51.920582 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2107a7d-fdbb-4816-82da-f4267197d378 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:51.920688 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2107a7d-fdbb-4816-82da-f4267197d378 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:51.922192 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 165/335] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:51.934563 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06633388-47d3-4db0-9367-dc8f3ba36979 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:51.935059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06633388-47d3-4db0-9367-dc8f3ba36979 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:51.935131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06633388-47d3-4db0-9367-dc8f3ba36979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:51.965366 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-06633388-47d3-4db0-9367-dc8f3ba36979 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:51.966592 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-06633388-47d3-4db0-9367-dc8f3ba36979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:52.045965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 171/336] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:52.467789 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d4a45-bfbc-4491-8a28-5ff83ff82781 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:52.468192 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d4a45-bfbc-4491-8a28-5ff83ff82781 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:52.468471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d4a45-bfbc-4491-8a28-5ff83ff82781 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:52.470097 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 166/337] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:52.475610 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbc022-bf13-4f92-97ea-3b65ecb4650d None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:52.475898 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbc022-bf13-4f92-97ea-3b65ecb4650d None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:52.476168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbc022-bf13-4f92-97ea-3b65ecb4650d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:52.504545 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-29dbc022-bf13-4f92-97ea-3b65ecb4650d None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:52.505742 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-29dbc022-bf13-4f92-97ea-3b65ecb4650d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:52.517408 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:52.584198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 172/338] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:52.635561 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d4a45-bfbc-4491-8a28-5ff83ff82781 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:52.752832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d4a45-bfbc-4491-8a28-5ff83ff82781 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:52.788948 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c41d22-3503-49c4-a5e0-02963d235d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:52.789586 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c41d22-3503-49c4-a5e0-02963d235d0b None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:52.789861 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c41d22-3503-49c4-a5e0-02963d235d0b None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:52.790129 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c41d22-3503-49c4-a5e0-02963d235d0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:52.801969 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c41d22-3503-49c4-a5e0-02963d235d0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:52.807007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-f2c41d22-3503-49c4-a5e0-02963d235d0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:52.807007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:52.807007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:52.807007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:52.807007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:52.807007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:52.807007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:52.807007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:52.807007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:52.807007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:52.807007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:52.807007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:52.807007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:52.807007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:52.807007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:52.807007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:52.807898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:52.807898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:52.807898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:52.807898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:52.807898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:52.807898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:52.807898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:52.807898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:52.807898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:52.807898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:52.807898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:52.807898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:52.807898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:52.807898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:52.807898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:52.807898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:52.808676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:52.808676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:52.808676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:52.808676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:52.808676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:52.808676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:52.808676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:52.808676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:52.808676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:52.808676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:52.808676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:52.808676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:52.808676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 167/339] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:52.814773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbc022-bf13-4f92-97ea-3b65ecb4650d None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:52.942765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbc022-bf13-4f92-97ea-3b65ecb4650d None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:52.975422 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c41d22-3503-49c4-a5e0-02963d235d0b None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:52.989325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a2aa5-1a76-43fe-85ca-25193f70d31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:52.990177 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a2aa5-1a76-43fe-85ca-25193f70d31b None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:52.990452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a2aa5-1a76-43fe-85ca-25193f70d31b None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:52.990714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a2aa5-1a76-43fe-85ca-25193f70d31b None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:52.991432 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a2aa5-1a76-43fe-85ca-25193f70d31b None admin] RBAC: Adding query filter params (name=member) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:52.991756 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a2aa5-1a76-43fe-85ca-25193f70d31b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:52.999567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a2aa5-1a76-43fe-85ca-25193f70d31b None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:53.007967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 173/340] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:53.014654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a2aa5-1a76-43fe-85ca-25193f70d31b None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:53.030518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:53.105283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:53.196613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a2aa5-1a76-43fe-85ca-25193f70d31b None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:53.201069 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c41d22-3503-49c4-a5e0-02963d235d0b None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:53.273639 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d748d6-ba9a-4510-b863-d1c5ae411007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:53.274269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d748d6-ba9a-4510-b863-d1c5ae411007 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:53.274543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d748d6-ba9a-4510-b863-d1c5ae411007 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:53.274814 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d748d6-ba9a-4510-b863-d1c5ae411007 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:53.280412 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ace88-09ae-4e6b-aed3-ff9cf3f5cefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:53.281363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ace88-09ae-4e6b-aed3-ff9cf3f5cefb None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:53.281854 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ace88-09ae-4e6b-aed3-ff9cf3f5cefb None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:53.282315 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ace88-09ae-4e6b-aed3-ff9cf3f5cefb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:53.306464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ace88-09ae-4e6b-aed3-ff9cf3f5cefb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:53.312827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-028ace88-09ae-4e6b-aed3-ff9cf3f5cefb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:33:53.312827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:53.312827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:53.312827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:53.312827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:53.312827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:53.312827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:53.312827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:53.312827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:53.312827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:53.312827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:53.312827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:53.312827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:53.312827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:53.312827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:53.312827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:53.313714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:53.313714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:53.313714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:53.313714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:53.313714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:53.313714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:53.313714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:53.313714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:53.313714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:53.313714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:53.313714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:53.313714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:53.313714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:53.313714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:53.313714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:53.313714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:53.314499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:53.314499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:53.314499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:53.314499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:53.314499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:53.314499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:53.314499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:53.314499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:53.314499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:53.314499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:53.314499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:33:53.314499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:53.321666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 168/341] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:33:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:33:53.322968 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ace88-09ae-4e6b-aed3-ff9cf3f5cefb None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:53.429461 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d748d6-ba9a-4510-b863-d1c5ae411007 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:53.430967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d748d6-ba9a-4510-b863-d1c5ae411007 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:53.442541 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:53.533416 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ace88-09ae-4e6b-aed3-ff9cf3f5cefb None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:53.557976 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:53.584046 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c9b50-7bf1-44fd-bf40-71e6222b48d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:53.585293 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c9b50-7bf1-44fd-bf40-71e6222b48d1 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:53.585723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c9b50-7bf1-44fd-bf40-71e6222b48d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:53.586211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c9b50-7bf1-44fd-bf40-71e6222b48d1 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:53.587035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c9b50-7bf1-44fd-bf40-71e6222b48d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:53.587487 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c9b50-7bf1-44fd-bf40-71e6222b48d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:53.589209 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c9b50-7bf1-44fd-bf40-71e6222b48d1 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:53.599132 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 174/342] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 19:33:53.599132 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09619af6-324b-49d1-b8bc-141dc398e9e9 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:53.599132 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09619af6-324b-49d1-b8bc-141dc398e9e9 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:53.599477 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09619af6-324b-49d1-b8bc-141dc398e9e9 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:53.600696 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 175/343] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:53.602046 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 169/344] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:33:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:53.605961 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09619af6-324b-49d1-b8bc-141dc398e9e9 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:53.607585 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c9b50-7bf1-44fd-bf40-71e6222b48d1 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:53.745364 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c9b50-7bf1-44fd-bf40-71e6222b48d1 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:53.760281 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09619af6-324b-49d1-b8bc-141dc398e9e9 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:53.771633 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:53.801675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08fd02-1c2a-4c5e-9fa3-ac0504ffad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:53.804196 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08fd02-1c2a-4c5e-9fa3-ac0504ffad26 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:53.806815 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08fd02-1c2a-4c5e-9fa3-ac0504ffad26 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:53.806815 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08fd02-1c2a-4c5e-9fa3-ac0504ffad26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:53.813847 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf7691-891b-4a49-a1dc-c8612205caf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:53.814760 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf7691-891b-4a49-a1dc-c8612205caf8 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:53.815240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf7691-891b-4a49-a1dc-c8612205caf8 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:53.815676 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf7691-891b-4a49-a1dc-c8612205caf8 None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:53.817011 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf7691-891b-4a49-a1dc-c8612205caf8 None admin] RBAC: Authorizing `identity:get_project(project_id=40b14549caef48dfb5996de78e97302f)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:53.819849 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf7691-891b-4a49-a1dc-c8612205caf8 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:53.822088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 176/345] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:53 2022] GET /identity/v3/projects/40b14549caef48dfb5996de78e97302f => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:53.828638 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba701891-127d-4840-8e86-d7fc4df166f0 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:53.829119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba701891-127d-4840-8e86-d7fc4df166f0 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:53.829532 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba701891-127d-4840-8e86-d7fc4df166f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:53.857530 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-ba701891-127d-4840-8e86-d7fc4df166f0 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:53.859007 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ba701891-127d-4840-8e86-d7fc4df166f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:53.884153 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:53.909420 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08fd02-1c2a-4c5e-9fa3-ac0504ffad26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:53.910922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08fd02-1c2a-4c5e-9fa3-ac0504ffad26 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:53.938969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 177/346] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:53.940090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba701891-127d-4840-8e86-d7fc4df166f0 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:54.032211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 170/347] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:33:54.033627 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb87c2-ce08-4a66-9c27-878c844fc495 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:54.033916 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb87c2-ce08-4a66-9c27-878c844fc495 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:54.034192 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb87c2-ce08-4a66-9c27-878c844fc495 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:54.035752 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 171/348] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:54.037240 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb87c2-ce08-4a66-9c27-878c844fc495 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:54.050521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba701891-127d-4840-8e86-d7fc4df166f0 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:54.058812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:54.087435 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a694c-000a-4f32-b214-420ecd2ef0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:54.088117 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a694c-000a-4f32-b214-420ecd2ef0ea None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:54.088428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a694c-000a-4f32-b214-420ecd2ef0ea None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:54.088678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a694c-000a-4f32-b214-420ecd2ef0ea None admin] PATH_INFO: `/v3/groups/588e9ea9bd9e452ca96da287150dcaf2` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:54.097230 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a694c-000a-4f32-b214-420ecd2ef0ea None admin] RBAC: Authorizing `identity:get_group(group_id=588e9ea9bd9e452ca96da287150dcaf2)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:54.098843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a694c-000a-4f32-b214-420ecd2ef0ea None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:54.100636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 178/349] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Sep 14 19:33:53 2022] GET /identity/v3/groups/588e9ea9bd9e452ca96da287150dcaf2 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:54.101789 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb435b0-1d60-4023-9d0a-42dd736643bc None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:54.102071 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb435b0-1d60-4023-9d0a-42dd736643bc None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:54.102342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb435b0-1d60-4023-9d0a-42dd736643bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:54.122469 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-8eb435b0-1d60-4023-9d0a-42dd736643bc None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:54.124330 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-8eb435b0-1d60-4023-9d0a-42dd736643bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:54.165545 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:54.199978 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb87c2-ce08-4a66-9c27-878c844fc495 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:54.221785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 179/350] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:54.222726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb435b0-1d60-4023-9d0a-42dd736643bc None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:54.268121 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b08506-ee52-4616-8b29-d92ab01adb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:54.268772 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b08506-ee52-4616-8b29-d92ab01adb75 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:54.269050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b08506-ee52-4616-8b29-d92ab01adb75 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:54.269324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b08506-ee52-4616-8b29-d92ab01adb75 None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:54.270593 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b08506-ee52-4616-8b29-d92ab01adb75 None admin] RBAC: Authorizing `identity:get_project(project_id=40b14549caef48dfb5996de78e97302f)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:54.272324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b08506-ee52-4616-8b29-d92ab01adb75 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:54.274107 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 172/351] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:54 2022] GET /identity/v3/projects/40b14549caef48dfb5996de78e97302f => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:54.280198 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b08506-ee52-4616-8b29-d92ab01adb75 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:54.387590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:54.387590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb435b0-1d60-4023-9d0a-42dd736643bc None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:54.414018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b08506-ee52-4616-8b29-d92ab01adb75 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:54.425137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5706f-be29-4ebc-ab67-28542366fabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:54.425773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5706f-be29-4ebc-ab67-28542366fabd None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:54.426055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5706f-be29-4ebc-ab67-28542366fabd None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:54.426325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5706f-be29-4ebc-ab67-28542366fabd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:54.427073 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5706f-be29-4ebc-ab67-28542366fabd None admin] RBAC: Adding query filter params (group.id=588e9ea9bd9e452ca96da287150dcaf2, role.id=f63dc07e563f4ffb9f88aa95c528da47, scope.project.id=40b14549caef48dfb5996de78e97302f) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:54.427390 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5706f-be29-4ebc-ab67-28542366fabd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:54.428912 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5706f-be29-4ebc-ab67-28542366fabd None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:54.435368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 180/352] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Sep 14 19:33:54 2022] GET /identity/v3/role_assignments?group.id=588e9ea9bd9e452ca96da287150dcaf2&scope.project.id=40b14549caef48dfb5996de78e97302f&role.id=f63dc07e563f4ffb9f88aa95c528da47 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:54.436089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5706f-be29-4ebc-ab67-28542366fabd None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:54.457158 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472b972-81c9-4e37-bc69-6a948164b516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:54.457813 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472b972-81c9-4e37-bc69-6a948164b516 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:54.458090 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472b972-81c9-4e37-bc69-6a948164b516 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:54.458363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472b972-81c9-4e37-bc69-6a948164b516 None admin] PATH_INFO: `/v3/groups/588e9ea9bd9e452ca96da287150dcaf2` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:54.459651 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472b972-81c9-4e37-bc69-6a948164b516 None admin] RBAC: Authorizing `identity:get_group(group_id=588e9ea9bd9e452ca96da287150dcaf2)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:54.461215 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472b972-81c9-4e37-bc69-6a948164b516 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:54.463280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 173/353] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Sep 14 19:33:54 2022] GET /identity/v3/groups/588e9ea9bd9e452ca96da287150dcaf2 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:54.468890 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472b972-81c9-4e37-bc69-6a948164b516 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:54.492041 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:54.552643 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5706f-be29-4ebc-ab67-28542366fabd None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:54.590854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d59e3-8d1f-4747-a7f6-a195252e9a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:54.591515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d59e3-8d1f-4747-a7f6-a195252e9a2e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:54.591831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d59e3-8d1f-4747-a7f6-a195252e9a2e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:54.592105 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d59e3-8d1f-4747-a7f6-a195252e9a2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:54.605147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d59e3-8d1f-4747-a7f6-a195252e9a2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:54.611309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-276d59e3-8d1f-4747-a7f6-a195252e9a2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:54.611309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:54.611309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:54.611309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:54.611309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:54.611309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:54.611309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:54.611309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:54.611309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:54.611309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:54.611309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:54.611309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:54.611309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:54.611309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:54.611309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:54.611309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:54.612502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:54.612502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:54.612502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:54.612502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:54.612502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:54.612502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:54.612502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:54.612502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:54.612502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:54.612502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:54.612502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:54.612502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:54.612502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:54.612502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:54.612502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:54.612502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:54.613514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:54.613514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:54.613514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:54.613514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:54.613514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:54.613514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:54.613514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:54.613514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:54.613514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:54.613514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:54.613514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:54.613514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:33:54.615737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 181/354] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:54.617807 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d9636-8e03-47b2-8b9f-9b3f3d54fd61 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:54.618278 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d9636-8e03-47b2-8b9f-9b3f3d54fd61 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:54.618723 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d9636-8e03-47b2-8b9f-9b3f3d54fd61 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:54.620594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 182/355] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:54.627925 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c17bf-640a-426f-8f29-2541b4e102f9 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:54.628469 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c17bf-640a-426f-8f29-2541b4e102f9 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:54.629021 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c17bf-640a-426f-8f29-2541b4e102f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:54.632139 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472b972-81c9-4e37-bc69-6a948164b516 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:54.651121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-390c17bf-640a-426f-8f29-2541b4e102f9 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:54.652851 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-390c17bf-640a-426f-8f29-2541b4e102f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:54.673728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:54.693718 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be1571-85e3-4a81-a7ae-9a4951bddbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:54.694713 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be1571-85e3-4a81-a7ae-9a4951bddbb7 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:54.695136 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be1571-85e3-4a81-a7ae-9a4951bddbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:54.695577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be1571-85e3-4a81-a7ae-9a4951bddbb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:54.696504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be1571-85e3-4a81-a7ae-9a4951bddbb7 None admin] RBAC: Adding query filter params (group.id=588e9ea9bd9e452ca96da287150dcaf2, role.id=fd65be88941941298be36b142df9b505, scope.project.id=40b14549caef48dfb5996de78e97302f) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:54.697010 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be1571-85e3-4a81-a7ae-9a4951bddbb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:54.698672 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be1571-85e3-4a81-a7ae-9a4951bddbb7 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:54.711556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 174/356] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Sep 14 19:33:54 2022] GET /identity/v3/role_assignments?group.id=588e9ea9bd9e452ca96da287150dcaf2&scope.project.id=40b14549caef48dfb5996de78e97302f&role.id=fd65be88941941298be36b142df9b505 => generated 260 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:54.712882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be1571-85e3-4a81-a7ae-9a4951bddbb7 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:54.732156 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 183/357] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:33:54.733765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c17bf-640a-426f-8f29-2541b4e102f9 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:54.811095 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:54.837403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be1571-85e3-4a81-a7ae-9a4951bddbb7 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:54.852851 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c17bf-640a-426f-8f29-2541b4e102f9 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:54.882810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6573616-75c2-4d73-8d98-2d63a39daa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:54.883754 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573616-75c2-4d73-8d98-2d63a39daa34 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:54.884242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573616-75c2-4d73-8d98-2d63a39daa34 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:54.884736 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573616-75c2-4d73-8d98-2d63a39daa34 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:54.885629 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6573616-75c2-4d73-8d98-2d63a39daa34 None admin] RBAC: Adding query filter params (name=member) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:54.886148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6573616-75c2-4d73-8d98-2d63a39daa34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:54.887800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6573616-75c2-4d73-8d98-2d63a39daa34 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:54.893220 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d5e92-d5e5-4510-9b9a-d54b3259cbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:54.893874 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d5e92-d5e5-4510-9b9a-d54b3259cbf9 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:54.894156 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d5e92-d5e5-4510-9b9a-d54b3259cbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:54.894426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d5e92-d5e5-4510-9b9a-d54b3259cbf9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:54.901187 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 175/358] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:54.910993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d5e92-d5e5-4510-9b9a-d54b3259cbf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:54.912112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6573616-75c2-4d73-8d98-2d63a39daa34 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:54.916879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-b28d5e92-d5e5-4510-9b9a-d54b3259cbf9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 19:33:54.916879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:54.916879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:54.916879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:54.916879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:54.916879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:54.916879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:54.916879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:54.916879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:54.916879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:54.916879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:54.916879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:54.916879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:54.916879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:54.916879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:54.916879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:54.917915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:54.917915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:54.917915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:54.917915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:54.917915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:54.917915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:54.917915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:54.917915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:54.917915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:54.917915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:54.917915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:54.917915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:54.917915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:54.917915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:54.917915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:54.917915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:54.918703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:54.918703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:54.918703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:54.918703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:54.918703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:54.918703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:54.918703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:54.918703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:54.918703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:54.918703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:54.918703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 19:33:54.918703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:33:54.921313 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 184/359] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:54.927105 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d5e92-d5e5-4510-9b9a-d54b3259cbf9 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:54.946163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:55.035756 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6573616-75c2-4d73-8d98-2d63a39daa34 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:55.073365 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d5e92-d5e5-4510-9b9a-d54b3259cbf9 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:55.102744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301ab67-a7c0-480d-80e1-bb9d5bcf447e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:55.103854 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301ab67-a7c0-480d-80e1-bb9d5bcf447e None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:55.104135 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301ab67-a7c0-480d-80e1-bb9d5bcf447e None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:55.104407 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301ab67-a7c0-480d-80e1-bb9d5bcf447e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:55.117386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:55.140236 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3ee2e-dd7c-4305-a09a-b16440a959ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:55.140782 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3ee2e-dd7c-4305-a09a-b16440a959ba None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:55.141061 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3ee2e-dd7c-4305-a09a-b16440a959ba None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:55.141336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3ee2e-dd7c-4305-a09a-b16440a959ba None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:55.142068 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3ee2e-dd7c-4305-a09a-b16440a959ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:55.142381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3ee2e-dd7c-4305-a09a-b16440a959ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:55.143809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3ee2e-dd7c-4305-a09a-b16440a959ba None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:55.155255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 185/360] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:55.156162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3ee2e-dd7c-4305-a09a-b16440a959ba None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:55.198187 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301ab67-a7c0-480d-80e1-bb9d5bcf447e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:55.199839 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301ab67-a7c0-480d-80e1-bb9d5bcf447e None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:55.257233 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:55.284294 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3ee2e-dd7c-4305-a09a-b16440a959ba None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:55.341500 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5459508-b0e2-4f9c-88d2-4aa76cef5a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:55.341500 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5459508-b0e2-4f9c-88d2-4aa76cef5a5d None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:55.341500 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5459508-b0e2-4f9c-88d2-4aa76cef5a5d None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:55.341500 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5459508-b0e2-4f9c-88d2-4aa76cef5a5d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:55.342282 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 176/361] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:33:55.344001 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301ab67-a7c0-480d-80e1-bb9d5bcf447e None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:55.351491 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5459508-b0e2-4f9c-88d2-4aa76cef5a5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:55.357262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-d5459508-b0e2-4f9c-88d2-4aa76cef5a5d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:33:55.357262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:55.357262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:55.357262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:55.357262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:55.357262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:55.357262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:55.357262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:55.357262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:55.357262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:55.357262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:55.357262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:55.357262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:55.357262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:55.357262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:55.357262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:55.358695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:55.358695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:55.358695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:55.358695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:55.358695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:55.358695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:55.358695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:55.358695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:55.358695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:55.358695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:55.358695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:55.358695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:55.358695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:55.358695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:55.358695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:55.358695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:55.361815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:55.361815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:55.361815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:55.361815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:55.361815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:55.361815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:55.361815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:55.361815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:55.361815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:55.361815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:55.361815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:33:55.361815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:33:55.361815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 186/362] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:33:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:55.361815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b5237-1cec-4e7d-a335-b852b3bd05d9 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:55.362738 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b5237-1cec-4e7d-a335-b852b3bd05d9 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:55.363775 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b5237-1cec-4e7d-a335-b852b3bd05d9 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:55.367073 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 187/363] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:55.369966 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b5237-1cec-4e7d-a335-b852b3bd05d9 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:55.444020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:55.483154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301ab67-a7c0-480d-80e1-bb9d5bcf447e None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:55.494125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b5237-1cec-4e7d-a335-b852b3bd05d9 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:55.531032 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c01654-a129-426d-8aca-a0c08474ccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:55.532232 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c01654-a129-426d-8aca-a0c08474ccbd None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:55.532517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c01654-a129-426d-8aca-a0c08474ccbd None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:55.532803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c01654-a129-426d-8aca-a0c08474ccbd None admin] PATH_INFO: `/v3/users/2d0da3908ae94d21a7cec14452d65683` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:55.534669 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c01654-a129-426d-8aca-a0c08474ccbd None admin] RBAC: Authorizing `identity:get_user(user_id=2d0da3908ae94d21a7cec14452d65683)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:55.536521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c01654-a129-426d-8aca-a0c08474ccbd None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:55.538545 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 177/364] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:33:55 2022] GET /identity/v3/users/2d0da3908ae94d21a7cec14452d65683 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:55.539028 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c02cf3-992c-407e-8ee1-f5800dd57c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:55.539165 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c01654-a129-426d-8aca-a0c08474ccbd None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:55.539899 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c02cf3-992c-407e-8ee1-f5800dd57c5e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:55.540269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c02cf3-992c-407e-8ee1-f5800dd57c5e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:55.540639 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c02cf3-992c-407e-8ee1-f5800dd57c5e None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:55.541872 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c02cf3-992c-407e-8ee1-f5800dd57c5e None admin] RBAC: Authorizing `identity:get_project(project_id=c0309156ef604b44ad1f70081379b00e)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:55.543401 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c02cf3-992c-407e-8ee1-f5800dd57c5e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:55.545278 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 188/365] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:55 2022] GET /identity/v3/projects/c0309156ef604b44ad1f70081379b00e => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:55.546682 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f630e-af43-4c7e-af7b-aa7556d8042f None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:55.547061 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f630e-af43-4c7e-af7b-aa7556d8042f None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:55.547428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f630e-af43-4c7e-af7b-aa7556d8042f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:55.557661 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:55.570851 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-6c8f630e-af43-4c7e-af7b-aa7556d8042f None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:55.572324 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-6c8f630e-af43-4c7e-af7b-aa7556d8042f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:55.659900 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 189/366] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:55.660824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f630e-af43-4c7e-af7b-aa7556d8042f None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:55.671853 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c01654-a129-426d-8aca-a0c08474ccbd None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:55.690787 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:55.745380 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c1bea-5426-4d50-8ebc-96405f7f1c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:55.746349 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c1bea-5426-4d50-8ebc-96405f7f1c05 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:55.746829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c1bea-5426-4d50-8ebc-96405f7f1c05 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:55.747316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c1bea-5426-4d50-8ebc-96405f7f1c05 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:55.748354 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c1bea-5426-4d50-8ebc-96405f7f1c05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:55.749502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c1bea-5426-4d50-8ebc-96405f7f1c05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:55.751372 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c1bea-5426-4d50-8ebc-96405f7f1c05 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:55.765986 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 178/367] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:33:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:55.766834 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c1bea-5426-4d50-8ebc-96405f7f1c05 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:55.901921 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f630e-af43-4c7e-af7b-aa7556d8042f None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:55.964822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3214c45-e9e6-4ee0-8e6e-fe9e403cc2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:55.967064 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c1bea-5426-4d50-8ebc-96405f7f1c05 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:55.968859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3214c45-e9e6-4ee0-8e6e-fe9e403cc2bd None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:55.969138 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3214c45-e9e6-4ee0-8e6e-fe9e403cc2bd None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:55.969404 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3214c45-e9e6-4ee0-8e6e-fe9e403cc2bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:55.970170 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3214c45-e9e6-4ee0-8e6e-fe9e403cc2bd None admin] RBAC: Adding query filter params (role.id=44508e6bd9ba4b1b826ac09f102b2782, user.id=2d0da3908ae94d21a7cec14452d65683, scope.system=all) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:55.970475 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3214c45-e9e6-4ee0-8e6e-fe9e403cc2bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:55.972003 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3214c45-e9e6-4ee0-8e6e-fe9e403cc2bd None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:55.974109 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:55.997694 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 190/368] 10.222.0.15 () {56 vars in 1308 bytes} [Wed Sep 14 19:33:55 2022] GET /identity/v3/role_assignments?user.id=2d0da3908ae94d21a7cec14452d65683&scope.system=all&role.id=44508e6bd9ba4b1b826ac09f102b2782 => generated 510 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:55.998464 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3214c45-e9e6-4ee0-8e6e-fe9e403cc2bd None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:56.047628 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc46b36-067c-498d-b16d-f02fd529e0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:56.047628 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc46b36-067c-498d-b16d-f02fd529e0bf None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:56.047628 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc46b36-067c-498d-b16d-f02fd529e0bf None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:56.047628 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc46b36-067c-498d-b16d-f02fd529e0bf None admin] PATH_INFO: `/v3/groups/588e9ea9bd9e452ca96da287150dcaf2` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:56.049857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc46b36-067c-498d-b16d-f02fd529e0bf None admin] RBAC: Authorizing `identity:get_group(group_id=588e9ea9bd9e452ca96da287150dcaf2)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:56.051592 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc46b36-067c-498d-b16d-f02fd529e0bf None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:56.054028 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 179/369] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Sep 14 19:33:55 2022] GET /identity/v3/groups/588e9ea9bd9e452ca96da287150dcaf2 => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:56.055156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc46b36-067c-498d-b16d-f02fd529e0bf None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:56.137014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3214c45-e9e6-4ee0-8e6e-fe9e403cc2bd None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:56.140098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:56.176523 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c82138-4bd1-4817-aa36-ab9626c0208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:56.177145 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c82138-4bd1-4817-aa36-ab9626c0208f None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:56.177419 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c82138-4bd1-4817-aa36-ab9626c0208f None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:56.177686 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c82138-4bd1-4817-aa36-ab9626c0208f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:56.248024 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:56.256994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c82138-4bd1-4817-aa36-ab9626c0208f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:56.264659 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c82138-4bd1-4817-aa36-ab9626c0208f None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:56.264834 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc46b36-067c-498d-b16d-f02fd529e0bf None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:56.307622 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bdf10-2be1-4c1c-b94c-5ab0a8bcab70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:56.308302 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bdf10-2be1-4c1c-b94c-5ab0a8bcab70 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:56.308577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bdf10-2be1-4c1c-b94c-5ab0a8bcab70 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:56.308847 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bdf10-2be1-4c1c-b94c-5ab0a8bcab70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:56.323613 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bdf10-2be1-4c1c-b94c-5ab0a8bcab70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:56.328803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-969bdf10-2be1-4c1c-b94c-5ab0a8bcab70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:33:56.328803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:56.328803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:56.328803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:56.328803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:56.328803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:56.328803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:56.328803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:56.328803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:56.328803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:56.328803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:56.328803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:56.328803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:56.328803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:56.328803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:56.328803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:56.329764 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:56.329764 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:56.329764 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:56.329764 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:56.329764 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:56.329764 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:56.329764 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:56.329764 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:56.329764 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:56.329764 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:56.329764 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:56.329764 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:56.329764 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:56.329764 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:56.329764 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:56.329764 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:56.330576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:56.330576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:56.330576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:56.330576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:56.330576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:56.330576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:56.330576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:56.330576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:56.330576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:56.330576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:56.330576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:33:56.330576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:33:56.330576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 180/370] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:33:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:56.331231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bdf10-2be1-4c1c-b94c-5ab0a8bcab70 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:56.385856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 191/371] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:33:56.386713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c82138-4bd1-4817-aa36-ab9626c0208f None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:56.465662 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:56.478063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bdf10-2be1-4c1c-b94c-5ab0a8bcab70 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:56.506371 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:56.516405 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c82138-4bd1-4817-aa36-ab9626c0208f None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:56.528177 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27643de9-e757-47d1-b71d-51c2483ebcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:56.528884 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27643de9-e757-47d1-b71d-51c2483ebcdf None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:56.529157 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27643de9-e757-47d1-b71d-51c2483ebcdf None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:56.529421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27643de9-e757-47d1-b71d-51c2483ebcdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:56.530248 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27643de9-e757-47d1-b71d-51c2483ebcdf None admin] RBAC: Adding query filter params (group.id=588e9ea9bd9e452ca96da287150dcaf2, role.id=f63dc07e563f4ffb9f88aa95c528da47, scope.project.id=c0309156ef604b44ad1f70081379b00e) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:56.530770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27643de9-e757-47d1-b71d-51c2483ebcdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:56.535446 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27643de9-e757-47d1-b71d-51c2483ebcdf None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:56.541312 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 181/372] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Sep 14 19:33:56 2022] GET /identity/v3/role_assignments?group.id=588e9ea9bd9e452ca96da287150dcaf2&scope.project.id=c0309156ef604b44ad1f70081379b00e&role.id=f63dc07e563f4ffb9f88aa95c528da47 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:56.542291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27643de9-e757-47d1-b71d-51c2483ebcdf None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:56.565050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a04d65-a9e7-4198-a915-fdf69ba9b74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:56.566132 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a04d65-a9e7-4198-a915-fdf69ba9b74d None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:56.566667 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a04d65-a9e7-4198-a915-fdf69ba9b74d None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:56.567163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a04d65-a9e7-4198-a915-fdf69ba9b74d None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:56.568124 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a04d65-a9e7-4198-a915-fdf69ba9b74d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:56.568638 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a04d65-a9e7-4198-a915-fdf69ba9b74d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:56.570250 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a04d65-a9e7-4198-a915-fdf69ba9b74d None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:56.581693 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 192/373] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:56.587724 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a04d65-a9e7-4198-a915-fdf69ba9b74d None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:56.688477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27643de9-e757-47d1-b71d-51c2483ebcdf None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:56.721362 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a04d65-a9e7-4198-a915-fdf69ba9b74d None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:56.745190 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20517b-7e99-4030-98a5-9fdcc14ba83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:56.745853 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20517b-7e99-4030-98a5-9fdcc14ba83c None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:56.746125 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20517b-7e99-4030-98a5-9fdcc14ba83c None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:56.746394 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20517b-7e99-4030-98a5-9fdcc14ba83c None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:56.750866 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20517b-7e99-4030-98a5-9fdcc14ba83c None admin] RBAC: Authorizing `identity:get_project(project_id=c0309156ef604b44ad1f70081379b00e)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:56.752369 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20517b-7e99-4030-98a5-9fdcc14ba83c None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:56.754102 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 182/374] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:56 2022] GET /identity/v3/projects/c0309156ef604b44ad1f70081379b00e => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:56.760523 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20517b-7e99-4030-98a5-9fdcc14ba83c None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:56.806590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7128cc6-1a20-4fbc-b7b6-551a3dee8bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:56.807224 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7128cc6-1a20-4fbc-b7b6-551a3dee8bc8 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:56.807499 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7128cc6-1a20-4fbc-b7b6-551a3dee8bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:56.807792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7128cc6-1a20-4fbc-b7b6-551a3dee8bc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:56.824942 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:56.849544 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:56.919307 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7128cc6-1a20-4fbc-b7b6-551a3dee8bc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:56.920887 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7128cc6-1a20-4fbc-b7b6-551a3dee8bc8 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:56.945911 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20517b-7e99-4030-98a5-9fdcc14ba83c None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:57.018817 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8604d-3843-43f1-a301-0f5e1de1b96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:57.019375 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8604d-3843-43f1-a301-0f5e1de1b96e None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:57.019676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8604d-3843-43f1-a301-0f5e1de1b96e None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:57.019946 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8604d-3843-43f1-a301-0f5e1de1b96e None admin] PATH_INFO: `/v3/groups/588e9ea9bd9e452ca96da287150dcaf2` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:57.022349 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8604d-3843-43f1-a301-0f5e1de1b96e None admin] RBAC: Authorizing `identity:get_group(group_id=588e9ea9bd9e452ca96da287150dcaf2)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:57.026668 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8604d-3843-43f1-a301-0f5e1de1b96e None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:57.029537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 183/375] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Sep 14 19:33:56 2022] GET /identity/v3/groups/588e9ea9bd9e452ca96da287150dcaf2 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:57.036203 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8604d-3843-43f1-a301-0f5e1de1b96e None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:57.142500 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 193/376] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:33:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 19:33:57.146246 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7128cc6-1a20-4fbc-b7b6-551a3dee8bc8 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:57.239499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:57.250205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8604d-3843-43f1-a301-0f5e1de1b96e None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:57.266319 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:57.329868 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7fcef-908c-417a-82a1-e94cab18d2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:57.330364 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7fcef-908c-417a-82a1-e94cab18d2d3 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:57.330638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7fcef-908c-417a-82a1-e94cab18d2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:57.331654 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7fcef-908c-417a-82a1-e94cab18d2d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:57.332406 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7fcef-908c-417a-82a1-e94cab18d2d3 None admin] RBAC: Adding query filter params (group.id=588e9ea9bd9e452ca96da287150dcaf2, role.id=fd65be88941941298be36b142df9b505, scope.project.id=c0309156ef604b44ad1f70081379b00e) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:57.332711 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7fcef-908c-417a-82a1-e94cab18d2d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:57.334197 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7fcef-908c-417a-82a1-e94cab18d2d3 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:57.352541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 184/377] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Sep 14 19:33:57 2022] GET /identity/v3/role_assignments?group.id=588e9ea9bd9e452ca96da287150dcaf2&scope.project.id=c0309156ef604b44ad1f70081379b00e&role.id=fd65be88941941298be36b142df9b505 => generated 260 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:57.359213 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7128cc6-1a20-4fbc-b7b6-551a3dee8bc8 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:57.412644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace2415-4a9e-45fc-a542-ebc11d7f2441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:57.413313 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace2415-4a9e-45fc-a542-ebc11d7f2441 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:57.413590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace2415-4a9e-45fc-a542-ebc11d7f2441 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:57.413865 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace2415-4a9e-45fc-a542-ebc11d7f2441 None admin] PATH_INFO: `/v3/projects/de7968443f1e4b4a80b77215071336a1` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:57.415053 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace2415-4a9e-45fc-a542-ebc11d7f2441 None admin] RBAC: Authorizing `identity:get_project(project_id=de7968443f1e4b4a80b77215071336a1)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:57.416532 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace2415-4a9e-45fc-a542-ebc11d7f2441 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:57.418188 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 194/378] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:57 2022] GET /identity/v3/projects/de7968443f1e4b4a80b77215071336a1 => generated 344 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:57.424500 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7fcef-908c-417a-82a1-e94cab18d2d3 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:57.523328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72608bd-c843-44a6-920f-43b4aedd9803 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:57.523686 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72608bd-c843-44a6-920f-43b4aedd9803 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:57.524003 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72608bd-c843-44a6-920f-43b4aedd9803 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:57.525452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 195/379] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:57.531299 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decfdca-d073-4b5c-bbf7-62b62d205dbc None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:57.531939 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decfdca-d073-4b5c-bbf7-62b62d205dbc None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:57.532475 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decfdca-d073-4b5c-bbf7-62b62d205dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:57.554284 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-1decfdca-d073-4b5c-bbf7-62b62d205dbc None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:57.555906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-1decfdca-d073-4b5c-bbf7-62b62d205dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:57.575300 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7fcef-908c-417a-82a1-e94cab18d2d3 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:57.619615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef3ec0-8757-4009-af55-8054f3e39cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:57.620724 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef3ec0-8757-4009-af55-8054f3e39cf1 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:57.621205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef3ec0-8757-4009-af55-8054f3e39cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:57.621690 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef3ec0-8757-4009-af55-8054f3e39cf1 None admin] PATH_INFO: `/v3/groups/3188c4b79f024f83accf8bf82b693552` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:57.628657 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef3ec0-8757-4009-af55-8054f3e39cf1 None admin] RBAC: Authorizing `identity:get_group(group_id=3188c4b79f024f83accf8bf82b693552)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:57.630523 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef3ec0-8757-4009-af55-8054f3e39cf1 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:57.632856 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 185/380] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Sep 14 19:33:57 2022] GET /identity/v3/groups/3188c4b79f024f83accf8bf82b693552 => generated 229 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:57.634482 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef3d61-d37e-4f04-bd8d-e9b1a8300f9f None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:57.635012 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef3d61-d37e-4f04-bd8d-e9b1a8300f9f None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:57.635490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef3d61-d37e-4f04-bd8d-e9b1a8300f9f None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:57.642040 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 186/381] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:57.644333 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef3d61-d37e-4f04-bd8d-e9b1a8300f9f None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:57.650614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 196/382] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:33:57.651310 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cd4c4-7bcc-4da2-be14-5d5da6d46094 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:57.651644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cd4c4-7bcc-4da2-be14-5d5da6d46094 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:57.651925 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cd4c4-7bcc-4da2-be14-5d5da6d46094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:57.673971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-bf8cd4c4-7bcc-4da2-be14-5d5da6d46094 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:57.675208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-bf8cd4c4-7bcc-4da2-be14-5d5da6d46094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:57.700489 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:57.734716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:57.758990 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 197/383] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:33:57.838816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef3d61-d37e-4f04-bd8d-e9b1a8300f9f None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:57.881437 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1fc51-eb63-4f98-9995-ad32df1f8558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:57.881973 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1fc51-eb63-4f98-9995-ad32df1f8558 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:57.882253 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1fc51-eb63-4f98-9995-ad32df1f8558 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:57.882526 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1fc51-eb63-4f98-9995-ad32df1f8558 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:57.883263 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1fc51-eb63-4f98-9995-ad32df1f8558 None admin] RBAC: Adding query filter params (group.id=3188c4b79f024f83accf8bf82b693552, role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a, scope.project.id=de7968443f1e4b4a80b77215071336a1) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:57.883593 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1fc51-eb63-4f98-9995-ad32df1f8558 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:57.885055 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1fc51-eb63-4f98-9995-ad32df1f8558 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:57.892549 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 187/384] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Sep 14 19:33:57 2022] GET /identity/v3/role_assignments?group.id=3188c4b79f024f83accf8bf82b693552&scope.project.id=de7968443f1e4b4a80b77215071336a1&role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 260 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:58.079743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cd4c4-7bcc-4da2-be14-5d5da6d46094 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:58.192561 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cd4c4-7bcc-4da2-be14-5d5da6d46094 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:58.231797 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5188f1-27d5-4626-b1b4-7b537229223f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:58.232501 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5188f1-27d5-4626-b1b4-7b537229223f None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:58.232786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5188f1-27d5-4626-b1b4-7b537229223f None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:58.233059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5188f1-27d5-4626-b1b4-7b537229223f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:58.244757 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5188f1-27d5-4626-b1b4-7b537229223f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:58.249932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-bb5188f1-27d5-4626-b1b4-7b537229223f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:33:58.249932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:58.249932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:58.249932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:58.249932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:58.249932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:58.249932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:58.249932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:58.249932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:58.249932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:58.249932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:58.249932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:58.249932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:58.249932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:58.249932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:58.249932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:58.250768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:58.250768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:58.250768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:58.250768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:58.250768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:58.250768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:58.250768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:58.250768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:58.250768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:58.250768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:58.250768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:58.250768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:58.250768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:58.250768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:58.250768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:58.250768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:58.251586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:58.251586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:58.251586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:58.251586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:58.251586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:58.251586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:58.251586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:58.251586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:58.251586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:58.251586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:58.251586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:33:58.251586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:33:58.251586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 198/385] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:33:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:33:58.257192 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1fc51-eb63-4f98-9995-ad32df1f8558 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:58.266525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5188f1-27d5-4626-b1b4-7b537229223f None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:58.325992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:58.381903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:58.397427 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1fc51-eb63-4f98-9995-ad32df1f8558 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:58.439832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a9c46-f9f0-4f8f-93f4-6a84fb56121b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:58.440683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a9c46-f9f0-4f8f-93f4-6a84fb56121b None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:58.441124 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a9c46-f9f0-4f8f-93f4-6a84fb56121b None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:58.441527 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a9c46-f9f0-4f8f-93f4-6a84fb56121b None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:58.442435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a9c46-f9f0-4f8f-93f4-6a84fb56121b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:58.442929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a9c46-f9f0-4f8f-93f4-6a84fb56121b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:58.444638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a9c46-f9f0-4f8f-93f4-6a84fb56121b None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:58.454438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 188/386] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:33:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:58.460861 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a9c46-f9f0-4f8f-93f4-6a84fb56121b None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:58.497580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5188f1-27d5-4626-b1b4-7b537229223f None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:58.579332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a9c46-f9f0-4f8f-93f4-6a84fb56121b None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:58.616407 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffc5d6-e3b5-4e2d-9d5c-83e925b2e19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:58.617315 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffc5d6-e3b5-4e2d-9d5c-83e925b2e19c None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:58.617814 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffc5d6-e3b5-4e2d-9d5c-83e925b2e19c None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:58.618223 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffc5d6-e3b5-4e2d-9d5c-83e925b2e19c None admin] PATH_INFO: `/v3/groups/588e9ea9bd9e452ca96da287150dcaf2` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:58.619458 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffc5d6-e3b5-4e2d-9d5c-83e925b2e19c None admin] RBAC: Authorizing `identity:get_group(group_id=588e9ea9bd9e452ca96da287150dcaf2)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:58.621031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffc5d6-e3b5-4e2d-9d5c-83e925b2e19c None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:58.623037 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 189/387] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Sep 14 19:33:58 2022] GET /identity/v3/groups/588e9ea9bd9e452ca96da287150dcaf2 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:58.625442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541661a7-c6ed-4f93-9de1-eeb9a3847d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:58.626105 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541661a7-c6ed-4f93-9de1-eeb9a3847d6e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:58.626386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541661a7-c6ed-4f93-9de1-eeb9a3847d6e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:58.626659 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541661a7-c6ed-4f93-9de1-eeb9a3847d6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:58.629850 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffc5d6-e3b5-4e2d-9d5c-83e925b2e19c None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:58.656987 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541661a7-c6ed-4f93-9de1-eeb9a3847d6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:33:58.662465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-541661a7-c6ed-4f93-9de1-eeb9a3847d6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:58.662465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:33:58.662465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:33:58.662465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:33:58.662465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:33:58.662465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:33:58.662465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:33:58.662465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:33:58.662465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:33:58.662465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:33:58.662465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:33:58.662465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:33:58.662465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:33:58.662465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:33:58.662465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:33:58.662465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:33:58.663342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:33:58.663342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:33:58.663342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:33:58.663342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:33:58.663342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:33:58.663342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:33:58.663342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:33:58.663342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:33:58.663342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:33:58.663342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:33:58.663342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:33:58.663342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:33:58.663342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:33:58.663342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:33:58.663342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:33:58.663342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:33:58.664143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:33:58.664143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:33:58.664143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:33:58.664143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:33:58.664143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:33:58.664143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:33:58.664143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:33:58.664143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:33:58.664143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:33:58.664143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:33:58.664143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:33:58.664143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:33:58.668233 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 199/388] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:33:58.668366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:58.674033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541661a7-c6ed-4f93-9de1-eeb9a3847d6e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:58.745661 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffc5d6-e3b5-4e2d-9d5c-83e925b2e19c None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:58.814336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8813002-66fb-407e-b863-b1ed3196d786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:58.814994 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8813002-66fb-407e-b863-b1ed3196d786 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:58.815276 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8813002-66fb-407e-b863-b1ed3196d786 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:58.815572 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8813002-66fb-407e-b863-b1ed3196d786 None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:58.818324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8813002-66fb-407e-b863-b1ed3196d786 None admin] RBAC: Authorizing `identity:get_project(project_id=40b14549caef48dfb5996de78e97302f)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:58.818839 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8813002-66fb-407e-b863-b1ed3196d786 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:58.821612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 190/389] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:58 2022] GET /identity/v3/projects/40b14549caef48dfb5996de78e97302f => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:58.831711 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8813002-66fb-407e-b863-b1ed3196d786 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:58.835245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541661a7-c6ed-4f93-9de1-eeb9a3847d6e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:58.837881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:58.903986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39513e96-1f70-4e8a-839b-87217129a27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:58.904616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39513e96-1f70-4e8a-839b-87217129a27b None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:58.904893 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39513e96-1f70-4e8a-839b-87217129a27b None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:58.905160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39513e96-1f70-4e8a-839b-87217129a27b None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:58.905873 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39513e96-1f70-4e8a-839b-87217129a27b None admin] RBAC: Adding query filter params (name=member) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:33:58.906179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39513e96-1f70-4e8a-839b-87217129a27b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:58.907563 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39513e96-1f70-4e8a-839b-87217129a27b None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:58.925591 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 200/390] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:33:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:58.932199 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39513e96-1f70-4e8a-839b-87217129a27b None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:58.981763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:59.006668 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8813002-66fb-407e-b863-b1ed3196d786 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:59.045159 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33288d69-f9a6-402d-b0e4-ec14d0fa843a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:59.045812 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33288d69-f9a6-402d-b0e4-ec14d0fa843a None admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:59.046605 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33288d69-f9a6-402d-b0e4-ec14d0fa843a None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:59.046879 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33288d69-f9a6-402d-b0e4-ec14d0fa843a None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f/groups/588e9ea9bd9e452ca96da287150dcaf2/roles/fd65be88941941298be36b142df9b505` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:59.049201 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33288d69-f9a6-402d-b0e4-ec14d0fa843a None admin] RBAC: Authorizing `identity:create_grant(project_id=40b14549caef48dfb5996de78e97302f, group_id=588e9ea9bd9e452ca96da287150dcaf2, role_id=fd65be88941941298be36b142df9b505)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:59.050801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33288d69-f9a6-402d-b0e4-ec14d0fa843a None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:59.079219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39513e96-1f70-4e8a-839b-87217129a27b None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:59.119621 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 191/391] 10.222.0.15 () {58 vars in 1442 bytes} [Wed Sep 14 19:33:58 2022] PUT /identity/v3/projects/40b14549caef48dfb5996de78e97302f/groups/588e9ea9bd9e452ca96da287150dcaf2/roles/fd65be88941941298be36b142df9b505 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:33:59.127038 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d011ead-379e-4f17-9270-f2480ed079f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:59.127726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d011ead-379e-4f17-9270-f2480ed079f0 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:59.128095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d011ead-379e-4f17-9270-f2480ed079f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:59.128368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d011ead-379e-4f17-9270-f2480ed079f0 None admin] PATH_INFO: `/v3/groups/588e9ea9bd9e452ca96da287150dcaf2` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:59.129630 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d011ead-379e-4f17-9270-f2480ed079f0 None admin] RBAC: Authorizing `identity:get_group(group_id=588e9ea9bd9e452ca96da287150dcaf2)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:59.131131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d011ead-379e-4f17-9270-f2480ed079f0 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:59.133104 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 201/392] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Sep 14 19:33:58 2022] GET /identity/v3/groups/588e9ea9bd9e452ca96da287150dcaf2 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:33:59.139006 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33288d69-f9a6-402d-b0e4-ec14d0fa843a None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:59.294734 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33288d69-f9a6-402d-b0e4-ec14d0fa843a None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:59.338327 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fdbdf-ad65-42fc-b5ff-658a4049e783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:59.339000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fdbdf-ad65-42fc-b5ff-658a4049e783 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:59.339277 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fdbdf-ad65-42fc-b5ff-658a4049e783 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:59.339567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fdbdf-ad65-42fc-b5ff-658a4049e783 None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:59.340809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fdbdf-ad65-42fc-b5ff-658a4049e783 None admin] RBAC: Authorizing `identity:get_project(project_id=40b14549caef48dfb5996de78e97302f)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:59.342281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fdbdf-ad65-42fc-b5ff-658a4049e783 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:59.344439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 192/393] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:33:59 2022] GET /identity/v3/projects/40b14549caef48dfb5996de78e97302f => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:33:59.350314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d011ead-379e-4f17-9270-f2480ed079f0 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:33:59.411616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:59.428822 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86feb0-7a94-4104-9323-2e16d51fe2aa None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:59.429117 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86feb0-7a94-4104-9323-2e16d51fe2aa None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:59.429375 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86feb0-7a94-4104-9323-2e16d51fe2aa None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:59.430841 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 193/394] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:33:59.436057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcf19e-8f1c-4065-a29b-75739a736ddc None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:59.436340 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcf19e-8f1c-4065-a29b-75739a736ddc None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:59.436614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcf19e-8f1c-4065-a29b-75739a736ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:59.463983 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-71bcf19e-8f1c-4065-a29b-75739a736ddc None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:33:59.466980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-71bcf19e-8f1c-4065-a29b-75739a736ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:33:59.482408 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:33:59.514337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d011ead-379e-4f17-9270-f2480ed079f0 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:33:59.556636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa545710-5e85-474e-97c0-52e0ca23ba69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:33:59.557794 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa545710-5e85-474e-97c0-52e0ca23ba69 None admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:33:59.558250 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa545710-5e85-474e-97c0-52e0ca23ba69 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:33:59.558711 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa545710-5e85-474e-97c0-52e0ca23ba69 None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f/groups/588e9ea9bd9e452ca96da287150dcaf2/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:33:59.560386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 194/395] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:33:59.564330 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa545710-5e85-474e-97c0-52e0ca23ba69 None admin] RBAC: Authorizing `identity:create_grant(project_id=40b14549caef48dfb5996de78e97302f, group_id=588e9ea9bd9e452ca96da287150dcaf2, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:33:59.567565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa545710-5e85-474e-97c0-52e0ca23ba69 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:33:59.663686 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 202/396] 10.222.0.15 () {58 vars in 1442 bytes} [Wed Sep 14 19:33:59 2022] PUT /identity/v3/projects/40b14549caef48dfb5996de78e97302f/groups/588e9ea9bd9e452ca96da287150dcaf2/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:33:59.875307 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcf19e-8f1c-4065-a29b-75739a736ddc None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:00.011484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcf19e-8f1c-4065-a29b-75739a736ddc None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:00.066885 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628f234-2b3c-4a59-970a-253b330a7377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:00.067565 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628f234-2b3c-4a59-970a-253b330a7377 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:00.067849 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628f234-2b3c-4a59-970a-253b330a7377 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:00.068130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628f234-2b3c-4a59-970a-253b330a7377 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:00.082274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628f234-2b3c-4a59-970a-253b330a7377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:00.087321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-6628f234-2b3c-4a59-970a-253b330a7377 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:34:00.087321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:00.087321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:00.087321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:00.087321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:00.087321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:00.087321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:00.087321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:00.087321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:00.087321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:00.087321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:00.087321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:00.087321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:00.087321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:00.087321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:00.087321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:00.088285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:00.088285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:00.088285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:00.088285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:00.088285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:00.088285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:00.088285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:00.088285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:00.088285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:00.088285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:00.088285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:00.088285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:00.088285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:00.088285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:00.088285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:00.088285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:00.089810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:00.089810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:00.089810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:00.089810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:00.089810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:00.089810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:00.089810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:00.089810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:00.089810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:00.089810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:00.089810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:34:00.089810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:00.089810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 195/397] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:33:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:00.095098 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa545710-5e85-474e-97c0-52e0ca23ba69 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:00.246726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:00.258163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa545710-5e85-474e-97c0-52e0ca23ba69 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:00.307670 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0ab7a-6212-47b8-94cd-92d1844c38a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:00.308673 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0ab7a-6212-47b8-94cd-92d1844c38a4 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:00.309353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0ab7a-6212-47b8-94cd-92d1844c38a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:00.309823 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0ab7a-6212-47b8-94cd-92d1844c38a4 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:00.310697 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0ab7a-6212-47b8-94cd-92d1844c38a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:00.311212 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0ab7a-6212-47b8-94cd-92d1844c38a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:00.313703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0ab7a-6212-47b8-94cd-92d1844c38a4 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:00.330346 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 203/398] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:34:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:00.335791 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628f234-2b3c-4a59-970a-253b330a7377 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:00.348989 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:00.408934 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a60a37-5666-443f-b57d-2b6bd8a98298 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:00.409443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a60a37-5666-443f-b57d-2b6bd8a98298 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:00.409702 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a60a37-5666-443f-b57d-2b6bd8a98298 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:00.415805 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 204/399] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:00.418183 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322136ef-1a1b-4b43-bdbc-463823589831 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:00.418521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322136ef-1a1b-4b43-bdbc-463823589831 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:00.418981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322136ef-1a1b-4b43-bdbc-463823589831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:00.464453 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-322136ef-1a1b-4b43-bdbc-463823589831 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:00.468675 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-322136ef-1a1b-4b43-bdbc-463823589831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:00.597067 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628f234-2b3c-4a59-970a-253b330a7377 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:00.664606 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf5316-261d-4929-ab11-38a905762f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:00.665576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf5316-261d-4929-ab11-38a905762f5f None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:00.666212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf5316-261d-4929-ab11-38a905762f5f None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:00.666668 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf5316-261d-4929-ab11-38a905762f5f None admin] PATH_INFO: `/v3/groups/588e9ea9bd9e452ca96da287150dcaf2` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:00.668030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf5316-261d-4929-ab11-38a905762f5f None admin] RBAC: Authorizing `identity:get_group(group_id=588e9ea9bd9e452ca96da287150dcaf2)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:00.669782 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf5316-261d-4929-ab11-38a905762f5f None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:00.671961 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 196/400] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Sep 14 19:34:00 2022] GET /identity/v3/groups/588e9ea9bd9e452ca96da287150dcaf2 => generated 226 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:00.677931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 205/401] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:00.679456 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf5316-261d-4929-ab11-38a905762f5f None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:00.783482 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:00.821162 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf5316-261d-4929-ab11-38a905762f5f None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:00.873378 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae25aa-972f-4c80-a4e6-54b47f5a27b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:00.874851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae25aa-972f-4c80-a4e6-54b47f5a27b2 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:00.875527 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae25aa-972f-4c80-a4e6-54b47f5a27b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:00.876143 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae25aa-972f-4c80-a4e6-54b47f5a27b2 None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:00.877519 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae25aa-972f-4c80-a4e6-54b47f5a27b2 None admin] RBAC: Authorizing `identity:get_project(project_id=c0309156ef604b44ad1f70081379b00e)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:00.879182 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae25aa-972f-4c80-a4e6-54b47f5a27b2 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:00.881135 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 197/402] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:34:00 2022] GET /identity/v3/projects/c0309156ef604b44ad1f70081379b00e => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:00.891342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322136ef-1a1b-4b43-bdbc-463823589831 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:01.049115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:01.075953 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322136ef-1a1b-4b43-bdbc-463823589831 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:01.131340 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982ae27-fab5-418a-9040-533170bd49c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:01.132436 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982ae27-fab5-418a-9040-533170bd49c5 None admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:01.132936 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982ae27-fab5-418a-9040-533170bd49c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:01.133432 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982ae27-fab5-418a-9040-533170bd49c5 None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e/groups/588e9ea9bd9e452ca96da287150dcaf2/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:01.135844 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982ae27-fab5-418a-9040-533170bd49c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0309156ef604b44ad1f70081379b00e, group_id=588e9ea9bd9e452ca96da287150dcaf2, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:01.137645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982ae27-fab5-418a-9040-533170bd49c5 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:01.153416 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae25aa-972f-4c80-a4e6-54b47f5a27b2 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:01.246292 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 206/403] 10.222.0.15 () {58 vars in 1442 bytes} [Wed Sep 14 19:34:00 2022] PUT /identity/v3/projects/c0309156ef604b44ad1f70081379b00e/groups/588e9ea9bd9e452ca96da287150dcaf2/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:34:01.283790 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae25aa-972f-4c80-a4e6-54b47f5a27b2 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:01.325135 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b65445-a724-4d2f-aeaa-35b63c62bb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:01.326180 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b65445-a724-4d2f-aeaa-35b63c62bb5b None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:01.326706 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b65445-a724-4d2f-aeaa-35b63c62bb5b None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:01.327176 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b65445-a724-4d2f-aeaa-35b63c62bb5b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:01.339382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b65445-a724-4d2f-aeaa-35b63c62bb5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:01.345890 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:01.347275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-07b65445-a724-4d2f-aeaa-35b63c62bb5b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:34:01.347275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:01.347275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:01.347275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:01.347275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:01.347275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:01.347275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:01.347275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:01.347275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:01.347275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:01.347275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:01.347275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:01.347275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:01.347275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:01.347275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:01.347275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:01.348280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:01.348280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:01.348280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:01.348280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:01.348280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:01.348280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:01.348280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:01.348280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:01.348280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:01.348280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:01.348280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:01.348280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:01.348280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:01.348280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:01.348280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:01.348280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:01.349057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:01.349057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:01.349057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:01.349057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:01.349057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:01.349057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:01.349057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:01.349057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:01.349057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:01.349057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:01.349057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:34:01.349057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:01.355699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 198/404] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:34:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:01.358340 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982ae27-fab5-418a-9040-533170bd49c5 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:01.413138 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7935d-f348-439e-a4d5-fa6b9662dabb None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:01.413556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7935d-f348-439e-a4d5-fa6b9662dabb None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:01.414058 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7935d-f348-439e-a4d5-fa6b9662dabb None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:01.417478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 199/405] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:34:01.426368 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c4b88-db07-4397-813a-fe7c465e3be7 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:01.426863 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c4b88-db07-4397-813a-fe7c465e3be7 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:01.427358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c4b88-db07-4397-813a-fe7c465e3be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:01.459618 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-521c4b88-db07-4397-813a-fe7c465e3be7 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:01.461684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-521c4b88-db07-4397-813a-fe7c465e3be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:01.578729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982ae27-fab5-418a-9040-533170bd49c5 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:01.601762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 200/406] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:01.634026 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca9aed-fe32-4551-8bb9-404abf342d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:01.635030 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca9aed-fe32-4551-8bb9-404abf342d07 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:01.635516 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca9aed-fe32-4551-8bb9-404abf342d07 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:01.636008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca9aed-fe32-4551-8bb9-404abf342d07 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:01.637056 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca9aed-fe32-4551-8bb9-404abf342d07 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:01.637653 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca9aed-fe32-4551-8bb9-404abf342d07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:01.639361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca9aed-fe32-4551-8bb9-404abf342d07 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:01.653799 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 207/407] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:01.660347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c4b88-db07-4397-813a-fe7c465e3be7 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:01.770394 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c4b88-db07-4397-813a-fe7c465e3be7 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:01.801552 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:01.808032 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0d7b8-5b21-4c5b-8447-705fbe842550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:01.808915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0d7b8-5b21-4c5b-8447-705fbe842550 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:01.809335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0d7b8-5b21-4c5b-8447-705fbe842550 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:01.809804 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0d7b8-5b21-4c5b-8447-705fbe842550 None admin] PATH_INFO: `/v3/groups/588e9ea9bd9e452ca96da287150dcaf2` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:01.811103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0d7b8-5b21-4c5b-8447-705fbe842550 None admin] RBAC: Authorizing `identity:get_group(group_id=588e9ea9bd9e452ca96da287150dcaf2)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:01.813011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0d7b8-5b21-4c5b-8447-705fbe842550 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:01.819347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 201/408] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Sep 14 19:34:01 2022] GET /identity/v3/groups/588e9ea9bd9e452ca96da287150dcaf2 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:01.820903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca9aed-fe32-4551-8bb9-404abf342d07 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:01.831245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:01.944481 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0d7b8-5b21-4c5b-8447-705fbe842550 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:01.946376 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca9aed-fe32-4551-8bb9-404abf342d07 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:02.025789 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40485d0-1271-4017-96ea-1c90b4be6066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:02.026351 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40485d0-1271-4017-96ea-1c90b4be6066 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:02.026630 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40485d0-1271-4017-96ea-1c90b4be6066 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:02.026899 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40485d0-1271-4017-96ea-1c90b4be6066 None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:02.029106 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40485d0-1271-4017-96ea-1c90b4be6066 None admin] RBAC: Authorizing `identity:get_project(project_id=c0309156ef604b44ad1f70081379b00e)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:02.030531 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40485d0-1271-4017-96ea-1c90b4be6066 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:02.033569 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 208/409] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:34:01 2022] GET /identity/v3/projects/c0309156ef604b44ad1f70081379b00e => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:02.039520 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40485d0-1271-4017-96ea-1c90b4be6066 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:02.131409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0d7b8-5b21-4c5b-8447-705fbe842550 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:02.151345 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:02.197580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40485d0-1271-4017-96ea-1c90b4be6066 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:02.200927 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c9d74-a7f6-4e56-9f41-f42bc17a2d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:02.203584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c9d74-a7f6-4e56-9f41-f42bc17a2d3e None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:02.203584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c9d74-a7f6-4e56-9f41-f42bc17a2d3e None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:02.203584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c9d74-a7f6-4e56-9f41-f42bc17a2d3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:02.225060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c9d74-a7f6-4e56-9f41-f42bc17a2d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:02.230034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-032c9d74-a7f6-4e56-9f41-f42bc17a2d3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:34:02.230034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:02.230034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:02.230034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:02.230034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:02.230034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:02.230034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:02.230034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:02.230034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:02.230034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:02.230034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:02.230034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:02.230034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:02.230034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:02.230034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:02.230034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:02.230957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:02.230957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:02.230957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:02.230957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:02.230957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:02.230957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:02.230957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:02.230957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:02.230957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:02.230957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:02.230957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:02.230957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:02.230957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:02.230957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:02.230957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:02.230957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:02.231798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:02.231798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:02.231798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:02.231798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:02.231798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:02.231798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:02.231798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:02.231798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:02.231798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:02.231798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:02.231798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:34:02.231798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:02.231798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 202/410] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:34:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:02.238750 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c9d74-a7f6-4e56-9f41-f42bc17a2d3e None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:02.279623 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cbc0d-f39d-485c-b71a-ab0f713823e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:02.280217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cbc0d-f39d-485c-b71a-ab0f713823e4 None admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:02.280500 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cbc0d-f39d-485c-b71a-ab0f713823e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:02.281292 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cbc0d-f39d-485c-b71a-ab0f713823e4 None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e/groups/588e9ea9bd9e452ca96da287150dcaf2/roles/fd65be88941941298be36b142df9b505` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:02.283980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cbc0d-f39d-485c-b71a-ab0f713823e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0309156ef604b44ad1f70081379b00e, group_id=588e9ea9bd9e452ca96da287150dcaf2, role_id=fd65be88941941298be36b142df9b505)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:02.285423 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cbc0d-f39d-485c-b71a-ab0f713823e4 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:02.305327 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:02.350866 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c9d74-a7f6-4e56-9f41-f42bc17a2d3e None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:02.353711 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 209/411] 10.222.0.15 () {58 vars in 1442 bytes} [Wed Sep 14 19:34:02 2022] PUT /identity/v3/projects/c0309156ef604b44ad1f70081379b00e/groups/588e9ea9bd9e452ca96da287150dcaf2/roles/fd65be88941941298be36b142df9b505 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:34:02.361378 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e366bc3-8f64-4040-b3b8-5959b7897cb1 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:02.361980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e366bc3-8f64-4040-b3b8-5959b7897cb1 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:02.362445 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e366bc3-8f64-4040-b3b8-5959b7897cb1 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:02.364027 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 210/412] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:02.373937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959fccc-7b77-4038-bbd0-11d56ec5cd13 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:02.374446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959fccc-7b77-4038-bbd0-11d56ec5cd13 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:02.385939 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959fccc-7b77-4038-bbd0-11d56ec5cd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:02.403692 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62527580-53ab-4994-97c0-55af9465e199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:02.404851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62527580-53ab-4994-97c0-55af9465e199 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:02.405336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62527580-53ab-4994-97c0-55af9465e199 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:02.406341 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62527580-53ab-4994-97c0-55af9465e199 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:02.409441 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62527580-53ab-4994-97c0-55af9465e199 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:02.410175 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62527580-53ab-4994-97c0-55af9465e199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:02.412082 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62527580-53ab-4994-97c0-55af9465e199 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:02.425330 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-a959fccc-7b77-4038-bbd0-11d56ec5cd13 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:02.427000 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a959fccc-7b77-4038-bbd0-11d56ec5cd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:02.434033 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 203/413] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:34:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:02.457094 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62527580-53ab-4994-97c0-55af9465e199 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:02.586114 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 211/414] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:02.636979 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62527580-53ab-4994-97c0-55af9465e199 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:02.650603 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421f198-4ee2-4d26-b39b-1dacdc1d53da None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:02.650889 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421f198-4ee2-4d26-b39b-1dacdc1d53da None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:02.651159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421f198-4ee2-4d26-b39b-1dacdc1d53da None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:02.654364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 212/415] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:34:02.660586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41c010-5c27-4111-8c41-85de84635252 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:02.660864 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41c010-5c27-4111-8c41-85de84635252 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:02.661133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41c010-5c27-4111-8c41-85de84635252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:02.664013 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:02.682759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ebb47-6d47-482f-9ab7-5e985af40333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:02.683407 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ebb47-6d47-482f-9ab7-5e985af40333 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:02.683721 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ebb47-6d47-482f-9ab7-5e985af40333 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:02.684000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ebb47-6d47-482f-9ab7-5e985af40333 None admin] PATH_INFO: `/v3/groups/3188c4b79f024f83accf8bf82b693552` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:02.684591 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-bf41c010-5c27-4111-8c41-85de84635252 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:02.685125 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ebb47-6d47-482f-9ab7-5e985af40333 None admin] RBAC: Authorizing `identity:get_group(group_id=3188c4b79f024f83accf8bf82b693552)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:02.686270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-bf41c010-5c27-4111-8c41-85de84635252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:02.686576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ebb47-6d47-482f-9ab7-5e985af40333 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:02.688675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 204/416] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Sep 14 19:34:02 2022] GET /identity/v3/groups/3188c4b79f024f83accf8bf82b693552 => generated 229 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:02.694529 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ebb47-6d47-482f-9ab7-5e985af40333 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:02.813987 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ebb47-6d47-482f-9ab7-5e985af40333 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:02.829763 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:02.854634 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 213/417] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:34:02.862098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c131c6-27d7-4f67-b7ba-e939244b0e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:02.867243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41c010-5c27-4111-8c41-85de84635252 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:02.867351 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c131c6-27d7-4f67-b7ba-e939244b0e22 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:02.871612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c131c6-27d7-4f67-b7ba-e939244b0e22 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:02.871727 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c131c6-27d7-4f67-b7ba-e939244b0e22 None admin] PATH_INFO: `/v3/projects/de7968443f1e4b4a80b77215071336a1` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:02.874587 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c131c6-27d7-4f67-b7ba-e939244b0e22 None admin] RBAC: Authorizing `identity:get_project(project_id=de7968443f1e4b4a80b77215071336a1)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:02.876110 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c131c6-27d7-4f67-b7ba-e939244b0e22 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:02.877797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 205/418] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:34:02 2022] GET /identity/v3/projects/de7968443f1e4b4a80b77215071336a1 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:02.883608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c131c6-27d7-4f67-b7ba-e939244b0e22 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:03.008928 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:03.017415 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41c010-5c27-4111-8c41-85de84635252 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:03.056133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b9928-9613-4448-b402-8ec3b9ffbdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:03.057162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b9928-9613-4448-b402-8ec3b9ffbdd3 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:03.057645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b9928-9613-4448-b402-8ec3b9ffbdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:03.058109 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b9928-9613-4448-b402-8ec3b9ffbdd3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:03.070539 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b9928-9613-4448-b402-8ec3b9ffbdd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:03.076332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-e42b9928-9613-4448-b402-8ec3b9ffbdd3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:34:03.076332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:03.076332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:03.076332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:03.076332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:03.076332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:03.076332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:03.076332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:03.076332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:03.076332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:03.076332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:03.076332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:03.076332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:03.076332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:03.076332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:03.076332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:03.077257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:03.077257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:03.077257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:03.077257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:03.077257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:03.077257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:03.077257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:03.077257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:03.077257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:03.077257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:03.077257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:03.077257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:03.077257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:03.077257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:03.077257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:03.077257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:03.078118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:03.078118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:03.078118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:03.078118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:03.078118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:03.078118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:03.078118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:03.078118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:03.078118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:03.078118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:03.078118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:34:03.078118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:03.080765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 214/419] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:34:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:03.086563 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b9928-9613-4448-b402-8ec3b9ffbdd3 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:03.119016 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c131c6-27d7-4f67-b7ba-e939244b0e22 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:03.165681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:03.178962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b0f60-0786-4fa5-8581-7401817eca41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:03.179866 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b0f60-0786-4fa5-8581-7401817eca41 None admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:03.180047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b0f60-0786-4fa5-8581-7401817eca41 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:03.180305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b0f60-0786-4fa5-8581-7401817eca41 None admin] PATH_INFO: `/v3/projects/de7968443f1e4b4a80b77215071336a1/groups/3188c4b79f024f83accf8bf82b693552/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:03.182231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b0f60-0786-4fa5-8581-7401817eca41 None admin] RBAC: Authorizing `identity:create_grant(project_id=de7968443f1e4b4a80b77215071336a1, group_id=3188c4b79f024f83accf8bf82b693552, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:03.183714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b0f60-0786-4fa5-8581-7401817eca41 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:03.215275 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b9928-9613-4448-b402-8ec3b9ffbdd3 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:03.251063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928db74-29ca-4f00-aed5-f9d825684dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:03.251829 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928db74-29ca-4f00-aed5-f9d825684dfc None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:03.252104 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928db74-29ca-4f00-aed5-f9d825684dfc None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:03.252378 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928db74-29ca-4f00-aed5-f9d825684dfc None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:03.252787 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 206/420] 10.222.0.15 () {58 vars in 1442 bytes} [Wed Sep 14 19:34:02 2022] PUT /identity/v3/projects/de7968443f1e4b4a80b77215071336a1/groups/3188c4b79f024f83accf8bf82b693552/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:34:03.253026 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928db74-29ca-4f00-aed5-f9d825684dfc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:03.253328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928db74-29ca-4f00-aed5-f9d825684dfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:03.254267 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b0f60-0786-4fa5-8581-7401817eca41 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:03.254843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928db74-29ca-4f00-aed5-f9d825684dfc None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:03.265002 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 215/421] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:03.277025 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928db74-29ca-4f00-aed5-f9d825684dfc None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:03.417700 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b0f60-0786-4fa5-8581-7401817eca41 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:03.442839 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:03.462186 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2074aae-8356-4585-9338-5e036ea840d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:03.462834 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2074aae-8356-4585-9338-5e036ea840d0 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:03.463115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2074aae-8356-4585-9338-5e036ea840d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:03.463389 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2074aae-8356-4585-9338-5e036ea840d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:03.475633 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2074aae-8356-4585-9338-5e036ea840d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:03.481003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-c2074aae-8356-4585-9338-5e036ea840d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:34:03.481003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:03.481003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:03.481003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:03.481003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:03.481003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:03.481003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:03.481003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:03.481003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:03.481003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:03.481003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:03.481003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:03.481003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:03.481003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:03.481003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:03.481003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:03.482060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:03.482060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:03.482060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:03.482060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:03.482060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:03.482060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:03.482060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:03.482060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:03.482060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:03.482060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:03.482060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:03.482060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:03.482060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:03.482060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:03.482060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:03.482060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:03.483027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:03.483027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:03.483027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:03.483027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:03.483027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:03.483027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:03.483027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:03.483027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:03.483027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:03.483027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:03.483027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:34:03.483027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:03.486987 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 207/422] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:34:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:03.493069 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2074aae-8356-4585-9338-5e036ea840d0 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:03.500774 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928db74-29ca-4f00-aed5-f9d825684dfc None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:03.542555 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:03.600325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0bba6-002d-45df-b60e-ccb30f0a540b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:03.600948 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0bba6-002d-45df-b60e-ccb30f0a540b None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:03.601230 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0bba6-002d-45df-b60e-ccb30f0a540b None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:03.601508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0bba6-002d-45df-b60e-ccb30f0a540b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:03.658211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2074aae-8356-4585-9338-5e036ea840d0 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:03.712341 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72d3dc-c90e-4dd8-abed-175ad873aaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:03.712961 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72d3dc-c90e-4dd8-abed-175ad873aaff None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:03.713244 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72d3dc-c90e-4dd8-abed-175ad873aaff None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:03.713527 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72d3dc-c90e-4dd8-abed-175ad873aaff None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:03.714311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72d3dc-c90e-4dd8-abed-175ad873aaff None admin] RBAC: Adding query filter params (name=member) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:03.714627 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72d3dc-c90e-4dd8-abed-175ad873aaff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:03.716090 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72d3dc-c90e-4dd8-abed-175ad873aaff None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:03.725835 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 208/423] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:34:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:03.727106 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0bba6-002d-45df-b60e-ccb30f0a540b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:03.728605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0bba6-002d-45df-b60e-ccb30f0a540b None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:03.736845 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72d3dc-c90e-4dd8-abed-175ad873aaff None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:03.813316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:03.896377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 216/424] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:34:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:34:03.907873 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0bba6-002d-45df-b60e-ccb30f0a540b None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:03.943133 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72d3dc-c90e-4dd8-abed-175ad873aaff None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:03.944811 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:03.994676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702736d-c4fa-4f83-b6f1-9a4636743235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:03.995604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702736d-c4fa-4f83-b6f1-9a4636743235 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:03.996028 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702736d-c4fa-4f83-b6f1-9a4636743235 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:03.996592 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702736d-c4fa-4f83-b6f1-9a4636743235 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:04.124637 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702736d-c4fa-4f83-b6f1-9a4636743235 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:04.126757 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702736d-c4fa-4f83-b6f1-9a4636743235 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:04.128945 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0bba6-002d-45df-b60e-ccb30f0a540b None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:04.166773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe193eb2-50e5-43bf-ba97-4042d2d62bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:04.168277 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe193eb2-50e5-43bf-ba97-4042d2d62bd3 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:04.168699 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe193eb2-50e5-43bf-ba97-4042d2d62bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:04.169111 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe193eb2-50e5-43bf-ba97-4042d2d62bd3 None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:04.170381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe193eb2-50e5-43bf-ba97-4042d2d62bd3 None admin] RBAC: Authorizing `identity:get_project(project_id=40b14549caef48dfb5996de78e97302f)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:04.172091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe193eb2-50e5-43bf-ba97-4042d2d62bd3 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:04.174169 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 217/425] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:34:03 2022] GET /identity/v3/projects/40b14549caef48dfb5996de78e97302f => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:04.175467 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebc7b0-3f77-4f3b-8111-6c2c9a5f566b None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:04.175904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebc7b0-3f77-4f3b-8111-6c2c9a5f566b None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:04.176313 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebc7b0-3f77-4f3b-8111-6c2c9a5f566b None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:04.177152 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:04.177858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 218/426] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:04.179423 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebc7b0-3f77-4f3b-8111-6c2c9a5f566b None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:04.264326 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 209/427] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:34:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 19:34:04.266646 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53640a0-3a1e-4dde-9aba-1b46004540aa None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:04.266931 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53640a0-3a1e-4dde-9aba-1b46004540aa None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:04.267205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53640a0-3a1e-4dde-9aba-1b46004540aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:04.276771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:04.291526 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-f53640a0-3a1e-4dde-9aba-1b46004540aa None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:04.293290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f53640a0-3a1e-4dde-9aba-1b46004540aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:04.296158 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebc7b0-3f77-4f3b-8111-6c2c9a5f566b None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:04.339154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8e474-9b7d-44f1-a8dd-c14a73fc1456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:04.341441 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8e474-9b7d-44f1-a8dd-c14a73fc1456 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:04.341965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8e474-9b7d-44f1-a8dd-c14a73fc1456 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:04.342411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8e474-9b7d-44f1-a8dd-c14a73fc1456 None admin] PATH_INFO: `/v3/groups/588e9ea9bd9e452ca96da287150dcaf2` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:04.343951 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8e474-9b7d-44f1-a8dd-c14a73fc1456 None admin] RBAC: Authorizing `identity:get_group(group_id=588e9ea9bd9e452ca96da287150dcaf2)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:04.345650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8e474-9b7d-44f1-a8dd-c14a73fc1456 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:04.347811 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 219/428] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Sep 14 19:34:04 2022] GET /identity/v3/groups/588e9ea9bd9e452ca96da287150dcaf2 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:04.348884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8e474-9b7d-44f1-a8dd-c14a73fc1456 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:04.390070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 210/429] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:04.391663 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53640a0-3a1e-4dde-9aba-1b46004540aa None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:04.469337 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:04.474477 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8e474-9b7d-44f1-a8dd-c14a73fc1456 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:04.505217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53640a0-3a1e-4dde-9aba-1b46004540aa None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:04.513321 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8c5f6-cc96-49e0-b73e-87c09416ef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:04.513969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8c5f6-cc96-49e0-b73e-87c09416ef48 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:04.514246 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8c5f6-cc96-49e0-b73e-87c09416ef48 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:04.514573 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8c5f6-cc96-49e0-b73e-87c09416ef48 None admin] PATH_INFO: `/v3/projects/40b14549caef48dfb5996de78e97302f` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:04.515813 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8c5f6-cc96-49e0-b73e-87c09416ef48 None admin] RBAC: Authorizing `identity:get_project(project_id=40b14549caef48dfb5996de78e97302f)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:04.517356 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8c5f6-cc96-49e0-b73e-87c09416ef48 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:04.519441 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 220/430] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:34:04 2022] GET /identity/v3/projects/40b14549caef48dfb5996de78e97302f => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:04.524909 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8c5f6-cc96-49e0-b73e-87c09416ef48 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:04.542999 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29d1f4-2b2e-4954-950d-5ea5216c3e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:04.543868 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29d1f4-2b2e-4954-950d-5ea5216c3e06 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:04.544282 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29d1f4-2b2e-4954-950d-5ea5216c3e06 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:04.544687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29d1f4-2b2e-4954-950d-5ea5216c3e06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:04.545611 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29d1f4-2b2e-4954-950d-5ea5216c3e06 None admin] RBAC: Adding query filter params (group.id=588e9ea9bd9e452ca96da287150dcaf2, role.id=fd65be88941941298be36b142df9b505, scope.project.id=40b14549caef48dfb5996de78e97302f) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:04.546133 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29d1f4-2b2e-4954-950d-5ea5216c3e06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:04.548143 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29d1f4-2b2e-4954-950d-5ea5216c3e06 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:04.551600 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:04.554829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 211/431] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Sep 14 19:34:04 2022] GET /identity/v3/role_assignments?group.id=588e9ea9bd9e452ca96da287150dcaf2&scope.project.id=40b14549caef48dfb5996de78e97302f&role.id=fd65be88941941298be36b142df9b505 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:04.648691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8c5f6-cc96-49e0-b73e-87c09416ef48 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:04.689135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f898209-b885-4ae5-803b-83c7b07b0a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:04.689795 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f898209-b885-4ae5-803b-83c7b07b0a5a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:04.690072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f898209-b885-4ae5-803b-83c7b07b0a5a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:04.690344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f898209-b885-4ae5-803b-83c7b07b0a5a None admin] PATH_INFO: `/v3/groups/588e9ea9bd9e452ca96da287150dcaf2` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:04.691517 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f898209-b885-4ae5-803b-83c7b07b0a5a None admin] RBAC: Authorizing `identity:get_group(group_id=588e9ea9bd9e452ca96da287150dcaf2)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:04.692985 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f898209-b885-4ae5-803b-83c7b07b0a5a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:04.695035 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 221/432] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Sep 14 19:34:04 2022] GET /identity/v3/groups/588e9ea9bd9e452ca96da287150dcaf2 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:04.700601 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29d1f4-2b2e-4954-950d-5ea5216c3e06 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:04.836590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29d1f4-2b2e-4954-950d-5ea5216c3e06 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:04.870903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:04.876316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a392b07-2616-485c-88c9-d819a7d79649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:04.876947 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a392b07-2616-485c-88c9-d819a7d79649 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:04.877484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a392b07-2616-485c-88c9-d819a7d79649 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:04.877754 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a392b07-2616-485c-88c9-d819a7d79649 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:04.878505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a392b07-2616-485c-88c9-d819a7d79649 None admin] RBAC: Adding query filter params (group.id=588e9ea9bd9e452ca96da287150dcaf2, role.id=f63dc07e563f4ffb9f88aa95c528da47, scope.project.id=40b14549caef48dfb5996de78e97302f) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:04.878809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a392b07-2616-485c-88c9-d819a7d79649 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:04.880382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a392b07-2616-485c-88c9-d819a7d79649 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:04.886311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f898209-b885-4ae5-803b-83c7b07b0a5a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:04.887445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 212/433] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Sep 14 19:34:04 2022] GET /identity/v3/role_assignments?group.id=588e9ea9bd9e452ca96da287150dcaf2&scope.project.id=40b14549caef48dfb5996de78e97302f&role.id=f63dc07e563f4ffb9f88aa95c528da47 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:04.982144 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b00ef-5ba9-4a9e-a70f-3828daaa0480 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:04.982590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b00ef-5ba9-4a9e-a70f-3828daaa0480 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:04.982963 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b00ef-5ba9-4a9e-a70f-3828daaa0480 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:04.984939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 213/434] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:34:04.990767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496cf40-f803-419b-90df-5e5de8f1a648 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:04.991220 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496cf40-f803-419b-90df-5e5de8f1a648 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:04.991639 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496cf40-f803-419b-90df-5e5de8f1a648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:05.005815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:05.020352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-a496cf40-f803-419b-90df-5e5de8f1a648 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:05.021395 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f898209-b885-4ae5-803b-83c7b07b0a5a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:05.021646 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-a496cf40-f803-419b-90df-5e5de8f1a648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:05.069848 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72053e40-54b9-4de5-9fe3-d4ddf951a827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:05.070515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72053e40-54b9-4de5-9fe3-d4ddf951a827 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:05.070796 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72053e40-54b9-4de5-9fe3-d4ddf951a827 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:05.071073 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72053e40-54b9-4de5-9fe3-d4ddf951a827 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:05.089998 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72053e40-54b9-4de5-9fe3-d4ddf951a827 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:05.095115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-72053e40-54b9-4de5-9fe3-d4ddf951a827 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:34:05.095115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:05.095115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:05.095115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:05.095115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:05.095115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:05.095115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:05.095115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:05.095115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:05.095115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:05.095115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:05.095115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:05.095115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:05.095115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:05.095115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:05.095115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:05.096147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:05.096147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:05.096147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:05.096147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:05.096147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:05.096147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:05.096147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:05.096147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:05.096147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:05.096147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:05.096147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:05.096147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:05.096147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:05.096147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:05.096147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:05.096147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:05.096971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:05.096971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:05.096971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:05.096971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:05.096971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:05.096971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:05.096971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:05.096971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:05.096971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:05.096971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:05.096971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 19:34:05.096971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:05.097595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 222/435] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:34:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:05.103960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72053e40-54b9-4de5-9fe3-d4ddf951a827 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:05.119707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 214/436] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:34:05.222173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72053e40-54b9-4de5-9fe3-d4ddf951a827 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:05.259399 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32557532-38e3-42f2-8fed-daf814c6966b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:05.260065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32557532-38e3-42f2-8fed-daf814c6966b None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:05.260345 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32557532-38e3-42f2-8fed-daf814c6966b None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:05.260619 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32557532-38e3-42f2-8fed-daf814c6966b None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:05.261285 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32557532-38e3-42f2-8fed-daf814c6966b None admin] RBAC: Adding query filter params (name=member) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:05.261587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32557532-38e3-42f2-8fed-daf814c6966b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:05.263029 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32557532-38e3-42f2-8fed-daf814c6966b None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:05.273012 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 223/437] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:34:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:05.278689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496cf40-f803-419b-90df-5e5de8f1a648 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:05.402388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496cf40-f803-419b-90df-5e5de8f1a648 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:05.408243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32557532-38e3-42f2-8fed-daf814c6966b None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:05.424041 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:05.436023 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:05.445163 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c246b98-99fe-48f4-b24c-7d3d4de00385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:05.451349 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c246b98-99fe-48f4-b24c-7d3d4de00385 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:05.451349 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c246b98-99fe-48f4-b24c-7d3d4de00385 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:05.451349 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c246b98-99fe-48f4-b24c-7d3d4de00385 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:05.527934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c246b98-99fe-48f4-b24c-7d3d4de00385 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:05.529408 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c246b98-99fe-48f4-b24c-7d3d4de00385 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:05.551811 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32557532-38e3-42f2-8fed-daf814c6966b None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:05.602785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debdf7c-fac4-4e0f-afe7-63e1ce8cdd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:05.603435 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debdf7c-fac4-4e0f-afe7-63e1ce8cdd9e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:05.603751 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debdf7c-fac4-4e0f-afe7-63e1ce8cdd9e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:05.604025 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debdf7c-fac4-4e0f-afe7-63e1ce8cdd9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:05.618351 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debdf7c-fac4-4e0f-afe7-63e1ce8cdd9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:05.627425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-6debdf7c-fac4-4e0f-afe7-63e1ce8cdd9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:34:05.627425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:05.627425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:05.627425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:05.627425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:05.627425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:05.627425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:05.627425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:05.627425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:05.627425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:05.627425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:05.627425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:05.627425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:05.627425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:05.627425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:05.627425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:05.628368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:05.628368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:05.628368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:05.628368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:05.628368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:05.628368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:05.628368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:05.628368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:05.628368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:05.628368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:05.628368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:05.628368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:05.628368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:05.628368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:05.628368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:05.628368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:05.629162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:05.629162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:05.629162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:05.629162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:05.629162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:05.629162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:05.629162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:05.629162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:05.629162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:05.629162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:05.629162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:34:05.629162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:05.629162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 224/438] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:34:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:05.632671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debdf7c-fac4-4e0f-afe7-63e1ce8cdd9e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:05.666638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 215/439] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:34:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 19:34:05.673214 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c246b98-99fe-48f4-b24c-7d3d4de00385 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:05.704001 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:05.716233 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:05.747288 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debdf7c-fac4-4e0f-afe7-63e1ce8cdd9e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:05.778547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c246b98-99fe-48f4-b24c-7d3d4de00385 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:05.781165 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71ecca-64a0-4a2d-84b3-44743ac8208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:05.781774 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71ecca-64a0-4a2d-84b3-44743ac8208e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:05.782054 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71ecca-64a0-4a2d-84b3-44743ac8208e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:05.782331 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71ecca-64a0-4a2d-84b3-44743ac8208e None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:05.783002 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71ecca-64a0-4a2d-84b3-44743ac8208e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:05.783310 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71ecca-64a0-4a2d-84b3-44743ac8208e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:05.784722 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71ecca-64a0-4a2d-84b3-44743ac8208e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:05.792670 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 225/440] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:05.793646 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f592950-8e1f-45df-819d-850733227331 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:05.793928 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f592950-8e1f-45df-819d-850733227331 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:05.794203 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f592950-8e1f-45df-819d-850733227331 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:05.795394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 226/441] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:05.798688 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f592950-8e1f-45df-819d-850733227331 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:05.817666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3d701-9dd4-4efd-a867-d42620b10150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:05.818284 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3d701-9dd4-4efd-a867-d42620b10150 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:05.818557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3d701-9dd4-4efd-a867-d42620b10150 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:05.818826 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3d701-9dd4-4efd-a867-d42620b10150 None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:05.820042 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3d701-9dd4-4efd-a867-d42620b10150 None admin] RBAC: Authorizing `identity:get_project(project_id=c0309156ef604b44ad1f70081379b00e)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:05.821590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3d701-9dd4-4efd-a867-d42620b10150 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:05.823220 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 216/442] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:34:05 2022] GET /identity/v3/projects/c0309156ef604b44ad1f70081379b00e => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:05.825405 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132a71b-c155-46d0-bbc2-3ba26905ff88 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:05.825678 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132a71b-c155-46d0-bbc2-3ba26905ff88 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:05.825958 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132a71b-c155-46d0-bbc2-3ba26905ff88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:05.843216 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-0132a71b-c155-46d0-bbc2-3ba26905ff88 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:05.844454 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0132a71b-c155-46d0-bbc2-3ba26905ff88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:05.900537 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f592950-8e1f-45df-819d-850733227331 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:05.910344 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 217/443] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:05.911175 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132a71b-c155-46d0-bbc2-3ba26905ff88 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:05.935308 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:05.940856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:05.945441 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724063b8-0eaf-4746-b11e-3ddcb594a8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:05.947201 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724063b8-0eaf-4746-b11e-3ddcb594a8b1 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:05.947201 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724063b8-0eaf-4746-b11e-3ddcb594a8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:05.947201 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724063b8-0eaf-4746-b11e-3ddcb594a8b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:06.013129 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132a71b-c155-46d0-bbc2-3ba26905ff88 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:06.018532 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724063b8-0eaf-4746-b11e-3ddcb594a8b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:06.020031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724063b8-0eaf-4746-b11e-3ddcb594a8b1 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:06.048938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5171d-0d73-4fa1-97f2-001efafe6c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:06.049570 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5171d-0d73-4fa1-97f2-001efafe6c80 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:06.049893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5171d-0d73-4fa1-97f2-001efafe6c80 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:06.050168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5171d-0d73-4fa1-97f2-001efafe6c80 None admin] PATH_INFO: `/v3/groups/588e9ea9bd9e452ca96da287150dcaf2` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:06.051381 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5171d-0d73-4fa1-97f2-001efafe6c80 None admin] RBAC: Authorizing `identity:get_group(group_id=588e9ea9bd9e452ca96da287150dcaf2)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:06.052843 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5171d-0d73-4fa1-97f2-001efafe6c80 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:06.054423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 218/444] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Sep 14 19:34:05 2022] GET /identity/v3/groups/588e9ea9bd9e452ca96da287150dcaf2 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:06.060041 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5171d-0d73-4fa1-97f2-001efafe6c80 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:06.131364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 227/445] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:34:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 19:34:06.132378 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724063b8-0eaf-4746-b11e-3ddcb594a8b1 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:06.154675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:06.163427 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5171d-0d73-4fa1-97f2-001efafe6c80 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:06.163585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:06.197714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d920bb1-80f8-4fec-87e9-2b9b5bbfb6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:06.198315 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d920bb1-80f8-4fec-87e9-2b9b5bbfb6aa None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:06.198593 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d920bb1-80f8-4fec-87e9-2b9b5bbfb6aa None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:06.198870 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d920bb1-80f8-4fec-87e9-2b9b5bbfb6aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:06.199606 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d920bb1-80f8-4fec-87e9-2b9b5bbfb6aa None admin] RBAC: Adding query filter params (group.id=588e9ea9bd9e452ca96da287150dcaf2, role.id=f63dc07e563f4ffb9f88aa95c528da47, scope.project.id=c0309156ef604b44ad1f70081379b00e) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:06.199913 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d920bb1-80f8-4fec-87e9-2b9b5bbfb6aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:06.201347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d920bb1-80f8-4fec-87e9-2b9b5bbfb6aa None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:06.207704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 219/446] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Sep 14 19:34:06 2022] GET /identity/v3/role_assignments?group.id=588e9ea9bd9e452ca96da287150dcaf2&scope.project.id=c0309156ef604b44ad1f70081379b00e&role.id=f63dc07e563f4ffb9f88aa95c528da47 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:06.208563 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d920bb1-80f8-4fec-87e9-2b9b5bbfb6aa None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:06.245646 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724063b8-0eaf-4746-b11e-3ddcb594a8b1 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:06.285848 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58d614-d1a6-4074-8866-79a158b01fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:06.286870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58d614-d1a6-4074-8866-79a158b01fd3 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:06.287383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58d614-d1a6-4074-8866-79a158b01fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:06.287905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58d614-d1a6-4074-8866-79a158b01fd3 None admin] PATH_INFO: `/v3/projects/c0309156ef604b44ad1f70081379b00e` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:06.289311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58d614-d1a6-4074-8866-79a158b01fd3 None admin] RBAC: Authorizing `identity:get_project(project_id=c0309156ef604b44ad1f70081379b00e)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:06.290949 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58d614-d1a6-4074-8866-79a158b01fd3 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:06.298543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 228/447] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:34:06 2022] GET /identity/v3/projects/c0309156ef604b44ad1f70081379b00e => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:06.300226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58d614-d1a6-4074-8866-79a158b01fd3 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:06.322465 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d920bb1-80f8-4fec-87e9-2b9b5bbfb6aa None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:06.360781 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370e71f-bdbd-44da-95fd-e72df2fc4af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:06.361427 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370e71f-bdbd-44da-95fd-e72df2fc4af6 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:06.361699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370e71f-bdbd-44da-95fd-e72df2fc4af6 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:06.361969 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370e71f-bdbd-44da-95fd-e72df2fc4af6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:06.373742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370e71f-bdbd-44da-95fd-e72df2fc4af6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:06.378521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-7370e71f-bdbd-44da-95fd-e72df2fc4af6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:34:06.378521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:06.378521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:06.378521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:06.378521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:06.378521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:06.378521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:06.378521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:06.378521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:06.378521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:06.378521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:06.378521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:06.378521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:06.378521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:06.378521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:06.378521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:06.379409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:06.379409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:06.379409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:06.379409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:06.379409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:06.379409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:06.379409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:06.379409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:06.379409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:06.379409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:06.379409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:06.379409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:06.379409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:06.379409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:06.379409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:06.379409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:06.383228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:06.383228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:06.383228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:06.383228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:06.383228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:06.383228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:06.383228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:06.383228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:06.383228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:06.383228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:06.383228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:34:06.383228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:06.383228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 220/448] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:34:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:06.386288 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370e71f-bdbd-44da-95fd-e72df2fc4af6 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:06.410926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:06.425072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:06.427886 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58d614-d1a6-4074-8866-79a158b01fd3 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:06.467924 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44827d-88c9-4ded-9044-cc699bbf6453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:06.468572 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44827d-88c9-4ded-9044-cc699bbf6453 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:06.468904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44827d-88c9-4ded-9044-cc699bbf6453 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:06.469178 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44827d-88c9-4ded-9044-cc699bbf6453 None admin] PATH_INFO: `/v3/groups/588e9ea9bd9e452ca96da287150dcaf2` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:06.470333 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44827d-88c9-4ded-9044-cc699bbf6453 None admin] RBAC: Authorizing `identity:get_group(group_id=588e9ea9bd9e452ca96da287150dcaf2)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:06.471786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44827d-88c9-4ded-9044-cc699bbf6453 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:06.473521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 229/449] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Sep 14 19:34:06 2022] GET /identity/v3/groups/588e9ea9bd9e452ca96da287150dcaf2 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:06.479288 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44827d-88c9-4ded-9044-cc699bbf6453 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:06.505206 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370e71f-bdbd-44da-95fd-e72df2fc4af6 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:06.544562 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cf8fc-b10a-4633-8592-f79f918aec7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:06.545181 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cf8fc-b10a-4633-8592-f79f918aec7d None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:06.545705 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cf8fc-b10a-4633-8592-f79f918aec7d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:06.545705 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cf8fc-b10a-4633-8592-f79f918aec7d None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:06.546360 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cf8fc-b10a-4633-8592-f79f918aec7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:06.546671 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cf8fc-b10a-4633-8592-f79f918aec7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:06.548743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cf8fc-b10a-4633-8592-f79f918aec7d None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:06.557689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 221/450] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:34:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:06.564361 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cf8fc-b10a-4633-8592-f79f918aec7d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:06.610738 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44827d-88c9-4ded-9044-cc699bbf6453 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:06.643424 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10d72a-1ee5-47de-8d2c-03f863185b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:06.644050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10d72a-1ee5-47de-8d2c-03f863185b52 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:06.644331 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10d72a-1ee5-47de-8d2c-03f863185b52 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:06.644465 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:06.644602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10d72a-1ee5-47de-8d2c-03f863185b52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:06.645314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10d72a-1ee5-47de-8d2c-03f863185b52 None admin] RBAC: Adding query filter params (group.id=588e9ea9bd9e452ca96da287150dcaf2, role.id=fd65be88941941298be36b142df9b505, scope.project.id=c0309156ef604b44ad1f70081379b00e) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:06.645620 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10d72a-1ee5-47de-8d2c-03f863185b52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:06.647034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10d72a-1ee5-47de-8d2c-03f863185b52 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:06.652859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 230/451] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Sep 14 19:34:06 2022] GET /identity/v3/role_assignments?group.id=588e9ea9bd9e452ca96da287150dcaf2&scope.project.id=c0309156ef604b44ad1f70081379b00e&role.id=fd65be88941941298be36b142df9b505 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:06.666742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cf8fc-b10a-4633-8592-f79f918aec7d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:06.704055 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e19cdf-d106-4e3c-b086-6fa4142557d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:06.704676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e19cdf-d106-4e3c-b086-6fa4142557d4 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:06.704947 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e19cdf-d106-4e3c-b086-6fa4142557d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:06.705215 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e19cdf-d106-4e3c-b086-6fa4142557d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:06.778002 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e19cdf-d106-4e3c-b086-6fa4142557d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:06.779533 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e19cdf-d106-4e3c-b086-6fa4142557d4 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:06.860163 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:06.884485 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 222/452] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:34:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 19:34:06.890410 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10d72a-1ee5-47de-8d2c-03f863185b52 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:06.924236 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:06.992984 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10d72a-1ee5-47de-8d2c-03f863185b52 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:07.026990 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0927f54-c355-4039-a7fc-a4ed4abf1d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:07.027662 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0927f54-c355-4039-a7fc-a4ed4abf1d6f None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:07.027948 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0927f54-c355-4039-a7fc-a4ed4abf1d6f None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:07.028224 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0927f54-c355-4039-a7fc-a4ed4abf1d6f None admin] PATH_INFO: `/v3/projects/de7968443f1e4b4a80b77215071336a1` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:07.029356 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0927f54-c355-4039-a7fc-a4ed4abf1d6f None admin] RBAC: Authorizing `identity:get_project(project_id=de7968443f1e4b4a80b77215071336a1)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:07.030783 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0927f54-c355-4039-a7fc-a4ed4abf1d6f None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:07.032756 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 231/453] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:34:06 2022] GET /identity/v3/projects/de7968443f1e4b4a80b77215071336a1 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:07.038231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e19cdf-d106-4e3c-b086-6fa4142557d4 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:07.135722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e19cdf-d106-4e3c-b086-6fa4142557d4 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:07.168538 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af281e-7eb5-4ac4-af07-608c3b36b2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:07.169157 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af281e-7eb5-4ac4-af07-608c3b36b2bc None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:07.169438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af281e-7eb5-4ac4-af07-608c3b36b2bc None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:07.169711 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af281e-7eb5-4ac4-af07-608c3b36b2bc None admin] PATH_INFO: `/v3/groups/3188c4b79f024f83accf8bf82b693552` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:07.170815 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af281e-7eb5-4ac4-af07-608c3b36b2bc None admin] RBAC: Authorizing `identity:get_group(group_id=3188c4b79f024f83accf8bf82b693552)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:07.172828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af281e-7eb5-4ac4-af07-608c3b36b2bc None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:07.174411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 223/454] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Sep 14 19:34:07 2022] GET /identity/v3/groups/3188c4b79f024f83accf8bf82b693552 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:07.180322 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0927f54-c355-4039-a7fc-a4ed4abf1d6f None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:07.274840 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:07.277622 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0927f54-c355-4039-a7fc-a4ed4abf1d6f None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:07.310856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db3c68-0e8b-4faa-8e3c-14071fc8d6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:07.311459 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db3c68-0e8b-4faa-8e3c-14071fc8d6aa None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:07.311797 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db3c68-0e8b-4faa-8e3c-14071fc8d6aa None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:07.312074 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db3c68-0e8b-4faa-8e3c-14071fc8d6aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:07.313508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db3c68-0e8b-4faa-8e3c-14071fc8d6aa None admin] RBAC: Adding query filter params (group.id=3188c4b79f024f83accf8bf82b693552, role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a, scope.project.id=de7968443f1e4b4a80b77215071336a1) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:07.314066 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db3c68-0e8b-4faa-8e3c-14071fc8d6aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:07.315818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db3c68-0e8b-4faa-8e3c-14071fc8d6aa None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:07.321486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 232/455] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Sep 14 19:34:07 2022] GET /identity/v3/role_assignments?group.id=3188c4b79f024f83accf8bf82b693552&scope.project.id=de7968443f1e4b4a80b77215071336a1&role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:09.976979 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da1f8e-9b6c-47f6-809d-fb84be8d1d10 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:09.977495 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da1f8e-9b6c-47f6-809d-fb84be8d1d10 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:09.977495 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da1f8e-9b6c-47f6-809d-fb84be8d1d10 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:09.979104 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 224/456] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:09.985105 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be0c8-582b-4050-8bb7-97a0a2ba2d94 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:09.985974 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be0c8-582b-4050-8bb7-97a0a2ba2d94 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:09.985974 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be0c8-582b-4050-8bb7-97a0a2ba2d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:10.008598 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-a15be0c8-582b-4050-8bb7-97a0a2ba2d94 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:10.009818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a15be0c8-582b-4050-8bb7-97a0a2ba2d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:10.097178 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 233/457] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:10.283388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5388b-b118-4360-9d50-92b5e49b8922 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:10.283897 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5388b-b118-4360-9d50-92b5e49b8922 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:10.284310 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5388b-b118-4360-9d50-92b5e49b8922 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:10.286021 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 225/458] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:10.291633 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4286de-1a7c-40a7-b98f-e038c35ef9d1 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:10.292074 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4286de-1a7c-40a7-b98f-e038c35ef9d1 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:10.292491 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4286de-1a7c-40a7-b98f-e038c35ef9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:10.324698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-4b4286de-1a7c-40a7-b98f-e038c35ef9d1 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:10.326182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4b4286de-1a7c-40a7-b98f-e038c35ef9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:10.406678 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5388b-b118-4360-9d50-92b5e49b8922 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:10.452028 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 234/459] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:34:10.465198 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:10.521708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5388b-b118-4360-9d50-92b5e49b8922 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:10.549392 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c2393-0f43-43f9-82c9-0abddc889fe3 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:10.549974 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c2393-0f43-43f9-82c9-0abddc889fe3 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:10.550440 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c2393-0f43-43f9-82c9-0abddc889fe3 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:10.552249 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 235/460] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:34:10.557645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a210653-dbbc-4ae6-b34d-08d4d41875c5 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:10.558057 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a210653-dbbc-4ae6-b34d-08d4d41875c5 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:10.558570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a210653-dbbc-4ae6-b34d-08d4d41875c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:10.566613 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a903b-db63-487e-880d-fa9ce7b962da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:10.567208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a903b-db63-487e-880d-fa9ce7b962da None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:10.567486 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a903b-db63-487e-880d-fa9ce7b962da None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:10.567797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a903b-db63-487e-880d-fa9ce7b962da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:10.587026 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a903b-db63-487e-880d-fa9ce7b962da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:10.588545 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a903b-db63-487e-880d-fa9ce7b962da None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:10.597692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-5a210653-dbbc-4ae6-b34d-08d4d41875c5 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:10.598921 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-5a210653-dbbc-4ae6-b34d-08d4d41875c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:10.619464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-d77a903b-db63-487e-880d-fa9ce7b962da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:10.619464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:10.619464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:10.619464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:10.619464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:10.619464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:10.619464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:10.619464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:10.619464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:10.619464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:10.619464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:10.619464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:10.619464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:10.619464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:10.619464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:10.619464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:10.620438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:10.620438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:10.620438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:10.620438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:10.620438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:10.620438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:10.620438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:10.620438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:10.620438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:10.620438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:10.620438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:10.620438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:10.620438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:10.620438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:10.620438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:10.620438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:10.620438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:10.621347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:10.621347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:10.621347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:10.621347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 226/461] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:10.631457 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a903b-db63-487e-880d-fa9ce7b962da None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:10.645486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:10.732174 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 236/462] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:10.734375 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4f69c-bb79-44b3-80c7-12ea04dcf5c3 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:10.734843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4f69c-bb79-44b3-80c7-12ea04dcf5c3 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:10.735381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4f69c-bb79-44b3-80c7-12ea04dcf5c3 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:10.737215 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 237/463] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:10.742289 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efdb6d-988e-4c6c-b0fa-32dc6b2015f8 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:10.742576 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efdb6d-988e-4c6c-b0fa-32dc6b2015f8 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:10.742851 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efdb6d-988e-4c6c-b0fa-32dc6b2015f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:10.764238 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-13efdb6d-988e-4c6c-b0fa-32dc6b2015f8 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:10.765658 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-13efdb6d-988e-4c6c-b0fa-32dc6b2015f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:10.788971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:10.792945 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a903b-db63-487e-880d-fa9ce7b962da None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:10.831171 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867db1b-181e-4623-bda7-e58cde619ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:10.832075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867db1b-181e-4623-bda7-e58cde619ac5 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:10.832529 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867db1b-181e-4623-bda7-e58cde619ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:10.832996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867db1b-181e-4623-bda7-e58cde619ac5 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:10.833809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867db1b-181e-4623-bda7-e58cde619ac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:10.834412 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867db1b-181e-4623-bda7-e58cde619ac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:10.836043 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867db1b-181e-4623-bda7-e58cde619ac5 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:10.839732 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 238/464] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:34:10.841253 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efdb6d-988e-4c6c-b0fa-32dc6b2015f8 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:10.849660 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 227/465] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:10.855173 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867db1b-181e-4623-bda7-e58cde619ac5 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:10.963607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867db1b-181e-4623-bda7-e58cde619ac5 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:11.005760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395c42b-cf51-47f1-926e-ad5a3fcb620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:11.007121 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395c42b-cf51-47f1-926e-ad5a3fcb620e None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:11.007729 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395c42b-cf51-47f1-926e-ad5a3fcb620e None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:11.008200 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395c42b-cf51-47f1-926e-ad5a3fcb620e None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:11.009036 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395c42b-cf51-47f1-926e-ad5a3fcb620e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:11.010640 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395c42b-cf51-47f1-926e-ad5a3fcb620e None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:11.015905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:11.040038 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efdb6d-988e-4c6c-b0fa-32dc6b2015f8 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:11.077818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b0051-260d-4936-a67b-9e3887e9d6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:11.078461 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b0051-260d-4936-a67b-9e3887e9d6ee None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:11.078793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b0051-260d-4936-a67b-9e3887e9d6ee None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:11.079297 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b0051-260d-4936-a67b-9e3887e9d6ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:11.089761 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b0051-260d-4936-a67b-9e3887e9d6ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:11.091208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b0051-260d-4936-a67b-9e3887e9d6ee None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:11.107678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-ab7b0051-260d-4936-a67b-9e3887e9d6ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:11.107678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:11.107678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:11.107678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:11.107678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:11.107678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:11.107678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:11.107678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:11.107678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:11.107678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:11.107678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:11.107678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:11.107678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:11.107678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:11.107678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:11.107678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:11.108613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:11.108613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:11.108613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:11.108613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:11.108613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:11.108613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:11.108613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:11.108613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:11.108613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:11.108613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:11.108613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:11.108613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:11.108613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:11.108613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:11.108613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:11.108613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:11.108613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:11.112594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:11.112594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:11.112594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:11.112594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 239/466] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:11.112594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b0051-260d-4936-a67b-9e3887e9d6ee None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:11.124060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 228/467] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Sep 14 19:34:10 2022] POST /identity/v3/users => generated 246 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:34:11.125151 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395c42b-cf51-47f1-926e-ad5a3fcb620e None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:11.156001 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:11.277733 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395c42b-cf51-47f1-926e-ad5a3fcb620e None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:11.298563 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b0051-260d-4936-a67b-9e3887e9d6ee None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:11.322188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516a84c-b7e9-4e2f-a2ae-723c4d4d3cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:11.322188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516a84c-b7e9-4e2f-a2ae-723c4d4d3cea None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:11.322188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516a84c-b7e9-4e2f-a2ae-723c4d4d3cea None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:11.322188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516a84c-b7e9-4e2f-a2ae-723c4d4d3cea None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:11.322592 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516a84c-b7e9-4e2f-a2ae-723c4d4d3cea None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:11.322592 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516a84c-b7e9-4e2f-a2ae-723c4d4d3cea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:11.323842 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516a84c-b7e9-4e2f-a2ae-723c4d4d3cea None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:11.336985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 229/468] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:11.337970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516a84c-b7e9-4e2f-a2ae-723c4d4d3cea None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:11.347283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d03970-b567-4412-bf35-154e7e5fa447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:11.348350 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d03970-b567-4412-bf35-154e7e5fa447 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:11.348350 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d03970-b567-4412-bf35-154e7e5fa447 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:11.348514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d03970-b567-4412-bf35-154e7e5fa447 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:11.352901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:11.365869 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d03970-b567-4412-bf35-154e7e5fa447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:11.367623 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d03970-b567-4412-bf35-154e7e5fa447 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:11.387317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-c8d03970-b567-4412-bf35-154e7e5fa447 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:11.387317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:11.387317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:11.387317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:11.387317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:11.387317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:11.387317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:11.387317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:11.387317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:11.387317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:11.387317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:11.387317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:11.387317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:11.387317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:11.387317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:11.387317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:11.388473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:11.388473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:11.388473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:11.388473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:11.388473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:11.388473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:11.388473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:11.388473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:11.388473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:11.388473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:11.388473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:11.388473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:11.388473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:11.388473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:11.388473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:11.388473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:11.388473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:11.389534 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:11.389534 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:11.389534 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:11.390909 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 240/469] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:11.392164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d03970-b567-4412-bf35-154e7e5fa447 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:11.447320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:11.475937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516a84c-b7e9-4e2f-a2ae-723c4d4d3cea None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:11.524736 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281de55-aca5-493c-92b4-f686bcedb9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:11.525644 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281de55-aca5-493c-92b4-f686bcedb9fa None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:11.525930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281de55-aca5-493c-92b4-f686bcedb9fa None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:11.526216 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281de55-aca5-493c-92b4-f686bcedb9fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:11.527689 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d03970-b567-4412-bf35-154e7e5fa447 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:11.542078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281de55-aca5-493c-92b4-f686bcedb9fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:11.543883 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281de55-aca5-493c-92b4-f686bcedb9fa None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:11.564274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-c281de55-aca5-493c-92b4-f686bcedb9fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:11.564274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:11.564274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:11.564274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:11.564274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:11.564274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:11.564274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:11.564274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:11.564274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:11.564274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:11.564274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:11.564274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:11.564274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:11.564274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:11.564274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:11.564274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:11.565423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:11.565423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:11.565423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:11.565423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:11.565423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:11.565423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:11.565423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:11.565423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:11.565423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:11.565423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:11.565423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:11.565423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:11.565423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:11.565423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:11.565423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:11.565423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:11.565423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:11.566394 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:11.566394 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:11.566394 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:11.566394 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 230/470] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:11.566601 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281de55-aca5-493c-92b4-f686bcedb9fa None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:11.575793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0d859-e6e0-4d13-a9ab-773f5d62a26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:11.576614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0d859-e6e0-4d13-a9ab-773f5d62a26a None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:11.577031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0d859-e6e0-4d13-a9ab-773f5d62a26a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:11.577442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0d859-e6e0-4d13-a9ab-773f5d62a26a None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:11.578231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0d859-e6e0-4d13-a9ab-773f5d62a26a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:11.580415 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0d859-e6e0-4d13-a9ab-773f5d62a26a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:11.656115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 241/471] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Sep 14 19:34:11 2022] POST /identity/v3/users => generated 248 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:34:11.657381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0d859-e6e0-4d13-a9ab-773f5d62a26a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:11.692143 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281de55-aca5-493c-92b4-f686bcedb9fa None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:11.739317 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:11.750969 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5de30-ea87-4743-b98d-d0efb0aef8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:11.752093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:11.753435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5de30-ea87-4743-b98d-d0efb0aef8ab None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:11.753931 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5de30-ea87-4743-b98d-d0efb0aef8ab None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:11.754437 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5de30-ea87-4743-b98d-d0efb0aef8ab None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:11.755362 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5de30-ea87-4743-b98d-d0efb0aef8ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:11.755969 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5de30-ea87-4743-b98d-d0efb0aef8ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:11.757767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5de30-ea87-4743-b98d-d0efb0aef8ab None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:11.777207 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 231/472] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:11.778817 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dda61-7deb-445c-b10b-42d256992455 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:11.779306 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dda61-7deb-445c-b10b-42d256992455 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:11.780730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dda61-7deb-445c-b10b-42d256992455 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:11.787436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 232/473] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:11.788755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dda61-7deb-445c-b10b-42d256992455 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:11.885350 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0d859-e6e0-4d13-a9ab-773f5d62a26a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:11.921574 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dda61-7deb-445c-b10b-42d256992455 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:11.944583 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bcd07-d554-4c15-8664-ad6e53557a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:11.946006 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bcd07-d554-4c15-8664-ad6e53557a79 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:11.946804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bcd07-d554-4c15-8664-ad6e53557a79 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:11.947324 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bcd07-d554-4c15-8664-ad6e53557a79 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:11.948237 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bcd07-d554-4c15-8664-ad6e53557a79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:11.948794 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bcd07-d554-4c15-8664-ad6e53557a79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:11.950388 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bcd07-d554-4c15-8664-ad6e53557a79 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:11.966478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e70f2-1efe-4bbc-aa78-4a6e9806cefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:11.966674 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e70f2-1efe-4bbc-aa78-4a6e9806cefe None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:11.966906 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e70f2-1efe-4bbc-aa78-4a6e9806cefe None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:11.967083 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e70f2-1efe-4bbc-aa78-4a6e9806cefe None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:11.968093 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e70f2-1efe-4bbc-aa78-4a6e9806cefe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:11.970681 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e70f2-1efe-4bbc-aa78-4a6e9806cefe None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:11.975782 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 242/474] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:11.977386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff36165-6721-4056-a258-e9d48abdd3bd None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:11.977903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff36165-6721-4056-a258-e9d48abdd3bd None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:11.978376 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff36165-6721-4056-a258-e9d48abdd3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:12.010116 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-7ff36165-6721-4056-a258-e9d48abdd3bd None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:12.011375 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-7ff36165-6721-4056-a258-e9d48abdd3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:12.088858 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 233/475] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Sep 14 19:34:11 2022] POST /identity/v3/users => generated 248 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:34:12.089677 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e70f2-1efe-4bbc-aa78-4a6e9806cefe None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:12.108074 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 243/476] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:12.185062 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:12.282625 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e70f2-1efe-4bbc-aa78-4a6e9806cefe None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:12.324799 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45984d-55a1-4e47-a0ba-7768c7e8d8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:12.325426 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45984d-55a1-4e47-a0ba-7768c7e8d8c1 None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:12.325703 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45984d-55a1-4e47-a0ba-7768c7e8d8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:12.325974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45984d-55a1-4e47-a0ba-7768c7e8d8c1 None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:12.326641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45984d-55a1-4e47-a0ba-7768c7e8d8c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:12.328375 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45984d-55a1-4e47-a0ba-7768c7e8d8c1 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:12.396466 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff36165-6721-4056-a258-e9d48abdd3bd None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:12.419687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 234/477] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Sep 14 19:34:12 2022] POST /identity/v3/users => generated 249 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:34:12.437578 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:12.513783 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff36165-6721-4056-a258-e9d48abdd3bd None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:12.552829 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b89d57-9c04-4e09-b452-009f5142653f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:12.553837 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b89d57-9c04-4e09-b452-009f5142653f None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:12.554331 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b89d57-9c04-4e09-b452-009f5142653f None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:12.554794 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b89d57-9c04-4e09-b452-009f5142653f None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:12.555700 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b89d57-9c04-4e09-b452-009f5142653f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:12.557395 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b89d57-9c04-4e09-b452-009f5142653f None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:12.606609 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.sql.core [None req-62b89d57-9c04-4e09-b452-009f5142653f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 14 19:34:12.606609 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 14 19:34:12.606609 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [parameters: {'id': 'f1ec0edf6cab4031b59157d01ab1ef88', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 14 19:34:12.606609 dv-cinder-839768-8-smb devstack@keystone.service[93545]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93545) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 19:34:12.624458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-62b89d57-9c04-4e09-b452-009f5142653f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 14 19:34:12.624458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:12.624458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 19:34:12.624458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 19:34:12.624458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 19:34:12.624458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 19:34:12.624458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 19:34:12.624458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 19:34:12.624458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 19:34:12.624458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application conn.query(q) Sep 14 19:34:12.624458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 19:34:12.624458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 19:34:12.624458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 19:34:12.624458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application result.read() Sep 14 19:34:12.624458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 19:34:12.625361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 19:34:12.625361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 19:34:12.625361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 19:34:12.625361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 19:34:12.625361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 19:34:12.625361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 19:34:12.625361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 19:34:12.625361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 14 19:34:12.625361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:12.625361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 14 19:34:12.625361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:12.625361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:12.625361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 14 19:34:12.625361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 14 19:34:12.625361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 14 19:34:12.625361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return ref.to_dict() Sep 14 19:34:12.625361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 19:34:12.625361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application next(self.gen) Sep 14 19:34:12.626386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 14 19:34:12.626386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application yield resource Sep 14 19:34:12.626386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 19:34:12.626386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application next(self.gen) Sep 14 19:34:12.626386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 14 19:34:12.626386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self.session.rollback() Sep 14 19:34:12.626386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 19:34:12.626386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self.force_reraise() Sep 14 19:34:12.626386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 19:34:12.626386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise self.value Sep 14 19:34:12.626386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 14 19:34:12.626386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 14 19:34:12.626386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 14 19:34:12.626386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application session.commit() Sep 14 19:34:12.626386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 14 19:34:12.626386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 14 19:34:12.626386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 14 19:34:12.627231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._prepare_impl() Sep 14 19:34:12.627231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 14 19:34:12.627231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self.session.flush() Sep 14 19:34:12.627231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 19:34:12.627231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._flush(objects) Sep 14 19:34:12.627231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 19:34:12.627231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 14 19:34:12.627231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 19:34:12.627231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application compat.raise_( Sep 14 19:34:12.627231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 19:34:12.627231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception Sep 14 19:34:12.627231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 19:34:12.627231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application flush_context.execute() Sep 14 19:34:12.627231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 19:34:12.627231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rec.execute(self) Sep 14 19:34:12.627231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 19:34:12.627231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 14 19:34:12.628191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 19:34:12.628191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 14 19:34:12.628191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 14 19:34:12.628191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 14 19:34:12.628191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 19:34:12.628191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 19:34:12.628191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 19:34:12.628191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 14 19:34:12.628191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 19:34:12.628191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 14 19:34:12.628191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 19:34:12.628191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 14 19:34:12.628191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 19:34:12.628191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 19:34:12.628191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 19:34:12.628191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception Sep 14 19:34:12.629009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 19:34:12.629009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 19:34:12.629009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 19:34:12.629009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 19:34:12.629009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 19:34:12.629009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 19:34:12.629009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 19:34:12.629009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application conn.query(q) Sep 14 19:34:12.629009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 19:34:12.629009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 19:34:12.629009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 19:34:12.629009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application result.read() Sep 14 19:34:12.629009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 19:34:12.629009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 19:34:12.629009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 19:34:12.629009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 19:34:12.629787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 19:34:12.629787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 19:34:12.629787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 19:34:12.629787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 19:34:12.629787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 14 19:34:12.629787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 14 19:34:12.629787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [parameters: {'id': 'f1ec0edf6cab4031b59157d01ab1ef88', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 14 19:34:12.629787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 19:34:12.629787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:12.629787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:34:12.629787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:12.629787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:12.629787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:12.629787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:12.629787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:12.629787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:12.632394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:12.632394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:12.632394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:12.632394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:12.632394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:12.632394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:12.632394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 14 19:34:12.632394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 14 19:34:12.632394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:12.632394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:12.632394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 14 19:34:12.632394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 14 19:34:12.632394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 14 19:34:12.632394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 14 19:34:12.632394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 14 19:34:12.632394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:12.634271 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 244/478] 10.222.0.15 () {60 vars in 1131 bytes} [Wed Sep 14 19:34:12 2022] POST /identity/v3/roles => generated 144 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:12.637628 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45984d-55a1-4e47-a0ba-7768c7e8d8c1 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:12.756135 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:12.760433 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45984d-55a1-4e47-a0ba-7768c7e8d8c1 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:12.798369 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b4125-19b8-4202-8013-52d4a2ee1bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:12.799063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b4125-19b8-4202-8013-52d4a2ee1bfc None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:12.799346 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b4125-19b8-4202-8013-52d4a2ee1bfc None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:12.799656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b4125-19b8-4202-8013-52d4a2ee1bfc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:12.816117 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b4125-19b8-4202-8013-52d4a2ee1bfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:12.821251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-d86b4125-19b8-4202-8013-52d4a2ee1bfc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:34:12.821251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:12.821251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:12.821251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:12.821251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:12.821251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:12.821251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:12.821251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:12.821251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:12.821251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:12.821251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:12.821251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:12.821251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:12.821251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:12.821251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:12.821251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:12.822191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:12.822191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:12.822191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:12.822191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:12.822191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:12.822191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:12.822191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:12.822191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:12.822191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:12.822191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:12.822191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:12.822191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:12.822191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:12.822191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:12.822191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:12.822191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:12.823052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:12.823052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:12.823052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:12.823052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:12.823052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:12.823052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:12.823052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:12.823052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:12.823052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:12.823052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:12.823052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 19:34:12.823052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:12.823052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 235/479] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:34:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:12.828704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b89d57-9c04-4e09-b452-009f5142653f None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:12.936031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:12.940056 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b89d57-9c04-4e09-b452-009f5142653f None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:12.985853 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4541a-8d7b-4961-9166-aa259c54be12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:12.986477 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4541a-8d7b-4961-9166-aa259c54be12 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:12.986756 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4541a-8d7b-4961-9166-aa259c54be12 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:12.987024 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4541a-8d7b-4961-9166-aa259c54be12 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:12.987709 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4541a-8d7b-4961-9166-aa259c54be12 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:12.988012 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4541a-8d7b-4961-9166-aa259c54be12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:12.989392 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4541a-8d7b-4961-9166-aa259c54be12 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:13.002278 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 245/480] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:13.792585 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587b26f-7018-4ec7-bc7f-bfd07e98d507 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:13.793087 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587b26f-7018-4ec7-bc7f-bfd07e98d507 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:13.793087 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587b26f-7018-4ec7-bc7f-bfd07e98d507 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:13.794633 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 236/481] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:13.800481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950179e-2ba6-445f-9bc2-0578b3c09fb9 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:13.800900 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950179e-2ba6-445f-9bc2-0578b3c09fb9 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:13.801058 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950179e-2ba6-445f-9bc2-0578b3c09fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:13.821815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-c950179e-2ba6-445f-9bc2-0578b3c09fb9 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:13.823019 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c950179e-2ba6-445f-9bc2-0578b3c09fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:13.899270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 246/482] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:14.224178 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587b26f-7018-4ec7-bc7f-bfd07e98d507 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:14.356473 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587b26f-7018-4ec7-bc7f-bfd07e98d507 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:14.406216 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765b81a-cf21-4502-8d7a-9f6dbe210592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:14.407808 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765b81a-cf21-4502-8d7a-9f6dbe210592 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:14.408297 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765b81a-cf21-4502-8d7a-9f6dbe210592 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:14.408794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765b81a-cf21-4502-8d7a-9f6dbe210592 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:14.426009 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765b81a-cf21-4502-8d7a-9f6dbe210592 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:14.431829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-2765b81a-cf21-4502-8d7a-9f6dbe210592 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:14.431829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:14.431829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:14.431829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:14.431829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:14.431829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:14.431829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:14.431829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:14.431829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:14.431829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:14.431829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:14.431829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:14.431829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:14.431829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:14.431829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:14.431829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:14.432707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:14.432707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:14.432707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:14.432707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:14.432707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:14.432707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:14.432707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:14.432707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:14.432707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:14.432707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:14.432707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:14.432707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:14.432707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:14.432707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:14.432707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:14.432707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:14.433502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:14.433502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:14.433502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:14.433502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:14.433502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:14.433502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:14.433502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:14.433502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:14.433502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:14.433502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:14.433502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:14.433502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:14.441130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 237/483] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:34:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:14.446882 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950179e-2ba6-445f-9bc2-0578b3c09fb9 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:14.560022 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:14.573428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950179e-2ba6-445f-9bc2-0578b3c09fb9 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:14.579801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0c92a-6781-4995-87bd-210f3d55d067 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:14.580089 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0c92a-6781-4995-87bd-210f3d55d067 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:14.580365 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0c92a-6781-4995-87bd-210f3d55d067 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:14.581993 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 238/484] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:14.598808 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25a0f9-1222-4b1d-99e0-a03db6b33bc3 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:14.599101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25a0f9-1222-4b1d-99e0-a03db6b33bc3 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:14.599357 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25a0f9-1222-4b1d-99e0-a03db6b33bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:14.615182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4cae8-15a2-48b3-8c48-5f9dbccff704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:14.615900 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4cae8-15a2-48b3-8c48-5f9dbccff704 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:14.616179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4cae8-15a2-48b3-8c48-5f9dbccff704 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:14.616568 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4cae8-15a2-48b3-8c48-5f9dbccff704 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:14.617264 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4cae8-15a2-48b3-8c48-5f9dbccff704 None admin] RBAC: Adding query filter params (name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:14.617569 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4cae8-15a2-48b3-8c48-5f9dbccff704 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:14.618974 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4cae8-15a2-48b3-8c48-5f9dbccff704 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:14.642260 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 247/485] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Sep 14 19:34:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:14.644418 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4cae8-15a2-48b3-8c48-5f9dbccff704 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:14.645525 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-9c25a0f9-1222-4b1d-99e0-a03db6b33bc3 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:14.646723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-9c25a0f9-1222-4b1d-99e0-a03db6b33bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:14.674287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:14.795718 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 239/486] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:14.805009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4cae8-15a2-48b3-8c48-5f9dbccff704 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:14.868485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a8a35-fb62-4144-afa5-b2d3313934c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:14.869176 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a8a35-fb62-4144-afa5-b2d3313934c0 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:14.869464 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a8a35-fb62-4144-afa5-b2d3313934c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:14.869744 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a8a35-fb62-4144-afa5-b2d3313934c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:14.887979 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a8a35-fb62-4144-afa5-b2d3313934c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:14.889484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a8a35-fb62-4144-afa5-b2d3313934c0 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:14.914133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-660a8a35-fb62-4144-afa5-b2d3313934c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:14.914133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:14.914133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:14.914133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:14.914133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:14.914133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:14.914133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:14.914133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:14.914133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:14.914133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:14.914133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:14.914133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:14.914133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:14.914133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:14.914133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:14.914133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:14.915089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:14.915089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:14.915089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:14.915089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:14.915089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:14.915089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:14.915089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:14.915089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:14.915089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:14.915089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:14.915089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:14.915089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:14.915089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:14.915089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:14.915089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:14.915089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:14.915089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:14.915970 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:14.915970 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:14.915970 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:14.915970 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 248/487] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:14.921055 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25a0f9-1222-4b1d-99e0-a03db6b33bc3 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:14.991096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d626b9-b338-41da-b5b2-817df5e279ec None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:14.991381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d626b9-b338-41da-b5b2-817df5e279ec None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:14.991698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d626b9-b338-41da-b5b2-817df5e279ec None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:14.993302 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 249/488] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:14.998468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c23c0-4b2b-474d-89c5-1beedbc2e0be None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:14.998996 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c23c0-4b2b-474d-89c5-1beedbc2e0be None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:14.999254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c23c0-4b2b-474d-89c5-1beedbc2e0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:15.031937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:15.033491 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-6d7c23c0-4b2b-474d-89c5-1beedbc2e0be None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:15.034710 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-6d7c23c0-4b2b-474d-89c5-1beedbc2e0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:15.121558 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25a0f9-1222-4b1d-99e0-a03db6b33bc3 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:15.168774 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 250/489] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:34:15.169642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c23c0-4b2b-474d-89c5-1beedbc2e0be None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:15.187136 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4a230-221d-4aeb-a88c-66f846ba79f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:15.187775 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4a230-221d-4aeb-a88c-66f846ba79f5 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:15.188055 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4a230-221d-4aeb-a88c-66f846ba79f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:15.188838 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4a230-221d-4aeb-a88c-66f846ba79f5 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:15.189498 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4a230-221d-4aeb-a88c-66f846ba79f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:15.189800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4a230-221d-4aeb-a88c-66f846ba79f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:15.191172 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4a230-221d-4aeb-a88c-66f846ba79f5 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:15.210040 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 240/490] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:15.211363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130238b-25a5-497e-bfdd-4dea990e391e None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:15.211681 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130238b-25a5-497e-bfdd-4dea990e391e None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:15.211959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130238b-25a5-497e-bfdd-4dea990e391e None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:15.213445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 241/491] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:15.214945 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130238b-25a5-497e-bfdd-4dea990e391e None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:15.227682 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:15.307274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c23c0-4b2b-474d-89c5-1beedbc2e0be None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:15.329714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130238b-25a5-497e-bfdd-4dea990e391e None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:15.348420 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5de07-20c0-4550-9886-2938a633dff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:15.349709 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5de07-20c0-4550-9886-2938a633dff8 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:15.350727 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5de07-20c0-4550-9886-2938a633dff8 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:15.351360 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5de07-20c0-4550-9886-2938a633dff8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:15.353944 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:15.370530 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5de07-20c0-4550-9886-2938a633dff8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:15.382665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-cfd5de07-20c0-4550-9886-2938a633dff8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:15.382665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:15.382665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:15.382665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:15.382665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:15.382665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:15.382665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:15.382665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:15.382665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:15.382665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:15.382665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:15.382665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:15.382665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:15.382665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:15.382665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:15.382665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:15.383521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:15.383521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:15.383521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:15.383521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:15.383521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:15.383521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:15.383521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:15.383521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:15.383521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:15.383521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:15.383521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:15.383521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:15.383521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:15.383521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:15.383521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:15.383521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:15.384348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:15.384348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:15.384348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:15.384348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:15.384348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:15.384348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:15.384348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:15.384348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:15.384348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:15.384348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:15.384348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:15.384348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:15.384348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 251/492] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:34:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:15.384348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8995fc7-d392-498e-8092-aa2a6a01a374 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:15.385129 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8995fc7-d392-498e-8092-aa2a6a01a374 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:15.385129 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8995fc7-d392-498e-8092-aa2a6a01a374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:15.394260 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ece6da-4bc3-4c1f-afcd-554567da27e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:15.394855 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ece6da-4bc3-4c1f-afcd-554567da27e8 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:15.395127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ece6da-4bc3-4c1f-afcd-554567da27e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:15.395391 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ece6da-4bc3-4c1f-afcd-554567da27e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:15.404430 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ece6da-4bc3-4c1f-afcd-554567da27e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:15.405872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ece6da-4bc3-4c1f-afcd-554567da27e8 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:15.409068 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-f8995fc7-d392-498e-8092-aa2a6a01a374 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:15.411440 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f8995fc7-d392-498e-8092-aa2a6a01a374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:15.419985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-34ece6da-4bc3-4c1f-afcd-554567da27e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 19:34:15.419985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:15.419985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:15.419985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:15.419985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:15.419985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:15.419985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:15.419985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:15.419985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:15.419985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:15.419985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:15.419985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:15.419985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:15.419985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:15.419985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:15.419985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:15.420915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:15.420915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:15.420915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:15.420915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:15.420915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:15.420915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:15.420915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:15.420915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:15.420915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:15.420915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:15.420915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:15.420915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:15.420915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:15.420915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:15.420915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:15.420915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:15.420915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:15.420915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:15.424148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:15.424148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:15.424148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:15.424148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:15.424148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:15.424148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:15.424148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:15.424148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:15.424148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 19:34:15.424148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:15.424148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 242/493] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Sep 14 19:34:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:15.424148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ece6da-4bc3-4c1f-afcd-554567da27e8 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:15.507569 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:15.507760 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 252/494] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:15.507760 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8995fc7-d392-498e-8092-aa2a6a01a374 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:15.541624 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ece6da-4bc3-4c1f-afcd-554567da27e8 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:15.577833 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fe9aa-8b99-4d60-9de6-38ae7965c7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:15.578493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fe9aa-8b99-4d60-9de6-38ae7965c7b1 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:15.578775 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fe9aa-8b99-4d60-9de6-38ae7965c7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:15.579649 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fe9aa-8b99-4d60-9de6-38ae7965c7b1 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:15.580480 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fe9aa-8b99-4d60-9de6-38ae7965c7b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:15.580924 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fe9aa-8b99-4d60-9de6-38ae7965c7b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:15.582313 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fe9aa-8b99-4d60-9de6-38ae7965c7b1 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:15.591419 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 243/495] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Sep 14 19:34:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:15.592369 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fe9aa-8b99-4d60-9de6-38ae7965c7b1 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:15.619691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8995fc7-d392-498e-8092-aa2a6a01a374 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:15.648224 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:15.670501 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1b8bc-979d-4698-8c5a-630fe9d998bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:15.671127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1b8bc-979d-4698-8c5a-630fe9d998bf None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:15.671403 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1b8bc-979d-4698-8c5a-630fe9d998bf None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:15.671710 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1b8bc-979d-4698-8c5a-630fe9d998bf None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:15.672661 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1b8bc-979d-4698-8c5a-630fe9d998bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:15.672992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1b8bc-979d-4698-8c5a-630fe9d998bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:15.674566 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1b8bc-979d-4698-8c5a-630fe9d998bf None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:15.714841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 253/496] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Sep 14 19:34:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:15.715721 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1b8bc-979d-4698-8c5a-630fe9d998bf None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:15.724742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fe9aa-8b99-4d60-9de6-38ae7965c7b1 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:15.757308 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:15.763271 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b97d10-2146-40b3-94b3-11391ee18479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:15.764024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b97d10-2146-40b3-94b3-11391ee18479 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:15.764399 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b97d10-2146-40b3-94b3-11391ee18479 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:15.764674 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b97d10-2146-40b3-94b3-11391ee18479 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:15.776915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b97d10-2146-40b3-94b3-11391ee18479 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:15.782077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-95b97d10-2146-40b3-94b3-11391ee18479 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:15.782077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:15.782077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:15.782077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:15.782077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:15.782077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:15.782077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:15.782077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:15.782077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:15.782077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:15.782077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:15.782077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:15.782077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:15.782077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:15.782077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:15.782077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:15.782962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:15.782962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:15.782962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:15.782962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:15.782962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:15.782962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:15.782962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:15.782962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:15.782962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:15.782962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:15.782962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:15.782962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:15.782962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:15.782962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:15.782962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:15.782962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:15.783771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:15.783771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:15.783771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:15.783771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:15.783771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:15.783771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:15.783771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:15.783771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:15.783771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:15.783771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:15.783771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:15.783771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:15.783771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 244/497] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:34:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:15.784896 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b97d10-2146-40b3-94b3-11391ee18479 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:15.846247 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1b8bc-979d-4698-8c5a-630fe9d998bf None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:15.884842 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a2129-4510-490d-b661-017361aa367e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:15.886355 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a2129-4510-490d-b661-017361aa367e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:15.886768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a2129-4510-490d-b661-017361aa367e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:15.887018 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a2129-4510-490d-b661-017361aa367e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:15.899684 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a2129-4510-490d-b661-017361aa367e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:15.900090 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b97d10-2146-40b3-94b3-11391ee18479 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:15.901093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a2129-4510-490d-b661-017361aa367e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:15.917574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-e86a2129-4510-490d-b661-017361aa367e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:15.917574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:15.917574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:15.917574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:15.917574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:15.917574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:15.917574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:15.917574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:15.917574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:15.917574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:15.917574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:15.917574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:15.917574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:15.917574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:15.917574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:15.917574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:15.918553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:15.918553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:15.918553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:15.918553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:15.918553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:15.918553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:15.918553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:15.918553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:15.918553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:15.918553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:15.918553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:15.918553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:15.918553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:15.918553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:15.918553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:15.918553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:15.918553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:15.919382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:15.919382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:15.919382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:15.919382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 254/498] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:15.919644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a2129-4510-490d-b661-017361aa367e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:15.946236 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da622d-2595-4c4f-bfce-b79bd61c6f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:15.947075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da622d-2595-4c4f-bfce-b79bd61c6f88 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:15.947511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da622d-2595-4c4f-bfce-b79bd61c6f88 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:15.947816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da622d-2595-4c4f-bfce-b79bd61c6f88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:15.959368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:16.014805 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:16.026874 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da622d-2595-4c4f-bfce-b79bd61c6f88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:16.028391 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da622d-2595-4c4f-bfce-b79bd61c6f88 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:16.030459 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a2129-4510-490d-b661-017361aa367e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:16.066637 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da61ba-4497-460e-a628-48e94354196d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:16.067247 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da61ba-4497-460e-a628-48e94354196d None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:16.067524 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da61ba-4497-460e-a628-48e94354196d None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:16.067836 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da61ba-4497-460e-a628-48e94354196d None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:16.068495 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da61ba-4497-460e-a628-48e94354196d None admin] RBAC: Adding query filter params (name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:16.068800 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da61ba-4497-460e-a628-48e94354196d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:16.070179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da61ba-4497-460e-a628-48e94354196d None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:16.077991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 255/499] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Sep 14 19:34:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:16.078779 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da61ba-4497-460e-a628-48e94354196d None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:16.128817 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 245/500] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:34:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:34:16.129749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da622d-2595-4c4f-bfce-b79bd61c6f88 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:16.174295 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:16.180544 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da61ba-4497-460e-a628-48e94354196d None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:16.214384 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab8701-f6bc-4ed1-bd84-d7aee89d5039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:16.215014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab8701-f6bc-4ed1-bd84-d7aee89d5039 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:16.215294 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab8701-f6bc-4ed1-bd84-d7aee89d5039 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:16.215596 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab8701-f6bc-4ed1-bd84-d7aee89d5039 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:16.216161 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:16.225803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da622d-2595-4c4f-bfce-b79bd61c6f88 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:16.225940 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab8701-f6bc-4ed1-bd84-d7aee89d5039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:16.231155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-c3ab8701-f6bc-4ed1-bd84-d7aee89d5039 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:16.231155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:16.231155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:16.231155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:16.231155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:16.231155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:16.231155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:16.231155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:16.231155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:16.231155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:16.231155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:16.231155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:16.231155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:16.231155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:16.231155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:16.231155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:16.232157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:16.232157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:16.232157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:16.232157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:16.232157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:16.232157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:16.232157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:16.232157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:16.232157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:16.232157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:16.232157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:16.232157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:16.232157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:16.232157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:16.232157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:16.232157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:16.232942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:16.232942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:16.232942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:16.232942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:16.232942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:16.232942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:16.232942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:16.232942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:16.232942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:16.232942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:16.232942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:16.232942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:16.232942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 256/501] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:34:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:16.233581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa8d97-d5ef-4bd5-9523-fc10445792a4 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:16.233772 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa8d97-d5ef-4bd5-9523-fc10445792a4 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:16.234039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa8d97-d5ef-4bd5-9523-fc10445792a4 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:16.237539 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 257/502] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:16.237539 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa8d97-d5ef-4bd5-9523-fc10445792a4 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:16.265823 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7929b-35e6-4d5b-b17b-b9ccc209a0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:16.266433 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7929b-35e6-4d5b-b17b-b9ccc209a0c3 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:16.267245 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7929b-35e6-4d5b-b17b-b9ccc209a0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:16.267515 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7929b-35e6-4d5b-b17b-b9ccc209a0c3 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:16.268183 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7929b-35e6-4d5b-b17b-b9ccc209a0c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:16.268487 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7929b-35e6-4d5b-b17b-b9ccc209a0c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:16.269862 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7929b-35e6-4d5b-b17b-b9ccc209a0c3 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:16.281157 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 246/503] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:16.281973 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7929b-35e6-4d5b-b17b-b9ccc209a0c3 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:16.341011 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa8d97-d5ef-4bd5-9523-fc10445792a4 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:16.382564 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838d0b3-2796-45e5-aea3-f1a2e29d934d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:16.383209 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838d0b3-2796-45e5-aea3-f1a2e29d934d None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:16.383490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838d0b3-2796-45e5-aea3-f1a2e29d934d None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:16.383782 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838d0b3-2796-45e5-aea3-f1a2e29d934d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:16.388242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7929b-35e6-4d5b-b17b-b9ccc209a0c3 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:16.395169 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838d0b3-2796-45e5-aea3-f1a2e29d934d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:16.396672 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838d0b3-2796-45e5-aea3-f1a2e29d934d None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:16.413417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-4838d0b3-2796-45e5-aea3-f1a2e29d934d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:16.413417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:16.413417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:16.413417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:16.413417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:16.413417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:16.413417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:16.413417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:16.413417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:16.413417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:16.413417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:16.413417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:16.413417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:16.413417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:16.413417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:16.413417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:16.414383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:16.414383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:16.414383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:16.414383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:16.414383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:16.414383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:16.414383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:16.414383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:16.414383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:16.414383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:16.414383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:16.414383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:16.414383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:16.414383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:16.414383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:16.414383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:16.414383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:16.415251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:16.415251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:16.415251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:16.415251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 258/504] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:16.415733 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838d0b3-2796-45e5-aea3-f1a2e29d934d None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:16.426964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004853f-5aea-4af5-babd-c33a694ca176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:16.427448 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004853f-5aea-4af5-babd-c33a694ca176 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:16.427756 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004853f-5aea-4af5-babd-c33a694ca176 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:16.428020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004853f-5aea-4af5-babd-c33a694ca176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:16.430262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:16.440056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004853f-5aea-4af5-babd-c33a694ca176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:16.441503 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004853f-5aea-4af5-babd-c33a694ca176 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:16.456269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-1004853f-5aea-4af5-babd-c33a694ca176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:16.456269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:16.456269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:16.456269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:16.456269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:16.456269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:16.456269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:16.456269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:16.456269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:16.456269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:16.456269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:16.456269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:16.456269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:16.456269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:16.456269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:16.456269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:16.457332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:16.457332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:16.457332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:16.457332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:16.457332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:16.457332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:16.457332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:16.457332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:16.457332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:16.457332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:16.457332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:16.457332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:16.457332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:16.457332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:16.457332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:16.457332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:16.457332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:16.458354 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:16.458354 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:16.458354 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:16.458354 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 247/505] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:16.458835 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08ed21-9ca5-4784-a2d0-e648f4b0ef4a None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:16.459116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08ed21-9ca5-4784-a2d0-e648f4b0ef4a None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:16.459384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08ed21-9ca5-4784-a2d0-e648f4b0ef4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:16.466014 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:16.477305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-fe08ed21-9ca5-4784-a2d0-e648f4b0ef4a None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:16.478503 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-fe08ed21-9ca5-4784-a2d0-e648f4b0ef4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:16.528835 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838d0b3-2796-45e5-aea3-f1a2e29d934d None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:16.544749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 248/506] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:16.545574 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08ed21-9ca5-4784-a2d0-e648f4b0ef4a None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:16.578691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427488f1-d499-46be-a05d-e629f3186bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:16.579427 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427488f1-d499-46be-a05d-e629f3186bb0 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:16.579836 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427488f1-d499-46be-a05d-e629f3186bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:16.580104 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427488f1-d499-46be-a05d-e629f3186bb0 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:16.580759 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427488f1-d499-46be-a05d-e629f3186bb0 None admin] RBAC: Adding query filter params (name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:16.581059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427488f1-d499-46be-a05d-e629f3186bb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:16.582435 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427488f1-d499-46be-a05d-e629f3186bb0 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:16.592252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 259/507] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Sep 14 19:34:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:16.593492 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427488f1-d499-46be-a05d-e629f3186bb0 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:16.659887 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08ed21-9ca5-4784-a2d0-e648f4b0ef4a None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:16.667220 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:16.692218 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:16.696910 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e908d-102e-4876-b7bd-746e14820412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:16.697533 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e908d-102e-4876-b7bd-746e14820412 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:16.697808 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e908d-102e-4876-b7bd-746e14820412 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:16.698076 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e908d-102e-4876-b7bd-746e14820412 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:16.699792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427488f1-d499-46be-a05d-e629f3186bb0 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:16.705384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e908d-102e-4876-b7bd-746e14820412 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:16.706823 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e908d-102e-4876-b7bd-746e14820412 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:16.724393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-fe6e908d-102e-4876-b7bd-746e14820412 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 19:34:16.724393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:16.724393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:16.724393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:16.724393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:16.724393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:16.724393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:16.724393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:16.724393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:16.724393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:16.724393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:16.724393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:16.724393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:16.724393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:16.724393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:16.724393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:16.725305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:16.725305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:16.725305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:16.725305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:16.725305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:16.725305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:16.725305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:16.725305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:16.725305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:16.725305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:16.725305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:16.725305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:16.725305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:16.725305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:16.725305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:16.725305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:16.725305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:16.725305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:16.726160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:16.726160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:16.726160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:16.726160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:16.726160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:16.726160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:16.726160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:16.726160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:16.726160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 14 19:34:16.726160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:16.726160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 249/508] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:34:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:16.726788 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e908d-102e-4876-b7bd-746e14820412 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:16.741332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0fe4d1-4b77-4bb6-8b6f-71eb6dc4acae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:16.741956 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fe4d1-4b77-4bb6-8b6f-71eb6dc4acae None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:16.742234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fe4d1-4b77-4bb6-8b6f-71eb6dc4acae None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:16.742499 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fe4d1-4b77-4bb6-8b6f-71eb6dc4acae None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:16.743138 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0fe4d1-4b77-4bb6-8b6f-71eb6dc4acae None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:16.743440 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0fe4d1-4b77-4bb6-8b6f-71eb6dc4acae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:16.744846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0fe4d1-4b77-4bb6-8b6f-71eb6dc4acae None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:16.762347 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 260/509] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:16.762347 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0fe4d1-4b77-4bb6-8b6f-71eb6dc4acae None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:16.839298 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e908d-102e-4876-b7bd-746e14820412 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:16.872115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc511a-b1de-4ac3-bdf7-a03c388743a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:16.872712 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc511a-b1de-4ac3-bdf7-a03c388743a3 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:16.872987 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc511a-b1de-4ac3-bdf7-a03c388743a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:16.873256 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc511a-b1de-4ac3-bdf7-a03c388743a3 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:16.873887 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc511a-b1de-4ac3-bdf7-a03c388743a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:16.874183 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc511a-b1de-4ac3-bdf7-a03c388743a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:16.875480 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0fe4d1-4b77-4bb6-8b6f-71eb6dc4acae None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:16.875942 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc511a-b1de-4ac3-bdf7-a03c388743a3 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:16.886868 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 250/510] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:16.887685 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc511a-b1de-4ac3-bdf7-a03c388743a3 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:16.904846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:16.911660 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38210446-05e5-48ad-8be4-def43d83817f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:16.912307 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38210446-05e5-48ad-8be4-def43d83817f None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:16.912586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38210446-05e5-48ad-8be4-def43d83817f None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:16.912857 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38210446-05e5-48ad-8be4-def43d83817f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:16.922520 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38210446-05e5-48ad-8be4-def43d83817f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:16.924044 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38210446-05e5-48ad-8be4-def43d83817f None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:16.939377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-38210446-05e5-48ad-8be4-def43d83817f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:16.939377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:16.939377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:16.939377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:16.939377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:16.939377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:16.939377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:16.939377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:16.939377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:16.939377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:16.939377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:16.939377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:16.939377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:16.939377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:16.939377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:16.939377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:16.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:16.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:16.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:16.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:16.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:16.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:16.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:16.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:16.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:16.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:16.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:16.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:16.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:16.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:16.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:16.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:16.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:16.941245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:16.941245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:16.941245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:16.941245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 261/511] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:16.941245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38210446-05e5-48ad-8be4-def43d83817f None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:16.942189 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:16.990616 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc511a-b1de-4ac3-bdf7-a03c388743a3 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:17.024784 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ced110-62e7-413c-bc97-399fcfec2bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:17.025395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ced110-62e7-413c-bc97-399fcfec2bb8 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:17.025670 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ced110-62e7-413c-bc97-399fcfec2bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:17.025946 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ced110-62e7-413c-bc97-399fcfec2bb8 None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:17.026672 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ced110-62e7-413c-bc97-399fcfec2bb8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:17.026981 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ced110-62e7-413c-bc97-399fcfec2bb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:17.028435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ced110-62e7-413c-bc97-399fcfec2bb8 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:17.042248 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38210446-05e5-48ad-8be4-def43d83817f None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:17.066809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 251/512] 10.222.0.15 () {56 vars in 1137 bytes} [Wed Sep 14 19:34:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:17.067692 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ced110-62e7-413c-bc97-399fcfec2bb8 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:17.082217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc9f39-3d02-474a-a9d7-cac142f542ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:17.082946 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc9f39-3d02-474a-a9d7-cac142f542ae None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:17.083297 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc9f39-3d02-474a-a9d7-cac142f542ae None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:17.083611 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc9f39-3d02-474a-a9d7-cac142f542ae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:17.091232 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc9f39-3d02-474a-a9d7-cac142f542ae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:17.092699 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc9f39-3d02-474a-a9d7-cac142f542ae None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:17.105034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-acbc9f39-3d02-474a-a9d7-cac142f542ae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 19:34:17.105034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:17.105034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:17.105034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:17.105034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:17.105034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:17.105034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:17.105034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:17.105034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:17.105034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:17.105034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:17.105034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:17.105034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:17.105034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:17.105034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:17.105034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:17.106095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:17.106095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:17.106095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:17.106095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:17.106095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:17.106095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:17.106095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:17.106095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:17.106095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:17.106095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:17.106095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:17.106095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:17.106095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:17.106095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:17.106095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:17.106095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:17.106095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:17.106095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:17.106960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:17.106960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:17.106960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:17.106960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:17.106960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:17.106960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:17.106960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:17.106960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:17.106960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 19:34:17.106960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:17.106960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 262/513] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:34:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:17.107514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc9f39-3d02-474a-a9d7-cac142f542ae None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:17.150835 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:17.169641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ced110-62e7-413c-bc97-399fcfec2bb8 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:17.180811 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:17.203500 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ef7cf-751c-48ab-a562-554163d43fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:17.204102 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ef7cf-751c-48ab-a562-554163d43fc1 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:17.204854 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ef7cf-751c-48ab-a562-554163d43fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:17.205052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ef7cf-751c-48ab-a562-554163d43fc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:17.206656 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc9f39-3d02-474a-a9d7-cac142f542ae None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:17.215172 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ef7cf-751c-48ab-a562-554163d43fc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:17.216651 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ef7cf-751c-48ab-a562-554163d43fc1 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:17.231393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-cb2ef7cf-751c-48ab-a562-554163d43fc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:17.231393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:17.231393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:17.231393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:17.231393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:17.231393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:17.231393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:17.231393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:17.231393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:17.231393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:17.231393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:17.231393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:17.231393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:17.231393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:17.231393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:17.231393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:17.232477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:17.232477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:17.232477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:17.232477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:17.232477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:17.232477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:17.232477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:17.232477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:17.232477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:17.232477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:17.232477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:17.232477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:17.232477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:17.232477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:17.232477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:17.232477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:17.232477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:17.233512 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:17.233512 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:17.233512 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:17.233512 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 252/514] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:17.233767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ef7cf-751c-48ab-a562-554163d43fc1 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:17.242532 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f00c66-92f9-4832-bb15-92358bb34c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:17.243091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f00c66-92f9-4832-bb15-92358bb34c17 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:17.243371 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f00c66-92f9-4832-bb15-92358bb34c17 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:17.243674 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f00c66-92f9-4832-bb15-92358bb34c17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:17.250120 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f00c66-92f9-4832-bb15-92358bb34c17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:17.252135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f00c66-92f9-4832-bb15-92358bb34c17 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:17.263655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-f5f00c66-92f9-4832-bb15-92358bb34c17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:17.263655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:17.263655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:17.263655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:17.263655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:17.263655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:17.263655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:17.263655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:17.263655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:17.263655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:17.263655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:17.263655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:17.263655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:17.263655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:17.263655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:17.264468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:17.264468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:17.264468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:17.264468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:17.264468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:17.264468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:17.264468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:17.264468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:17.264468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:17.264468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:17.264468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:17.264468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:17.264468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:17.264468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:17.264468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:17.264468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:17.264468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:17.265356 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:17.265356 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:17.265356 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:17.265356 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:17.265356 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:17.265356 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:17.265356 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:17.265356 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:17.265356 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 263/515] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:17.265827 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f00c66-92f9-4832-bb15-92358bb34c17 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:17.339566 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ef7cf-751c-48ab-a562-554163d43fc1 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:17.362746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f00c66-92f9-4832-bb15-92358bb34c17 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:17.364241 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:17.373109 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fb47f-65f4-4291-8ac4-36cf35ecaf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:17.381435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fb47f-65f4-4291-8ac4-36cf35ecaf7c None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:17.381435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fb47f-65f4-4291-8ac4-36cf35ecaf7c None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:17.381435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fb47f-65f4-4291-8ac4-36cf35ecaf7c None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:17.381435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fb47f-65f4-4291-8ac4-36cf35ecaf7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:17.381435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fb47f-65f4-4291-8ac4-36cf35ecaf7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:17.381435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fb47f-65f4-4291-8ac4-36cf35ecaf7c None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:17.389625 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 253/516] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:17.390429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fb47f-65f4-4291-8ac4-36cf35ecaf7c None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:17.399971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778fcd1-a0e6-47b8-8933-7e1bdbdf247e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:17.400960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778fcd1-a0e6-47b8-8933-7e1bdbdf247e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:17.401448 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778fcd1-a0e6-47b8-8933-7e1bdbdf247e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:17.401979 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778fcd1-a0e6-47b8-8933-7e1bdbdf247e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:17.415366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:17.470258 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778fcd1-a0e6-47b8-8933-7e1bdbdf247e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:17.471757 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778fcd1-a0e6-47b8-8933-7e1bdbdf247e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:17.490566 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fb47f-65f4-4291-8ac4-36cf35ecaf7c None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:17.533647 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166eb45f-f3f1-482b-9770-096c5ce09e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:17.534174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eb45f-f3f1-482b-9770-096c5ce09e50 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:17.534451 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eb45f-f3f1-482b-9770-096c5ce09e50 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:17.534723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eb45f-f3f1-482b-9770-096c5ce09e50 None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:17.535455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166eb45f-f3f1-482b-9770-096c5ce09e50 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:17.535797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166eb45f-f3f1-482b-9770-096c5ce09e50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:17.537230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166eb45f-f3f1-482b-9770-096c5ce09e50 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:17.554896 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 254/517] 10.222.0.15 () {56 vars in 1137 bytes} [Wed Sep 14 19:34:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:17.555832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166eb45f-f3f1-482b-9770-096c5ce09e50 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:17.576336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 264/518] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:34:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:34:17.576336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778fcd1-a0e6-47b8-8933-7e1bdbdf247e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:17.576336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:17.640920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:17.660300 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166eb45f-f3f1-482b-9770-096c5ce09e50 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:17.670291 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778fcd1-a0e6-47b8-8933-7e1bdbdf247e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:17.694255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ab634-8f5d-4f07-8025-f713adc52088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:17.694855 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ab634-8f5d-4f07-8025-f713adc52088 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:17.695139 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ab634-8f5d-4f07-8025-f713adc52088 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:17.695415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ab634-8f5d-4f07-8025-f713adc52088 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:17.696090 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ab634-8f5d-4f07-8025-f713adc52088 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:17.696393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ab634-8f5d-4f07-8025-f713adc52088 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:17.697759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ab634-8f5d-4f07-8025-f713adc52088 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:17.703443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698c0d3-8b44-420c-9614-2acc3ddabeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:17.704088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698c0d3-8b44-420c-9614-2acc3ddabeba None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:17.704891 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698c0d3-8b44-420c-9614-2acc3ddabeba None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:17.705166 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698c0d3-8b44-420c-9614-2acc3ddabeba None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:17.705860 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698c0d3-8b44-420c-9614-2acc3ddabeba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:17.706167 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698c0d3-8b44-420c-9614-2acc3ddabeba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:17.707616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698c0d3-8b44-420c-9614-2acc3ddabeba None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:17.709540 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 255/519] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:17.710333 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ab634-8f5d-4f07-8025-f713adc52088 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:17.725382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 265/520] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:17.726212 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698c0d3-8b44-420c-9614-2acc3ddabeba None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:17.786436 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:17.811050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ab634-8f5d-4f07-8025-f713adc52088 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:17.824044 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698c0d3-8b44-420c-9614-2acc3ddabeba None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:17.844331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2692b-8280-4051-ad49-5b135dc160a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:17.845067 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2692b-8280-4051-ad49-5b135dc160a2 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:17.845413 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2692b-8280-4051-ad49-5b135dc160a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:17.845687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2692b-8280-4051-ad49-5b135dc160a2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:17.853183 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2692b-8280-4051-ad49-5b135dc160a2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:17.854642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2692b-8280-4051-ad49-5b135dc160a2 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:17.857385 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:17.858331 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed306f83-0475-4d1b-ae5e-d677223bbced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:17.858941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed306f83-0475-4d1b-ae5e-d677223bbced None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:17.859220 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed306f83-0475-4d1b-ae5e-d677223bbced None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:17.859485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed306f83-0475-4d1b-ae5e-d677223bbced None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:17.866810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-51a2692b-8280-4051-ad49-5b135dc160a2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 19:34:17.866810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:17.866810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:17.866810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:17.866810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:17.866810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:17.866810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:17.866810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:17.866810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:17.866810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:17.866810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:17.866810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:17.866810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:17.866810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:17.866810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:17.866810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:17.876290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:17.876290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:17.876290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:17.876290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:17.876290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:17.876290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:17.876290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:17.876290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:17.876290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:17.876290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:17.876290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:17.876290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:17.876290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:17.876290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:17.876290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:17.876290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:17.876290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:17.876290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:17.877398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:17.877398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:17.877398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:17.877398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:17.877398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:17.877398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:17.877398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:17.877398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:17.877398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 19:34:17.877398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:17.877398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 256/521] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:34:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:17.877398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2692b-8280-4051-ad49-5b135dc160a2 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:17.927258 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed306f83-0475-4d1b-ae5e-d677223bbced None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:17.928743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed306f83-0475-4d1b-ae5e-d677223bbced None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:17.972272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2692b-8280-4051-ad49-5b135dc160a2 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:17.986921 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:18.006483 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02aa44-9c74-4123-82cd-170e905a296a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:18.007118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02aa44-9c74-4123-82cd-170e905a296a None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:18.007395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02aa44-9c74-4123-82cd-170e905a296a None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:18.007709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02aa44-9c74-4123-82cd-170e905a296a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:18.018155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02aa44-9c74-4123-82cd-170e905a296a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:18.019640 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02aa44-9c74-4123-82cd-170e905a296a None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:18.025528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 266/522] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:34:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:34:18.026967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed306f83-0475-4d1b-ae5e-d677223bbced None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:18.034922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-6b02aa44-9c74-4123-82cd-170e905a296a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:18.034922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:18.034922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:18.034922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:18.034922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:18.034922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:18.034922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:18.034922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:18.034922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:18.034922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:18.034922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:18.034922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:18.034922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:18.034922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:18.034922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:18.034922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:18.035939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:18.035939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:18.035939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:18.035939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:18.035939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:18.035939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:18.035939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:18.035939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:18.035939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:18.035939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:18.035939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:18.035939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:18.035939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:18.035939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:18.035939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:18.035939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:18.035939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:18.036841 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:18.036841 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:18.036841 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:18.036841 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 257/523] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:18.037074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02aa44-9c74-4123-82cd-170e905a296a None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:18.088996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:18.132698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed306f83-0475-4d1b-ae5e-d677223bbced None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:18.140505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02aa44-9c74-4123-82cd-170e905a296a None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:18.167607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51a053-3bb8-419b-b28d-6a9d66958e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:18.168220 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51a053-3bb8-419b-b28d-6a9d66958e54 None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:18.168498 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51a053-3bb8-419b-b28d-6a9d66958e54 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:18.168766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51a053-3bb8-419b-b28d-6a9d66958e54 None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:18.169402 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51a053-3bb8-419b-b28d-6a9d66958e54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:18.170825 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51a053-3bb8-419b-b28d-6a9d66958e54 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:18.173898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56252007-1308-4dfd-9101-269d60001e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:18.174486 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56252007-1308-4dfd-9101-269d60001e55 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:18.174758 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56252007-1308-4dfd-9101-269d60001e55 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:18.175025 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56252007-1308-4dfd-9101-269d60001e55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:18.175771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56252007-1308-4dfd-9101-269d60001e55 None admin] RBAC: Adding query filter params (role.id=b2e8ea485659485f92e729741880d447, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=421f6cc846b342918a177d2794eb3db8) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:18.176074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56252007-1308-4dfd-9101-269d60001e55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:18.177510 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56252007-1308-4dfd-9101-269d60001e55 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:18.182741 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 258/524] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:34:18 2022] GET /identity/v3/role_assignments?user.id=421f6cc846b342918a177d2794eb3db8&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=b2e8ea485659485f92e729741880d447 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:18.183512 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56252007-1308-4dfd-9101-269d60001e55 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:18.259044 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 267/525] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Sep 14 19:34:18 2022] POST /identity/v3/users => generated 247 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:34:18.260157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51a053-3bb8-419b-b28d-6a9d66958e54 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:18.289140 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:18.312688 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56252007-1308-4dfd-9101-269d60001e55 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:18.342887 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:18.373952 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa51d5-b997-495e-9251-1d63302c2f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:18.374740 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa51d5-b997-495e-9251-1d63302c2f34 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:18.375074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa51d5-b997-495e-9251-1d63302c2f34 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:18.375753 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa51d5-b997-495e-9251-1d63302c2f34 None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:18.378055 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa51d5-b997-495e-9251-1d63302c2f34 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:18.378464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa51d5-b997-495e-9251-1d63302c2f34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:18.380605 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa51d5-b997-495e-9251-1d63302c2f34 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:18.407592 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51a053-3bb8-419b-b28d-6a9d66958e54 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:18.408749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 259/526] 10.222.0.15 () {56 vars in 1139 bytes} [Wed Sep 14 19:34:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:18.409855 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa51d5-b997-495e-9251-1d63302c2f34 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:18.450257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b3c20-d85d-4f4e-9188-15114eadb9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:18.451065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b3c20-d85d-4f4e-9188-15114eadb9ad None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:18.451446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b3c20-d85d-4f4e-9188-15114eadb9ad None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:18.451874 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b3c20-d85d-4f4e-9188-15114eadb9ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:18.464602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b3c20-d85d-4f4e-9188-15114eadb9ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:18.466230 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b3c20-d85d-4f4e-9188-15114eadb9ad None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:18.483328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-790b3c20-d85d-4f4e-9188-15114eadb9ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:18.483328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:18.483328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:18.483328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:18.483328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:18.483328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:18.483328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:18.483328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:18.483328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:18.483328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:18.483328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:18.483328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:18.483328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:18.483328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:18.483328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:18.483328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:18.484490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:18.484490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:18.484490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:18.484490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:18.484490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:18.484490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:18.484490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:18.484490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:18.484490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:18.484490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:18.484490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:18.484490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:18.484490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:18.484490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:18.484490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:18.484490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:18.484490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:18.485410 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:18.485410 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:18.485410 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:18.486159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 268/527] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:18.490901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b3c20-d85d-4f4e-9188-15114eadb9ad None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:18.547472 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa51d5-b997-495e-9251-1d63302c2f34 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:18.577924 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:18.592095 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eea953-f6c9-4a47-8f4f-a04db69238c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:18.593148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eea953-f6c9-4a47-8f4f-a04db69238c8 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:18.593431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eea953-f6c9-4a47-8f4f-a04db69238c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:18.593741 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eea953-f6c9-4a47-8f4f-a04db69238c8 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:18.594653 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eea953-f6c9-4a47-8f4f-a04db69238c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:18.594998 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eea953-f6c9-4a47-8f4f-a04db69238c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:18.596964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eea953-f6c9-4a47-8f4f-a04db69238c8 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:18.612831 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 260/528] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:18.613721 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eea953-f6c9-4a47-8f4f-a04db69238c8 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:18.615053 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b3c20-d85d-4f4e-9188-15114eadb9ad None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:18.654405 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986fcd7-ee79-4320-92e7-9548b6cd296e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:18.655170 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986fcd7-ee79-4320-92e7-9548b6cd296e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:18.655569 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986fcd7-ee79-4320-92e7-9548b6cd296e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:18.655957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986fcd7-ee79-4320-92e7-9548b6cd296e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:18.657480 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:18.734635 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986fcd7-ee79-4320-92e7-9548b6cd296e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:18.736303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986fcd7-ee79-4320-92e7-9548b6cd296e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:18.745840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eea953-f6c9-4a47-8f4f-a04db69238c8 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:18.783678 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86ffd7-790e-40db-959f-39a049b5dd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:18.784337 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86ffd7-790e-40db-959f-39a049b5dd06 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:18.784617 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86ffd7-790e-40db-959f-39a049b5dd06 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:18.784985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86ffd7-790e-40db-959f-39a049b5dd06 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:18.785637 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86ffd7-790e-40db-959f-39a049b5dd06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:18.785938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86ffd7-790e-40db-959f-39a049b5dd06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:18.787399 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86ffd7-790e-40db-959f-39a049b5dd06 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:18.801569 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 261/529] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:18.802432 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86ffd7-790e-40db-959f-39a049b5dd06 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:18.821921 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:18.855076 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 269/530] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:34:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:34:18.856329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986fcd7-ee79-4320-92e7-9548b6cd296e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:18.928449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:18.938154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86ffd7-790e-40db-959f-39a049b5dd06 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:18.968236 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986fcd7-ee79-4320-92e7-9548b6cd296e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:18.989587 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d6467-292e-4625-a727-98216e752fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:18.991287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d6467-292e-4625-a727-98216e752fa6 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:18.991744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d6467-292e-4625-a727-98216e752fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:18.992157 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d6467-292e-4625-a727-98216e752fa6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:19.003497 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d6467-292e-4625-a727-98216e752fa6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:19.005148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d6467-292e-4625-a727-98216e752fa6 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:19.006982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bcfd6-f920-48c4-b54b-7e7a7648d194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:19.007806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bcfd6-f920-48c4-b54b-7e7a7648d194 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:19.008250 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bcfd6-f920-48c4-b54b-7e7a7648d194 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:19.008543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bcfd6-f920-48c4-b54b-7e7a7648d194 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:19.015565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bcfd6-f920-48c4-b54b-7e7a7648d194 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:19.017557 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bcfd6-f920-48c4-b54b-7e7a7648d194 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:19.020537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-611d6467-292e-4625-a727-98216e752fa6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:19.020537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:19.020537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:19.020537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:19.020537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:19.020537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:19.020537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:19.020537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:19.020537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:19.020537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:19.020537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:19.020537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:19.020537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:19.020537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:19.020537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:19.021528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:19.021528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:19.021528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:19.021528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:19.021528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:19.021528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:19.021528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:19.021528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:19.021528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:19.021528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:19.021528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:19.021528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:19.021528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:19.021528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:19.021528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:19.021528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:19.021528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:19.022579 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:19.022579 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:19.022579 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:19.022579 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:19.022579 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:19.022579 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:19.022579 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:19.022579 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:19.024606 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 262/531] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:19.025990 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d6467-292e-4625-a727-98216e752fa6 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:19.032437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-f79bcfd6-f920-48c4-b54b-7e7a7648d194 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:19.032437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:19.032437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:19.032437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:19.032437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:19.032437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:19.032437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:19.032437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:19.032437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:19.032437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:19.032437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:19.032437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:19.032437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:19.032437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:19.032437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:19.034088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:19.034088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:19.034088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:19.034088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:19.034088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:19.034088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:19.034088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:19.034088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:19.034088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:19.034088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:19.034088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:19.034088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:19.034088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:19.034088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:19.034088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:19.034088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:19.034088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:19.035141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:19.035141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:19.035141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:19.035141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:19.035141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:19.035141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:19.035141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:19.035141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:19.036256 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 270/532] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:19.037202 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bcfd6-f920-48c4-b54b-7e7a7648d194 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:19.070570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:19.156918 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d6467-292e-4625-a727-98216e752fa6 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:19.167598 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bcfd6-f920-48c4-b54b-7e7a7648d194 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:19.201411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e40bfc-d7c1-41ef-9dc6-f56027215c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:19.202904 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e40bfc-d7c1-41ef-9dc6-f56027215c38 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:19.203670 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e40bfc-d7c1-41ef-9dc6-f56027215c38 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:19.204128 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e40bfc-d7c1-41ef-9dc6-f56027215c38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:19.213478 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a774f76-f256-41ad-aa02-6ca104fb9af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:19.214713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a774f76-f256-41ad-aa02-6ca104fb9af6 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:19.214713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a774f76-f256-41ad-aa02-6ca104fb9af6 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:19.215149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a774f76-f256-41ad-aa02-6ca104fb9af6 None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:19.215951 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a774f76-f256-41ad-aa02-6ca104fb9af6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:19.216338 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a774f76-f256-41ad-aa02-6ca104fb9af6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:19.217849 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a774f76-f256-41ad-aa02-6ca104fb9af6 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:19.219809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e40bfc-d7c1-41ef-9dc6-f56027215c38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:19.222084 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e40bfc-d7c1-41ef-9dc6-f56027215c38 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:19.230275 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 271/533] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:19.231235 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a774f76-f256-41ad-aa02-6ca104fb9af6 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:19.244234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-87e40bfc-d7c1-41ef-9dc6-f56027215c38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:19.244234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:19.244234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:19.244234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:19.244234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:19.244234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:19.244234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:19.244234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:19.244234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:19.244234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:19.244234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:19.244234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:19.244234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:19.244234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:19.244234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:19.244234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:19.245114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:19.245114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:19.245114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:19.245114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:19.245114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:19.245114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:19.245114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:19.245114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:19.245114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:19.245114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:19.245114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:19.245114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:19.245114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:19.245114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:19.245114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:19.245114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:19.245114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:19.246546 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:19.246546 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:19.246546 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:19.246546 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 263/534] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:19.246546 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e40bfc-d7c1-41ef-9dc6-f56027215c38 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:19.255734 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:19.339907 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:19.354944 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a774f76-f256-41ad-aa02-6ca104fb9af6 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:19.398154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e40bfc-d7c1-41ef-9dc6-f56027215c38 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:19.402726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2f901-b704-49f5-b8ef-3789466d7755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:19.403340 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2f901-b704-49f5-b8ef-3789466d7755 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:19.403644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2f901-b704-49f5-b8ef-3789466d7755 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:19.403916 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2f901-b704-49f5-b8ef-3789466d7755 None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:19.404599 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2f901-b704-49f5-b8ef-3789466d7755 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:19.404900 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2f901-b704-49f5-b8ef-3789466d7755 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:19.406306 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2f901-b704-49f5-b8ef-3789466d7755 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:19.423629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 272/535] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:19.424687 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2f901-b704-49f5-b8ef-3789466d7755 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:19.438066 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4656fa-1718-4bbf-bc00-9e3f5f0a40f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:19.439943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4656fa-1718-4bbf-bc00-9e3f5f0a40f5 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:19.440497 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4656fa-1718-4bbf-bc00-9e3f5f0a40f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:19.440984 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4656fa-1718-4bbf-bc00-9e3f5f0a40f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:19.441976 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4656fa-1718-4bbf-bc00-9e3f5f0a40f5 None admin] RBAC: Adding query filter params (role.id=b2e8ea485659485f92e729741880d447, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=a2faa7ffc99948478ec7b81842139078) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:19.442489 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4656fa-1718-4bbf-bc00-9e3f5f0a40f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:19.444389 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4656fa-1718-4bbf-bc00-9e3f5f0a40f5 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:19.450611 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 264/536] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:34:19 2022] GET /identity/v3/role_assignments?user.id=a2faa7ffc99948478ec7b81842139078&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=b2e8ea485659485f92e729741880d447 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:19.451711 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4656fa-1718-4bbf-bc00-9e3f5f0a40f5 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:19.539320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:19.574020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4656fa-1718-4bbf-bc00-9e3f5f0a40f5 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:19.605985 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2f901-b704-49f5-b8ef-3789466d7755 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:19.614230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a1c78-6038-4a2f-80b0-fc1e1582c58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:19.615228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a1c78-6038-4a2f-80b0-fc1e1582c58d None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:19.615758 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a1c78-6038-4a2f-80b0-fc1e1582c58d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:19.616252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a1c78-6038-4a2f-80b0-fc1e1582c58d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:19.617219 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a1c78-6038-4a2f-80b0-fc1e1582c58d None admin] RBAC: Adding query filter params (role.id=b2e8ea485659485f92e729741880d447, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=fe18c9b67d814fbba4614cf7491e136e) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:19.617775 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a1c78-6038-4a2f-80b0-fc1e1582c58d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:19.619503 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a1c78-6038-4a2f-80b0-fc1e1582c58d None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:19.626228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 265/537] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:34:19 2022] GET /identity/v3/role_assignments?user.id=fe18c9b67d814fbba4614cf7491e136e&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=b2e8ea485659485f92e729741880d447 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:19.670267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c38c6-0a4d-460b-a6ca-ba73326d3a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:19.671304 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c38c6-0a4d-460b-a6ca-ba73326d3a4e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:19.671854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c38c6-0a4d-460b-a6ca-ba73326d3a4e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:19.672346 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c38c6-0a4d-460b-a6ca-ba73326d3a4e None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:19.673477 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c38c6-0a4d-460b-a6ca-ba73326d3a4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:19.674162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c38c6-0a4d-460b-a6ca-ba73326d3a4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:19.678770 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c38c6-0a4d-460b-a6ca-ba73326d3a4e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:19.693005 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 273/538] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:19.699038 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a1c78-6038-4a2f-80b0-fc1e1582c58d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:19.819849 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a1c78-6038-4a2f-80b0-fc1e1582c58d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:19.858163 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71090f-c511-44e9-8e7f-5fa64a880b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:19.859151 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71090f-c511-44e9-8e7f-5fa64a880b79 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:19.859674 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71090f-c511-44e9-8e7f-5fa64a880b79 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:19.860165 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71090f-c511-44e9-8e7f-5fa64a880b79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:19.863400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:19.869082 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71090f-c511-44e9-8e7f-5fa64a880b79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:19.870795 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71090f-c511-44e9-8e7f-5fa64a880b79 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:19.883920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-0b71090f-c511-44e9-8e7f-5fa64a880b79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:19.883920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:19.883920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:19.883920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:19.883920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:19.883920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:19.883920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:19.883920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:19.883920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:19.883920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:19.883920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:19.883920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:19.883920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:19.883920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:19.883920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:19.884832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:19.884832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:19.884832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:19.884832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:19.884832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:19.884832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:19.884832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:19.884832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:19.884832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:19.884832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:19.884832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:19.884832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:19.884832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:19.884832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:19.884832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:19.884832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:19.884832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:19.885709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:19.885709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:19.885709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:19.885709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:19.885709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:19.885709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:19.885709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:19.885709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:19.885709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 266/539] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:19.891787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c38c6-0a4d-460b-a6ca-ba73326d3a4e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:19.909551 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:20.030076 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c38c6-0a4d-460b-a6ca-ba73326d3a4e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:20.075989 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f1c89-8b8a-48f1-b17a-b57dace50efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:20.076996 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f1c89-8b8a-48f1-b17a-b57dace50efe None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:20.077479 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f1c89-8b8a-48f1-b17a-b57dace50efe None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:20.077953 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f1c89-8b8a-48f1-b17a-b57dace50efe None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:20.078837 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f1c89-8b8a-48f1-b17a-b57dace50efe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:20.079360 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f1c89-8b8a-48f1-b17a-b57dace50efe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:20.081528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f1c89-8b8a-48f1-b17a-b57dace50efe None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:20.098516 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 274/540] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:20.104646 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71090f-c511-44e9-8e7f-5fa64a880b79 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:20.237845 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71090f-c511-44e9-8e7f-5fa64a880b79 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:20.288064 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57658140-6397-44c7-9a61-ec428aa1bfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:20.289074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57658140-6397-44c7-9a61-ec428aa1bfdc None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:20.289546 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57658140-6397-44c7-9a61-ec428aa1bfdc None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:20.290039 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57658140-6397-44c7-9a61-ec428aa1bfdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:20.290968 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57658140-6397-44c7-9a61-ec428aa1bfdc None admin] RBAC: Adding query filter params (role.id=b2e8ea485659485f92e729741880d447, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=221300017882415ca3a7c9192343b956) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:20.291476 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57658140-6397-44c7-9a61-ec428aa1bfdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:20.293310 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57658140-6397-44c7-9a61-ec428aa1bfdc None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:20.303841 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 267/541] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:34:20 2022] GET /identity/v3/role_assignments?user.id=221300017882415ca3a7c9192343b956&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=b2e8ea485659485f92e729741880d447 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:20.716808 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af1c9f-54d1-4c1c-a8e2-60e3d7d713a3 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:20.717194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af1c9f-54d1-4c1c-a8e2-60e3d7d713a3 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:20.717388 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af1c9f-54d1-4c1c-a8e2-60e3d7d713a3 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:20.718951 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 275/542] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:20.725059 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c3719-4592-4a0a-ab50-c321253b9776 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:20.725344 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c3719-4592-4a0a-ab50-c321253b9776 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:20.725619 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c3719-4592-4a0a-ab50-c321253b9776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:20.752542 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-850c3719-4592-4a0a-ab50-c321253b9776 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:20.753773 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-850c3719-4592-4a0a-ab50-c321253b9776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:20.771516 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95e389-de56-4d80-9f40-8d34a0cd0ced None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:20.771873 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95e389-de56-4d80-9f40-8d34a0cd0ced None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:20.772184 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95e389-de56-4d80-9f40-8d34a0cd0ced None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:20.773568 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 276/543] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:34:20.789836 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6be4a-ea7c-447e-a021-d77632699419 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:20.790141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6be4a-ea7c-447e-a021-d77632699419 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:20.790382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6be4a-ea7c-447e-a021-d77632699419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:20.817388 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-4fe6be4a-ea7c-447e-a021-d77632699419 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:20.821426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4fe6be4a-ea7c-447e-a021-d77632699419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:20.889416 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:20.907051 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 268/544] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:20.924138 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:20.933190 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 277/545] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:21.205913 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c3719-4592-4a0a-ab50-c321253b9776 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:21.309723 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6be4a-ea7c-447e-a021-d77632699419 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:21.332043 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c3719-4592-4a0a-ab50-c321253b9776 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:21.379566 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ffdfb-23f4-47d9-b833-f0dcb8f54eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:21.379566 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ffdfb-23f4-47d9-b833-f0dcb8f54eb2 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:21.379566 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ffdfb-23f4-47d9-b833-f0dcb8f54eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:21.379566 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ffdfb-23f4-47d9-b833-f0dcb8f54eb2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:21.387095 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ffdfb-23f4-47d9-b833-f0dcb8f54eb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:21.392926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-6f4ffdfb-23f4-47d9-b833-f0dcb8f54eb2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:21.392926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:21.392926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:21.392926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:21.392926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:21.392926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:21.392926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:21.392926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:21.392926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:21.392926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:21.392926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:21.392926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:21.392926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:21.392926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:21.392926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:21.392926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:21.393816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:21.393816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:21.393816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:21.393816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:21.393816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:21.393816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:21.393816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:21.393816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:21.393816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:21.393816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:21.393816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:21.393816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:21.393816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:21.393816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:21.393816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:21.393816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:21.394615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:21.394615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:21.394615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:21.394615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:21.394615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:21.394615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:21.394615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:21.394615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:21.394615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:21.394615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:21.394615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:21.394615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:21.394615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 269/546] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:34:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:21.408333 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ffdfb-23f4-47d9-b833-f0dcb8f54eb2 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:21.489408 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:21.537044 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6be4a-ea7c-447e-a021-d77632699419 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:21.578645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31504a1-a0bf-448f-b2d8-fa4549f8b586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:21.579296 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31504a1-a0bf-448f-b2d8-fa4549f8b586 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:21.579586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31504a1-a0bf-448f-b2d8-fa4549f8b586 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:21.580558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31504a1-a0bf-448f-b2d8-fa4549f8b586 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:21.593833 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ffdfb-23f4-47d9-b833-f0dcb8f54eb2 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:21.605862 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31504a1-a0bf-448f-b2d8-fa4549f8b586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:21.613136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-c31504a1-a0bf-448f-b2d8-fa4549f8b586 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:21.613136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:21.613136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:21.613136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:21.613136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:21.613136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:21.613136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:21.613136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:21.613136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:21.613136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:21.613136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:21.613136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:21.613136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:21.613136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:21.613136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:21.613136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:21.614096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:21.614096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:21.614096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:21.614096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:21.614096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:21.614096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:21.614096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:21.614096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:21.614096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:21.614096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:21.614096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:21.614096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:21.614096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:21.614096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:21.614096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:21.614096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:21.615312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:21.615312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:21.615312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:21.615312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:21.615312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:21.615312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:21.615312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:21.615312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:21.615312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:21.615312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:21.615312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:21.615312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:21.615312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 278/547] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:34:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:21.624312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31504a1-a0bf-448f-b2d8-fa4549f8b586 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:21.666504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22011e3-28b1-42c7-b2d7-63113052e48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:21.667115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22011e3-28b1-42c7-b2d7-63113052e48c None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:21.667385 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22011e3-28b1-42c7-b2d7-63113052e48c None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:21.667686 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22011e3-28b1-42c7-b2d7-63113052e48c None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:21.668357 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22011e3-28b1-42c7-b2d7-63113052e48c None admin] RBAC: Adding query filter params (name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:21.668656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22011e3-28b1-42c7-b2d7-63113052e48c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:21.670021 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22011e3-28b1-42c7-b2d7-63113052e48c None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:21.691781 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 270/548] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Sep 14 19:34:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:21.713375 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22011e3-28b1-42c7-b2d7-63113052e48c None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:21.735994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:21.812927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31504a1-a0bf-448f-b2d8-fa4549f8b586 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:21.883598 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f8e29-c5fa-4aad-96fa-91a8fd9a081a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:21.884223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f8e29-c5fa-4aad-96fa-91a8fd9a081a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:21.884503 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f8e29-c5fa-4aad-96fa-91a8fd9a081a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:21.884776 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f8e29-c5fa-4aad-96fa-91a8fd9a081a None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:21.885445 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f8e29-c5fa-4aad-96fa-91a8fd9a081a None admin] RBAC: Adding query filter params (name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:21.885749 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f8e29-c5fa-4aad-96fa-91a8fd9a081a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:21.888756 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f8e29-c5fa-4aad-96fa-91a8fd9a081a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:21.897609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22011e3-28b1-42c7-b2d7-63113052e48c None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:21.909257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 279/549] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Sep 14 19:34:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:21.915051 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f8e29-c5fa-4aad-96fa-91a8fd9a081a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:21.919145 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:21.961955 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195be79-1602-4773-b150-dbfaf550123b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:21.962954 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195be79-1602-4773-b150-dbfaf550123b None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:21.963460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195be79-1602-4773-b150-dbfaf550123b None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:21.964007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195be79-1602-4773-b150-dbfaf550123b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:21.976943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195be79-1602-4773-b150-dbfaf550123b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:21.978832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195be79-1602-4773-b150-dbfaf550123b None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:21.995050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-f195be79-1602-4773-b150-dbfaf550123b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:21.995050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:21.995050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:21.995050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:21.995050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:21.995050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:21.995050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:21.995050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:21.995050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:21.995050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:21.995050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:21.995050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:21.995050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:21.995050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:21.995050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:21.995050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:21.996056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:21.996056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:21.996056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:21.996056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:21.996056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:21.996056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:21.996056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:21.996056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:21.996056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:21.996056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:21.996056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:21.996056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:21.996056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:21.996056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:21.996056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:21.996056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:21.996056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:21.997087 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:21.997087 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:21.997087 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:21.999316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 271/550] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:22.011824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195be79-1602-4773-b150-dbfaf550123b None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:22.056537 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f8e29-c5fa-4aad-96fa-91a8fd9a081a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:22.102744 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:22.118591 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8c983-e9b5-4e18-b4e8-6f92e5672657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:22.119229 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8c983-e9b5-4e18-b4e8-6f92e5672657 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:22.119505 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8c983-e9b5-4e18-b4e8-6f92e5672657 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:22.119800 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8c983-e9b5-4e18-b4e8-6f92e5672657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:22.139022 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8c983-e9b5-4e18-b4e8-6f92e5672657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:22.143411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8c983-e9b5-4e18-b4e8-6f92e5672657 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:22.168008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-0ee8c983-e9b5-4e18-b4e8-6f92e5672657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:22.168008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:22.168008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:22.168008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:22.168008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:22.168008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:22.168008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:22.168008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:22.168008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:22.168008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:22.168008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:22.168008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:22.168008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:22.168008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:22.168008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:22.168008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:22.168988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:22.168988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:22.168988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:22.168988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:22.168988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:22.168988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:22.168988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:22.168988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:22.168988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:22.168988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:22.168988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:22.168988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:22.168988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:22.168988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:22.168988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:22.168988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:22.168988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:22.169853 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:22.169853 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:22.169853 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:22.169853 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 280/551] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:22.170942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b7659-cf21-4944-bde4-19ea5972c003 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:22.170942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b7659-cf21-4944-bde4-19ea5972c003 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:22.171209 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b7659-cf21-4944-bde4-19ea5972c003 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:22.177607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 281/552] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:22.178460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b7659-cf21-4944-bde4-19ea5972c003 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:22.188857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195be79-1602-4773-b150-dbfaf550123b None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:22.235819 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd38a6d-a2d9-4236-8c64-234d2a9acb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:22.237096 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd38a6d-a2d9-4236-8c64-234d2a9acb8c None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:22.237388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd38a6d-a2d9-4236-8c64-234d2a9acb8c None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:22.237648 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd38a6d-a2d9-4236-8c64-234d2a9acb8c None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:22.238861 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd38a6d-a2d9-4236-8c64-234d2a9acb8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:22.239390 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd38a6d-a2d9-4236-8c64-234d2a9acb8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:22.241245 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd38a6d-a2d9-4236-8c64-234d2a9acb8c None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:22.260773 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 272/553] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:22.262120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a061e-2ee6-4d95-a9c7-823ebc27a3c0 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:22.262471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a061e-2ee6-4d95-a9c7-823ebc27a3c0 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:22.262747 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a061e-2ee6-4d95-a9c7-823ebc27a3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:22.284431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-806a061e-2ee6-4d95-a9c7-823ebc27a3c0 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:22.285770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-806a061e-2ee6-4d95-a9c7-823ebc27a3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:22.302598 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b7659-cf21-4944-bde4-19ea5972c003 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:22.312430 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:22.344829 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78879d-8768-413b-8dd7-61fe07648983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:22.346158 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78879d-8768-413b-8dd7-61fe07648983 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:22.346330 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78879d-8768-413b-8dd7-61fe07648983 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:22.346628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78879d-8768-413b-8dd7-61fe07648983 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:22.347520 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78879d-8768-413b-8dd7-61fe07648983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:22.347851 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78879d-8768-413b-8dd7-61fe07648983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:22.349285 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78879d-8768-413b-8dd7-61fe07648983 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:22.363579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 282/555] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:22.363970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 273/555] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:22.369068 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a061e-2ee6-4d95-a9c7-823ebc27a3c0 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:22.375362 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78879d-8768-413b-8dd7-61fe07648983 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:22.424128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:22.489270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a061e-2ee6-4d95-a9c7-823ebc27a3c0 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:22.501147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78879d-8768-413b-8dd7-61fe07648983 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:22.526828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de7a49-7510-49b6-98ce-c9764a8b5499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:22.527745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de7a49-7510-49b6-98ce-c9764a8b5499 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:22.528221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de7a49-7510-49b6-98ce-c9764a8b5499 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:22.528561 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de7a49-7510-49b6-98ce-c9764a8b5499 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:22.538919 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de7a49-7510-49b6-98ce-c9764a8b5499 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:22.540340 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cce5d-2eb8-4def-baa6-96d086d39d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:22.540487 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de7a49-7510-49b6-98ce-c9764a8b5499 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:22.541325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cce5d-2eb8-4def-baa6-96d086d39d7e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:22.541788 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cce5d-2eb8-4def-baa6-96d086d39d7e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:22.542229 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cce5d-2eb8-4def-baa6-96d086d39d7e None admin] PATH_INFO: `/v3/users/nova` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:22.554613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945cce5d-2eb8-4def-baa6-96d086d39d7e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:22.556447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945cce5d-2eb8-4def-baa6-96d086d39d7e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:22.559101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-15de7a49-7510-49b6-98ce-c9764a8b5499 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 19:34:22.559101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:22.559101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:22.559101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:22.559101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:22.559101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:22.559101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:22.559101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:22.559101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:22.559101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:22.559101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:22.559101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:22.559101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:22.559101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:22.559101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:22.559101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:22.560050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:22.560050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:22.560050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:22.560050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:22.560050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:22.560050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:22.560050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:22.560050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:22.560050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:22.560050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:22.560050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:22.560050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:22.560050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:22.560050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:22.560050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:22.560050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:22.560050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:22.560050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:22.560996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:22.560996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:22.560996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:22.560996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:22.560996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:22.560996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:22.560996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:22.560996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:22.560996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 19:34:22.560996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:22.563686 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 274/556] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:34:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:22.565272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe5990-7a22-426c-8407-d85b324069aa None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:22.565728 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe5990-7a22-426c-8407-d85b324069aa None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:22.566187 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe5990-7a22-426c-8407-d85b324069aa None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:22.568350 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 275/557] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:22.569370 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe5990-7a22-426c-8407-d85b324069aa None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:22.585119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-945cce5d-2eb8-4def-baa6-96d086d39d7e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 19:34:22.585119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:22.585119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:22.585119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:22.585119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:22.585119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:22.585119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:22.585119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:22.585119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:22.585119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:22.585119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:22.585119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:22.585119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:22.585119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:22.585119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:22.585119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:22.586590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:22.586590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:22.586590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:22.586590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:22.586590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:22.586590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:22.586590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:22.586590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:22.586590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:22.586590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:22.586590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:22.586590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:22.586590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:22.586590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:22.586590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:22.586590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:22.586590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:22.586590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:22.587508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:22.587508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:22.587508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:22.587508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:22.587508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:22.587508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:22.587508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:22.587508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:22.587508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 19:34:22.587508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:22.589663 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:22.591100 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 283/558] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Sep 14 19:34:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:22.592481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51c85f-c0e1-4f00-bcba-e035d17d6193 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:22.592833 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51c85f-c0e1-4f00-bcba-e035d17d6193 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:22.593175 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51c85f-c0e1-4f00-bcba-e035d17d6193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:22.619845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-df51c85f-c0e1-4f00-bcba-e035d17d6193 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:22.621158 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-df51c85f-c0e1-4f00-bcba-e035d17d6193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:22.691752 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe5990-7a22-426c-8407-d85b324069aa None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:22.696809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 284/559] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:22.697587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51c85f-c0e1-4f00-bcba-e035d17d6193 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:22.724915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:22.742976 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f2bd8-4d2c-4115-9625-392dbf674b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:22.743951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f2bd8-4d2c-4115-9625-392dbf674b8b None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:22.744458 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f2bd8-4d2c-4115-9625-392dbf674b8b None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:22.744951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f2bd8-4d2c-4115-9625-392dbf674b8b None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:22.745899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f2bd8-4d2c-4115-9625-392dbf674b8b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:22.746411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f2bd8-4d2c-4115-9625-392dbf674b8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:22.748079 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f2bd8-4d2c-4115-9625-392dbf674b8b None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:22.769905 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 276/560] 10.222.0.15 () {56 vars in 1135 bytes} [Wed Sep 14 19:34:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:22.771224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f2bd8-4d2c-4115-9625-392dbf674b8b None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:22.807319 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51c85f-c0e1-4f00-bcba-e035d17d6193 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:22.844965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df242800-f515-4fe6-9735-884e7a64e235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:22.846324 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df242800-f515-4fe6-9735-884e7a64e235 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:22.846622 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df242800-f515-4fe6-9735-884e7a64e235 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:22.846896 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df242800-f515-4fe6-9735-884e7a64e235 None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:22.847654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df242800-f515-4fe6-9735-884e7a64e235 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:22.847961 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df242800-f515-4fe6-9735-884e7a64e235 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:22.849399 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df242800-f515-4fe6-9735-884e7a64e235 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:22.852270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:22.869550 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 285/561] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Sep 14 19:34:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:22.871734 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df242800-f515-4fe6-9735-884e7a64e235 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:22.940415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f2bd8-4d2c-4115-9625-392dbf674b8b None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:22.984729 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a03e1-5875-4455-99db-a9d431415e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:22.985371 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a03e1-5875-4455-99db-a9d431415e2d None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:22.985651 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a03e1-5875-4455-99db-a9d431415e2d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:22.985923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a03e1-5875-4455-99db-a9d431415e2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:22.993305 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:22.997035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a03e1-5875-4455-99db-a9d431415e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:23.002195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-af9a03e1-5875-4455-99db-a9d431415e2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:23.002195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:23.002195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:23.002195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:23.002195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:23.002195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:23.002195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:23.002195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:23.002195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:23.002195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:23.002195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:23.002195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:23.002195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:23.002195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:23.002195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:23.002195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:23.007226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:23.007226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:23.007226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:23.007226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:23.007226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:23.007226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:23.007226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:23.007226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:23.007226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:23.007226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:23.007226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:23.007226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:23.007226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:23.007226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:23.007226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:23.007226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:23.008120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:23.008120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:23.008120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:23.008120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:23.008120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:23.008120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:23.008120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:23.008120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:23.008120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:23.008120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:23.008120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:23.008120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:23.008120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 277/562] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:34:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:23.008120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a03e1-5875-4455-99db-a9d431415e2d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:23.013204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df242800-f515-4fe6-9735-884e7a64e235 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:23.048659 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420cbce2-0874-41a4-a1b0-73ee3309ef6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:23.049400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cbce2-0874-41a4-a1b0-73ee3309ef6a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:23.049687 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cbce2-0874-41a4-a1b0-73ee3309ef6a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:23.049955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cbce2-0874-41a4-a1b0-73ee3309ef6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:23.101728 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a03e1-5875-4455-99db-a9d431415e2d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:23.115595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420cbce2-0874-41a4-a1b0-73ee3309ef6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:23.117029 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420cbce2-0874-41a4-a1b0-73ee3309ef6a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:23.130602 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:23.136176 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a457b-1c56-4319-bac8-5d039ce16f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:23.136803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a457b-1c56-4319-bac8-5d039ce16f9f None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:23.137083 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a457b-1c56-4319-bac8-5d039ce16f9f None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:23.137352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a457b-1c56-4319-bac8-5d039ce16f9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:23.147656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a457b-1c56-4319-bac8-5d039ce16f9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:23.149134 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a457b-1c56-4319-bac8-5d039ce16f9f None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:23.164680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-194a457b-1c56-4319-bac8-5d039ce16f9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:23.164680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:23.164680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:23.164680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:23.164680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:23.164680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:23.164680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:23.164680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:23.164680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:23.164680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:23.164680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:23.164680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:23.164680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:23.164680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:23.164680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:23.164680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:23.165608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:23.165608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:23.165608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:23.165608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:23.165608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:23.165608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:23.165608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:23.165608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:23.165608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:23.165608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:23.165608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:23.165608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:23.165608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:23.165608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:23.165608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:23.165608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:23.165608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:23.166459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:23.166459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:23.166459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:23.166459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 278/563] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:23.166689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a457b-1c56-4319-bac8-5d039ce16f9f None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:23.199097 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:23.217163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 286/564] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:34:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:34:23.218422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809e7c4-50af-4ef1-adcc-70414332f938 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:23.218751 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809e7c4-50af-4ef1-adcc-70414332f938 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:23.219089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809e7c4-50af-4ef1-adcc-70414332f938 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:23.221086 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 287/565] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:23.221561 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809e7c4-50af-4ef1-adcc-70414332f938 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:23.274184 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a457b-1c56-4319-bac8-5d039ce16f9f None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:23.307471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ab576-4728-4cb3-a5fa-ed3407685680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:23.308130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ab576-4728-4cb3-a5fa-ed3407685680 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:23.308409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ab576-4728-4cb3-a5fa-ed3407685680 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:23.308684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ab576-4728-4cb3-a5fa-ed3407685680 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:23.319753 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ab576-4728-4cb3-a5fa-ed3407685680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:23.321885 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809e7c4-50af-4ef1-adcc-70414332f938 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:23.325056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-483ab576-4728-4cb3-a5fa-ed3407685680 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:23.325056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:23.325056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:23.325056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:23.325056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:23.325056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:23.325056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:23.325056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:23.325056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:23.325056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:23.325056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:23.325056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:23.325056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:23.325056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:23.325056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:23.325056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:23.326005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:23.326005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:23.326005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:23.326005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:23.326005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:23.326005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:23.326005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:23.326005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:23.326005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:23.326005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:23.326005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:23.326005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:23.326005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:23.326005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:23.326005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:23.326005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:23.326837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:23.326837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:23.326837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:23.326837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:23.326837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:23.326837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:23.326837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:23.326837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:23.326837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:23.326837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:23.326837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:23.326837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:23.326837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 279/566] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:34:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:23.328011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ab576-4728-4cb3-a5fa-ed3407685680 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:23.356064 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d171de6-f5fa-4116-8a89-3e837067471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:23.356677 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d171de6-f5fa-4116-8a89-3e837067471c None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:23.356957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d171de6-f5fa-4116-8a89-3e837067471c None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:23.357362 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d171de6-f5fa-4116-8a89-3e837067471c None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:23.358028 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d171de6-f5fa-4116-8a89-3e837067471c None admin] RBAC: Adding query filter params (name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:23.358332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d171de6-f5fa-4116-8a89-3e837067471c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:23.359834 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d171de6-f5fa-4116-8a89-3e837067471c None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:23.367920 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 288/567] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Sep 14 19:34:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:23.368960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d171de6-f5fa-4116-8a89-3e837067471c None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:23.375802 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:23.417812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:23.434120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ab576-4728-4cb3-a5fa-ed3407685680 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:23.466628 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f80804-6a29-4020-9365-4fffa30b49c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:23.467232 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80804-6a29-4020-9365-4fffa30b49c6 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:23.467511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80804-6a29-4020-9365-4fffa30b49c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:23.467813 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80804-6a29-4020-9365-4fffa30b49c6 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:23.468457 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f80804-6a29-4020-9365-4fffa30b49c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:23.468760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f80804-6a29-4020-9365-4fffa30b49c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:23.470126 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f80804-6a29-4020-9365-4fffa30b49c6 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:23.471429 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d171de6-f5fa-4116-8a89-3e837067471c None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:23.482284 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 280/568] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:23.483442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce37816-cbf5-4fce-9703-87036c3c14ca None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:23.483754 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce37816-cbf5-4fce-9703-87036c3c14ca None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:23.484027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce37816-cbf5-4fce-9703-87036c3c14ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:23.502732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-1ce37816-cbf5-4fce-9703-87036c3c14ca None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:23.503955 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1ce37816-cbf5-4fce-9703-87036c3c14ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:23.505797 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f547f75-4169-4ae6-859c-7a0fb2842460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:23.506425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f547f75-4169-4ae6-859c-7a0fb2842460 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:23.506707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f547f75-4169-4ae6-859c-7a0fb2842460 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:23.506978 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f547f75-4169-4ae6-859c-7a0fb2842460 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:23.517215 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f547f75-4169-4ae6-859c-7a0fb2842460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:23.519350 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f547f75-4169-4ae6-859c-7a0fb2842460 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:23.534755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-4f547f75-4169-4ae6-859c-7a0fb2842460 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:23.534755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:23.534755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:23.534755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:23.534755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:23.534755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:23.534755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:23.534755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:23.534755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:23.534755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:23.534755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:23.534755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:23.534755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:23.534755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:23.534755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:23.534755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:23.535991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:23.535991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:23.535991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:23.535991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:23.535991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:23.535991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:23.535991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:23.535991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:23.535991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:23.535991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:23.535991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:23.535991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:23.535991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:23.535991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:23.535991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:23.535991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:23.535991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:23.536992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:23.536992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:23.536992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:23.537396 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 289/569] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:23.538579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f547f75-4169-4ae6-859c-7a0fb2842460 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:23.579266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 281/570] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:23.580265 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce37816-cbf5-4fce-9703-87036c3c14ca None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:23.614791 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:23.647152 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:23.656142 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f547f75-4169-4ae6-859c-7a0fb2842460 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:23.689582 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce37816-cbf5-4fce-9703-87036c3c14ca None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:23.691231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250445d3-f295-4e1f-8cfc-1280166e0c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:23.691883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250445d3-f295-4e1f-8cfc-1280166e0c43 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:23.692161 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250445d3-f295-4e1f-8cfc-1280166e0c43 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:23.692434 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250445d3-f295-4e1f-8cfc-1280166e0c43 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:23.693120 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250445d3-f295-4e1f-8cfc-1280166e0c43 None admin] RBAC: Adding query filter params (name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:23.693427 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250445d3-f295-4e1f-8cfc-1280166e0c43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:23.694785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250445d3-f295-4e1f-8cfc-1280166e0c43 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:23.703766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 290/571] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Sep 14 19:34:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:23.704730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250445d3-f295-4e1f-8cfc-1280166e0c43 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:23.726886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c45c0-cece-4b0f-840a-fe4f92105267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:23.727505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c45c0-cece-4b0f-840a-fe4f92105267 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:23.727820 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c45c0-cece-4b0f-840a-fe4f92105267 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:23.728089 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c45c0-cece-4b0f-840a-fe4f92105267 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:23.738897 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c45c0-cece-4b0f-840a-fe4f92105267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:23.740368 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c45c0-cece-4b0f-840a-fe4f92105267 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:23.754888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-c61c45c0-cece-4b0f-840a-fe4f92105267 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:23.754888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:23.754888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:23.754888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:23.754888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:23.754888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:23.754888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:23.754888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:23.754888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:23.754888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:23.754888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:23.754888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:23.754888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:23.754888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:23.754888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:23.754888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:23.755851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:23.755851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:23.755851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:23.755851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:23.755851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:23.755851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:23.755851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:23.755851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:23.755851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:23.755851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:23.755851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:23.755851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:23.755851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:23.755851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:23.755851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:23.755851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:23.755851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:23.757350 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:23.757350 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:23.757350 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:23.757350 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 282/572] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:23.757350 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c45c0-cece-4b0f-840a-fe4f92105267 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:23.821792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250445d3-f295-4e1f-8cfc-1280166e0c43 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:23.852838 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:23.857127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcba64b-243c-4e61-88f3-fb1268658932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:23.857959 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcba64b-243c-4e61-88f3-fb1268658932 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:23.858235 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcba64b-243c-4e61-88f3-fb1268658932 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:23.858504 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcba64b-243c-4e61-88f3-fb1268658932 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:23.865807 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcba64b-243c-4e61-88f3-fb1268658932 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:23.867226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcba64b-243c-4e61-88f3-fb1268658932 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:23.869575 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c45c0-cece-4b0f-840a-fe4f92105267 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:23.878773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-adcba64b-243c-4e61-88f3-fb1268658932 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:23.878773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:23.878773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:23.878773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:23.878773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:23.878773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:23.878773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:23.878773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:23.878773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:23.878773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:23.878773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:23.878773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:23.878773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:23.878773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:23.878773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:23.879801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:23.879801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:23.879801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:23.879801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:23.879801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:23.879801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:23.879801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:23.879801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:23.879801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:23.879801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:23.879801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:23.879801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:23.879801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:23.879801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:23.879801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:23.879801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:23.879801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:23.880691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:23.880691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:23.880691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:23.880691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:23.880691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:23.880691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:23.880691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:23.880691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:23.880691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 291/573] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:23.880691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcba64b-243c-4e61-88f3-fb1268658932 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:23.899625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:23.913427 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e1302-f4d9-4c57-b764-44506dcda54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:23.914043 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e1302-f4d9-4c57-b764-44506dcda54a None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:23.914323 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e1302-f4d9-4c57-b764-44506dcda54a None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:23.914595 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e1302-f4d9-4c57-b764-44506dcda54a None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:23.915242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e1302-f4d9-4c57-b764-44506dcda54a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:23.915567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e1302-f4d9-4c57-b764-44506dcda54a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:23.916973 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e1302-f4d9-4c57-b764-44506dcda54a None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:23.929460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 283/574] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:23.930330 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e1302-f4d9-4c57-b764-44506dcda54a None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:23.982573 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcba64b-243c-4e61-88f3-fb1268658932 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:24.015494 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307c182-05ff-4178-bedf-c083f80055f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:24.016148 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307c182-05ff-4178-bedf-c083f80055f8 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:24.016425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307c182-05ff-4178-bedf-c083f80055f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:24.016706 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307c182-05ff-4178-bedf-c083f80055f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:24.027468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307c182-05ff-4178-bedf-c083f80055f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:24.027613 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e1302-f4d9-4c57-b764-44506dcda54a None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:24.028959 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307c182-05ff-4178-bedf-c083f80055f8 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:24.044430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-1307c182-05ff-4178-bedf-c083f80055f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:24.044430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:24.044430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:24.044430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:24.044430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:24.044430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:24.044430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:24.044430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:24.044430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:24.044430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:24.044430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:24.044430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:24.044430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:24.044430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:24.044430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:24.044430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:24.045364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:24.045364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:24.045364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:24.045364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:24.045364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:24.045364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:24.045364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:24.045364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:24.045364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:24.045364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:24.045364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:24.045364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:24.045364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:24.045364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:24.045364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:24.045364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:24.045364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:24.046270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:24.046270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:24.046270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:24.046270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 292/575] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:24.046270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307c182-05ff-4178-bedf-c083f80055f8 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:24.061856 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0299e85-fc75-40aa-842e-62a8e894f972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:24.062460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0299e85-fc75-40aa-842e-62a8e894f972 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:24.062737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0299e85-fc75-40aa-842e-62a8e894f972 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:24.063002 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0299e85-fc75-40aa-842e-62a8e894f972 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:24.063672 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0299e85-fc75-40aa-842e-62a8e894f972 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:24.063972 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0299e85-fc75-40aa-842e-62a8e894f972 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:24.065393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0299e85-fc75-40aa-842e-62a8e894f972 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:24.076676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 284/576] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:24.077447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0299e85-fc75-40aa-842e-62a8e894f972 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:24.080710 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:24.118690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:24.150239 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307c182-05ff-4178-bedf-c083f80055f8 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:24.175805 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0299e85-fc75-40aa-842e-62a8e894f972 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:24.182815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf6674-eeb1-4715-876e-1103f8b5fa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:24.183455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf6674-eeb1-4715-876e-1103f8b5fa64 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:24.183762 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf6674-eeb1-4715-876e-1103f8b5fa64 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:24.184035 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf6674-eeb1-4715-876e-1103f8b5fa64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:24.194543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf6674-eeb1-4715-876e-1103f8b5fa64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:24.199802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-2abf6674-eeb1-4715-876e-1103f8b5fa64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:24.199802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:24.199802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:24.199802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:24.199802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:24.199802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:24.199802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:24.199802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:24.199802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:24.199802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:24.199802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:24.199802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:24.199802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:24.199802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:24.199802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:24.199802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:24.200683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:24.200683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:24.200683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:24.200683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:24.200683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:24.200683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:24.200683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:24.200683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:24.200683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:24.200683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:24.200683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:24.200683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:24.200683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:24.200683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:24.200683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:24.200683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:24.201540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:24.201540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:24.201540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:24.201540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:24.201540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:24.201540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:24.201540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:24.201540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:24.201540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:24.201540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:24.201540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:24.201540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:24.201540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 293/577] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:34:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:24.202210 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf6674-eeb1-4715-876e-1103f8b5fa64 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:24.215324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405c49b-f873-4e3c-a027-0942640dbb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:24.215963 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405c49b-f873-4e3c-a027-0942640dbb19 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:24.216251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405c49b-f873-4e3c-a027-0942640dbb19 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:24.216510 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405c49b-f873-4e3c-a027-0942640dbb19 None admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:24.217203 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405c49b-f873-4e3c-a027-0942640dbb19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:24.217514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405c49b-f873-4e3c-a027-0942640dbb19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:24.218948 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405c49b-f873-4e3c-a027-0942640dbb19 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:24.237389 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 285/578] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:24.237923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405c49b-f873-4e3c-a027-0942640dbb19 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:24.298356 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:24.304002 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf6674-eeb1-4715-876e-1103f8b5fa64 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:24.332420 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:24.337787 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405c49b-f873-4e3c-a027-0942640dbb19 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:24.337911 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea571a8-7bcb-467f-b9b7-003bee5c37a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:24.338459 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea571a8-7bcb-467f-b9b7-003bee5c37a5 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:24.338735 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea571a8-7bcb-467f-b9b7-003bee5c37a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:24.339001 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea571a8-7bcb-467f-b9b7-003bee5c37a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:24.345446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea571a8-7bcb-467f-b9b7-003bee5c37a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:24.347110 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea571a8-7bcb-467f-b9b7-003bee5c37a5 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:24.357994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-bea571a8-7bcb-467f-b9b7-003bee5c37a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:24.357994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:24.357994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:24.357994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:24.357994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:24.357994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:24.357994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:24.357994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:24.357994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:24.357994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:24.357994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:24.357994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:24.357994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:24.357994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:24.357994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:24.359485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:24.359485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:24.359485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:24.359485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:24.359485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:24.359485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:24.359485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:24.359485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:24.359485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:24.359485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:24.359485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:24.359485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:24.359485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:24.359485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:24.359485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:24.359485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:24.359485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:24.360644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:24.360644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:24.360644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:24.360644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:24.360644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:24.360644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:24.360644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:24.360644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:24.360644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 294/579] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:24.360644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea571a8-7bcb-467f-b9b7-003bee5c37a5 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:24.376534 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bb12d-e63c-4999-a1cd-c71639703e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:24.377252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bb12d-e63c-4999-a1cd-c71639703e82 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:24.377536 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bb12d-e63c-4999-a1cd-c71639703e82 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:24.377925 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bb12d-e63c-4999-a1cd-c71639703e82 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:24.378584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bb12d-e63c-4999-a1cd-c71639703e82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:24.378890 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bb12d-e63c-4999-a1cd-c71639703e82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:24.380297 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bb12d-e63c-4999-a1cd-c71639703e82 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:24.392086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 286/580] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:24.393627 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bb12d-e63c-4999-a1cd-c71639703e82 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:24.465181 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea571a8-7bcb-467f-b9b7-003bee5c37a5 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:24.491050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bb12d-e63c-4999-a1cd-c71639703e82 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:24.497754 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4525e-ef48-4f32-b9a7-cc7723b00f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:24.498379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4525e-ef48-4f32-b9a7-cc7723b00f79 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:24.498655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4525e-ef48-4f32-b9a7-cc7723b00f79 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:24.498926 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4525e-ef48-4f32-b9a7-cc7723b00f79 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:24.506193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4525e-ef48-4f32-b9a7-cc7723b00f79 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:24.507950 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4525e-ef48-4f32-b9a7-cc7723b00f79 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:24.514200 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:24.519311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-4db4525e-ef48-4f32-b9a7-cc7723b00f79 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 19:34:24.519311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:24.519311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:24.519311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:24.519311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:24.519311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:24.519311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:24.519311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:24.519311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:24.519311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:24.519311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:24.519311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:24.519311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:24.519311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:24.519311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:24.519311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:24.520385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:24.520385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:24.520385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:24.520385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:24.520385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:24.520385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:24.520385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:24.520385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:24.520385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:24.520385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:24.520385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:24.520385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:24.520385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:24.520385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:24.520385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:24.520385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:24.520385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:24.520385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:24.521348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:24.521348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:24.521348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:24.521348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:24.521348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:24.521348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:24.521348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:24.521348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:24.521348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 19:34:24.521348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:24.521348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 295/581] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:34:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:24.521954 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4525e-ef48-4f32-b9a7-cc7723b00f79 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:24.530261 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356d0a3-03cd-4037-981e-133e73862270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:24.538184 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356d0a3-03cd-4037-981e-133e73862270 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:24.538184 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356d0a3-03cd-4037-981e-133e73862270 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:24.538184 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356d0a3-03cd-4037-981e-133e73862270 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:24.538184 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356d0a3-03cd-4037-981e-133e73862270 None admin] RBAC: Adding query filter params (name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:24.538184 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356d0a3-03cd-4037-981e-133e73862270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:24.538184 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356d0a3-03cd-4037-981e-133e73862270 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:24.542370 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 287/582] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Sep 14 19:34:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:24.543154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356d0a3-03cd-4037-981e-133e73862270 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:24.574497 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:24.624339 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4525e-ef48-4f32-b9a7-cc7723b00f79 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:24.643033 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356d0a3-03cd-4037-981e-133e73862270 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:24.658824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaf24a-7cc8-41ee-81ff-be1e83766481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:24.659484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaf24a-7cc8-41ee-81ff-be1e83766481 None admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:24.659801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaf24a-7cc8-41ee-81ff-be1e83766481 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:24.660079 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaf24a-7cc8-41ee-81ff-be1e83766481 None admin] PATH_INFO: `/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/421f6cc846b342918a177d2794eb3db8/roles/b2e8ea485659485f92e729741880d447` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:24.674319 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaf24a-7cc8-41ee-81ff-be1e83766481 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e3e0c278ce94ce3a132496923eef365, user_id=421f6cc846b342918a177d2794eb3db8, role_id=b2e8ea485659485f92e729741880d447)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:24.675782 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaf24a-7cc8-41ee-81ff-be1e83766481 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:24.676577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f9cc0-721c-4c3f-8405-4fac77962d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:24.677184 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f9cc0-721c-4c3f-8405-4fac77962d8d None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:24.677465 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f9cc0-721c-4c3f-8405-4fac77962d8d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:24.677744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f9cc0-721c-4c3f-8405-4fac77962d8d None admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:24.678436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f9cc0-721c-4c3f-8405-4fac77962d8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:24.678746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f9cc0-721c-4c3f-8405-4fac77962d8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:24.680203 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f9cc0-721c-4c3f-8405-4fac77962d8d None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:24.692662 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 288/583] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:24.694763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f9cc0-721c-4c3f-8405-4fac77962d8d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:24.738277 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:24.756396 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 296/584] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:34:24 2022] PUT /identity/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/421f6cc846b342918a177d2794eb3db8/roles/b2e8ea485659485f92e729741880d447 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:34:24.757353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaf24a-7cc8-41ee-81ff-be1e83766481 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:24.799646 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f9cc0-721c-4c3f-8405-4fac77962d8d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:24.842395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11fe9a-2b79-4c04-a983-332f8b115007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:24.843040 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11fe9a-2b79-4c04-a983-332f8b115007 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:24.843316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11fe9a-2b79-4c04-a983-332f8b115007 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:24.843612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11fe9a-2b79-4c04-a983-332f8b115007 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:24.853860 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11fe9a-2b79-4c04-a983-332f8b115007 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:24.855357 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11fe9a-2b79-4c04-a983-332f8b115007 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:24.867760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-3a11fe9a-2b79-4c04-a983-332f8b115007 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 19:34:24.867760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:24.867760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:24.867760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:24.867760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:24.867760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:24.867760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:24.867760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:24.867760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:24.867760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:24.867760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:24.867760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:24.867760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:24.867760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:24.867760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:24.867760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:24.868794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:24.868794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:24.868794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:24.868794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:24.868794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:24.868794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:24.868794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:24.868794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:24.868794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:24.868794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:24.868794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:24.868794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:24.868794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:24.868794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:24.868794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:24.868794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:24.868794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:24.868794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:24.869730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:24.869730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:24.869730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:24.869730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:24.869730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:24.869730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:24.869730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:24.869730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:24.869730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 14 19:34:24.869730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:24.869730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 289/585] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:34:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:24.869730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11fe9a-2b79-4c04-a983-332f8b115007 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:24.886363 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:24.889388 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaf24a-7cc8-41ee-81ff-be1e83766481 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:24.936453 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440463f-8004-488a-865a-1927a42e3db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:24.937091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440463f-8004-488a-865a-1927a42e3db9 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:24.937374 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440463f-8004-488a-865a-1927a42e3db9 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:24.937648 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440463f-8004-488a-865a-1927a42e3db9 None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:24.938409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440463f-8004-488a-865a-1927a42e3db9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:24.938718 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440463f-8004-488a-865a-1927a42e3db9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:24.941796 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440463f-8004-488a-865a-1927a42e3db9 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:24.961639 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 297/586] 10.222.0.15 () {56 vars in 1137 bytes} [Wed Sep 14 19:34:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:24.962486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440463f-8004-488a-865a-1927a42e3db9 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:24.997567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11fe9a-2b79-4c04-a983-332f8b115007 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:25.005380 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:25.033382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a0f69-a2f2-40ed-ab60-5076fa952a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:25.034103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a0f69-a2f2-40ed-ab60-5076fa952a01 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:25.034478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a0f69-a2f2-40ed-ab60-5076fa952a01 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:25.034850 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a0f69-a2f2-40ed-ab60-5076fa952a01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:25.045551 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a0f69-a2f2-40ed-ab60-5076fa952a01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:25.047112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a0f69-a2f2-40ed-ab60-5076fa952a01 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:25.061964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-7d1a0f69-a2f2-40ed-ab60-5076fa952a01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:25.061964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:25.061964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:25.061964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:25.061964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:25.061964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:25.061964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:25.061964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:25.061964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:25.061964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:25.061964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:25.061964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:25.061964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:25.061964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:25.061964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:25.061964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:25.063108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:25.063108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:25.063108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:25.063108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:25.063108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:25.063108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:25.063108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:25.063108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:25.063108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:25.063108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:25.063108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:25.063108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:25.063108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:25.063108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:25.063108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:25.063108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:25.063108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:25.064203 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:25.064203 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:25.064203 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:25.069745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 290/587] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:25.069745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a0f69-a2f2-40ed-ab60-5076fa952a01 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:25.075342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440463f-8004-488a-865a-1927a42e3db9 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:25.113916 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9cc33-2756-4285-ac6e-a39ef5cac01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:25.115200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9cc33-2756-4285-ac6e-a39ef5cac01a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:25.115683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9cc33-2756-4285-ac6e-a39ef5cac01a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:25.115968 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9cc33-2756-4285-ac6e-a39ef5cac01a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:25.116697 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9cc33-2756-4285-ac6e-a39ef5cac01a None admin] RBAC: Adding query filter params (role.id=b2e8ea485659485f92e729741880d447, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=ee56bf9af257486e94e6ff1b33086f23) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:25.117010 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9cc33-2756-4285-ac6e-a39ef5cac01a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:25.118505 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9cc33-2756-4285-ac6e-a39ef5cac01a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:25.131574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 298/588] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:34:24 2022] GET /identity/v3/role_assignments?user.id=ee56bf9af257486e94e6ff1b33086f23&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=b2e8ea485659485f92e729741880d447 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:25.131574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9cc33-2756-4285-ac6e-a39ef5cac01a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:25.158057 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:25.184709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a0f69-a2f2-40ed-ab60-5076fa952a01 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:25.229856 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea11706-bc71-425c-8e15-72f863b20d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:25.230505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea11706-bc71-425c-8e15-72f863b20d3c None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:25.230785 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea11706-bc71-425c-8e15-72f863b20d3c None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:25.231056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea11706-bc71-425c-8e15-72f863b20d3c None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:25.231838 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea11706-bc71-425c-8e15-72f863b20d3c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:25.232147 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea11706-bc71-425c-8e15-72f863b20d3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:25.233604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea11706-bc71-425c-8e15-72f863b20d3c None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:25.258203 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9cc33-2756-4285-ac6e-a39ef5cac01a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:25.259802 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 291/589] 10.222.0.15 () {56 vars in 1137 bytes} [Wed Sep 14 19:34:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:25.260830 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea11706-bc71-425c-8e15-72f863b20d3c None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:25.281617 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:25.305119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c41c21-6a3b-4b84-8993-3736a931f532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:25.305847 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c41c21-6a3b-4b84-8993-3736a931f532 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:25.306206 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c41c21-6a3b-4b84-8993-3736a931f532 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:25.306553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c41c21-6a3b-4b84-8993-3736a931f532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:25.323982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c41c21-6a3b-4b84-8993-3736a931f532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:25.326191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c41c21-6a3b-4b84-8993-3736a931f532 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:25.346439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-d7c41c21-6a3b-4b84-8993-3736a931f532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:25.346439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:25.346439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:25.346439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:25.346439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:25.346439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:25.346439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:25.346439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:25.346439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:25.346439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:25.346439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:25.346439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:25.346439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:25.346439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:25.346439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:25.346439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:25.347507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:25.347507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:25.347507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:25.347507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:25.347507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:25.347507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:25.347507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:25.347507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:25.347507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:25.347507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:25.347507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:25.347507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:25.347507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:25.347507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:25.347507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:25.347507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:25.347507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:25.348618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:25.348618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:25.348618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:25.348618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 299/590] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:25.348906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c41c21-6a3b-4b84-8993-3736a931f532 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:25.388593 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea11706-bc71-425c-8e15-72f863b20d3c None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:25.426428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c88900-1386-4d7b-93d6-2c1d0ef8e5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:25.427205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c88900-1386-4d7b-93d6-2c1d0ef8e5d9 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:25.427609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c88900-1386-4d7b-93d6-2c1d0ef8e5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:25.427988 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c88900-1386-4d7b-93d6-2c1d0ef8e5d9 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:25.428917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c88900-1386-4d7b-93d6-2c1d0ef8e5d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:25.429133 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c88900-1386-4d7b-93d6-2c1d0ef8e5d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:25.430602 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c88900-1386-4d7b-93d6-2c1d0ef8e5d9 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:25.448298 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 292/591] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:25.448298 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c88900-1386-4d7b-93d6-2c1d0ef8e5d9 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:25.459996 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:25.469472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c41c21-6a3b-4b84-8993-3736a931f532 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:25.506031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e0cf2-f555-4587-937d-d8a508003466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:25.506953 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e0cf2-f555-4587-937d-d8a508003466 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:25.507375 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e0cf2-f555-4587-937d-d8a508003466 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:25.507821 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e0cf2-f555-4587-937d-d8a508003466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:25.519826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e0cf2-f555-4587-937d-d8a508003466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:25.521492 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e0cf2-f555-4587-937d-d8a508003466 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:25.536428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:25.537942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-b76e0cf2-f555-4587-937d-d8a508003466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:25.537942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:25.537942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:25.537942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:25.537942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:25.537942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:25.537942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:25.537942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:25.537942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:25.537942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:25.537942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:25.537942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:25.537942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:25.537942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:25.537942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:25.537942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:25.539032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:25.539032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:25.539032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:25.539032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:25.539032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:25.539032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:25.539032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:25.539032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:25.539032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:25.539032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:25.539032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:25.539032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:25.539032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:25.539032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:25.539032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:25.539032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:25.539032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:25.540029 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:25.540029 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:25.540029 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:25.541993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 300/592] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:25.543029 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e0cf2-f555-4587-937d-d8a508003466 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:25.562661 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c88900-1386-4d7b-93d6-2c1d0ef8e5d9 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:25.607874 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa7d5f-1ab8-47f7-9247-3822b82b3458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:25.608550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa7d5f-1ab8-47f7-9247-3822b82b3458 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:25.608831 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa7d5f-1ab8-47f7-9247-3822b82b3458 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:25.609119 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa7d5f-1ab8-47f7-9247-3822b82b3458 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:25.609798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa7d5f-1ab8-47f7-9247-3822b82b3458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:25.610109 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa7d5f-1ab8-47f7-9247-3822b82b3458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:25.611625 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa7d5f-1ab8-47f7-9247-3822b82b3458 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:25.624774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 293/593] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:25.625639 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa7d5f-1ab8-47f7-9247-3822b82b3458 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:25.658831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e0cf2-f555-4587-937d-d8a508003466 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:25.686037 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:25.696198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428785f0-2f33-4c20-aef6-8f63ef279048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:25.697080 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428785f0-2f33-4c20-aef6-8f63ef279048 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:25.700740 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428785f0-2f33-4c20-aef6-8f63ef279048 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:25.700740 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428785f0-2f33-4c20-aef6-8f63ef279048 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:25.706812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428785f0-2f33-4c20-aef6-8f63ef279048 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:25.708675 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428785f0-2f33-4c20-aef6-8f63ef279048 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:25.721838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-428785f0-2f33-4c20-aef6-8f63ef279048 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 19:34:25.721838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:25.721838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:25.721838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:25.721838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:25.721838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:25.721838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:25.721838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:25.721838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:25.721838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:25.721838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:25.721838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:25.721838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:25.721838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:25.721838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:25.721838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:25.722806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:25.722806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:25.722806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:25.722806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:25.722806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:25.722806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:25.722806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:25.722806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:25.722806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:25.722806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:25.722806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:25.722806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:25.722806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:25.722806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:25.722806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:25.722806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:25.722806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:25.722806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:25.723765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:25.723765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:25.723765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:25.723765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:25.723765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:25.723765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:25.723765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:25.723765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:25.723765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 19:34:25.723765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:25.730798 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 301/594] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:34:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:25.731892 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428785f0-2f33-4c20-aef6-8f63ef279048 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:25.735428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa7d5f-1ab8-47f7-9247-3822b82b3458 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:25.771291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65279c5-aa7b-401c-8461-36d0b0ca336c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:25.771934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65279c5-aa7b-401c-8461-36d0b0ca336c None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:25.772215 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65279c5-aa7b-401c-8461-36d0b0ca336c None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:25.772485 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65279c5-aa7b-401c-8461-36d0b0ca336c None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:25.773133 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65279c5-aa7b-401c-8461-36d0b0ca336c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:25.773436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65279c5-aa7b-401c-8461-36d0b0ca336c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:25.774828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65279c5-aa7b-401c-8461-36d0b0ca336c None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:25.777590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:25.787517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 294/595] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:25.788358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65279c5-aa7b-401c-8461-36d0b0ca336c None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:25.843089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428785f0-2f33-4c20-aef6-8f63ef279048 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:25.881509 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86fdf9-efc3-4178-9d42-4a32c8b553cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:25.882636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86fdf9-efc3-4178-9d42-4a32c8b553cf None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:25.883129 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86fdf9-efc3-4178-9d42-4a32c8b553cf None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:25.883753 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86fdf9-efc3-4178-9d42-4a32c8b553cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:25.891413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86fdf9-efc3-4178-9d42-4a32c8b553cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:25.892432 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65279c5-aa7b-401c-8461-36d0b0ca336c None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:25.893958 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86fdf9-efc3-4178-9d42-4a32c8b553cf None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:25.906470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-8b86fdf9-efc3-4178-9d42-4a32c8b553cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:25.906470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:25.906470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:25.906470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:25.906470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:25.906470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:25.906470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:25.906470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:25.906470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:25.906470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:25.906470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:25.906470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:25.906470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:25.906470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:25.906470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:25.907368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:25.907368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:25.907368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:25.907368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:25.907368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:25.907368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:25.907368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:25.907368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:25.907368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:25.907368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:25.907368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:25.907368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:25.907368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:25.907368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:25.907368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:25.907368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:25.907368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:25.908364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:25.908364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:25.908364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:25.908364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:25.908364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:25.908364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:25.908364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:25.908364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:25.910800 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 302/596] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:25.911896 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86fdf9-efc3-4178-9d42-4a32c8b553cf None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:25.929566 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819939bd-b89c-4202-b77f-e8a90d3b8783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:25.930304 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819939bd-b89c-4202-b77f-e8a90d3b8783 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:25.930506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819939bd-b89c-4202-b77f-e8a90d3b8783 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:25.930766 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819939bd-b89c-4202-b77f-e8a90d3b8783 None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:25.931514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819939bd-b89c-4202-b77f-e8a90d3b8783 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:25.931870 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819939bd-b89c-4202-b77f-e8a90d3b8783 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:25.933301 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819939bd-b89c-4202-b77f-e8a90d3b8783 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:25.956862 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 295/597] 10.222.0.15 () {56 vars in 1139 bytes} [Wed Sep 14 19:34:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:25.956862 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819939bd-b89c-4202-b77f-e8a90d3b8783 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:25.991927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:26.015995 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:26.032071 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86fdf9-efc3-4178-9d42-4a32c8b553cf None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:26.058309 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819939bd-b89c-4202-b77f-e8a90d3b8783 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:26.068719 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738570a2-b276-47e0-b1e2-7e8b481ce1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:26.069713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738570a2-b276-47e0-b1e2-7e8b481ce1cd None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:26.070181 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738570a2-b276-47e0-b1e2-7e8b481ce1cd None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:26.070648 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738570a2-b276-47e0-b1e2-7e8b481ce1cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:26.081276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738570a2-b276-47e0-b1e2-7e8b481ce1cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:26.082954 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738570a2-b276-47e0-b1e2-7e8b481ce1cd None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:26.094809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-738570a2-b276-47e0-b1e2-7e8b481ce1cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:26.094809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:26.094809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:26.094809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:26.094809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:26.094809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:26.094809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:26.094809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:26.094809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:26.094809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:26.094809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:26.094809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:26.094809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:26.094809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:26.094809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:26.095822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:26.095822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:26.095822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:26.095822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:26.095822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:26.095822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:26.095822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:26.095822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:26.095822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:26.095822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:26.095822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:26.095822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:26.095822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:26.095822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:26.095822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:26.095822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:26.095822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:26.097298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:26.097298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:26.097298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:26.097298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:26.097298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:26.097298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:26.097298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:26.097298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:26.099788 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 303/598] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:26.100863 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738570a2-b276-47e0-b1e2-7e8b481ce1cd None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:26.102514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29473d1a-f8ed-4dc6-9e21-529e411aae64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:26.103205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29473d1a-f8ed-4dc6-9e21-529e411aae64 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:26.103574 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29473d1a-f8ed-4dc6-9e21-529e411aae64 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:26.103957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29473d1a-f8ed-4dc6-9e21-529e411aae64 None admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:26.105051 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29473d1a-f8ed-4dc6-9e21-529e411aae64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:26.105435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29473d1a-f8ed-4dc6-9e21-529e411aae64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:26.107115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29473d1a-f8ed-4dc6-9e21-529e411aae64 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:26.121085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 296/599] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:26.122032 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29473d1a-f8ed-4dc6-9e21-529e411aae64 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:26.206006 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738570a2-b276-47e0-b1e2-7e8b481ce1cd None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:26.213240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:26.228362 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29473d1a-f8ed-4dc6-9e21-529e411aae64 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:26.242315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1b7ac-36ae-47ad-868b-df4baad20a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:26.243088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1b7ac-36ae-47ad-868b-df4baad20a3a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:26.243475 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1b7ac-36ae-47ad-868b-df4baad20a3a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:26.243866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1b7ac-36ae-47ad-868b-df4baad20a3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:26.255977 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:26.256283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1b7ac-36ae-47ad-868b-df4baad20a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:26.257901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1b7ac-36ae-47ad-868b-df4baad20a3a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:26.268863 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c2a79-5adb-4f9b-9399-562d18afe6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:26.269659 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c2a79-5adb-4f9b-9399-562d18afe6e9 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:26.270085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c2a79-5adb-4f9b-9399-562d18afe6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:26.270500 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c2a79-5adb-4f9b-9399-562d18afe6e9 None admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:26.271356 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c2a79-5adb-4f9b-9399-562d18afe6e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:26.271835 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c2a79-5adb-4f9b-9399-562d18afe6e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:26.272994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-e5c1b7ac-36ae-47ad-868b-df4baad20a3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:26.272994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:26.272994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:26.272994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:26.272994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:26.272994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:26.272994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:26.272994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:26.272994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:26.272994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:26.272994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:26.272994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:26.272994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:26.272994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:26.272994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:26.272994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:26.274115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:26.274115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:26.274115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:26.274115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:26.274115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:26.274115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:26.274115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:26.274115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:26.274115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:26.274115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:26.274115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:26.274115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:26.274115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:26.274115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:26.274115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:26.274115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:26.274115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:26.275221 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:26.275221 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:26.275221 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:26.276202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c2a79-5adb-4f9b-9399-562d18afe6e9 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:26.281363 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 304/600] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:26.282240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1b7ac-36ae-47ad-868b-df4baad20a3a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:26.291676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 297/601] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:26.293270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c2a79-5adb-4f9b-9399-562d18afe6e9 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:26.411156 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1b7ac-36ae-47ad-868b-df4baad20a3a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:26.427132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c2a79-5adb-4f9b-9399-562d18afe6e9 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:26.460538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026c6a4-7ffe-42bc-8acf-ca94ebfa3ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:26.461823 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c6a4-7ffe-42bc-8acf-ca94ebfa3ad2 None admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:26.462267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c6a4-7ffe-42bc-8acf-ca94ebfa3ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:26.462860 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c6a4-7ffe-42bc-8acf-ca94ebfa3ad2 None admin] PATH_INFO: `/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/fe18c9b67d814fbba4614cf7491e136e/roles/b2e8ea485659485f92e729741880d447` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:26.464074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a9946-ecde-4b1c-af1d-9657ea64fe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:26.464755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a9946-ecde-4b1c-af1d-9657ea64fe65 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:26.465128 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a9946-ecde-4b1c-af1d-9657ea64fe65 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:26.465495 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a9946-ecde-4b1c-af1d-9657ea64fe65 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:26.466256 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a9946-ecde-4b1c-af1d-9657ea64fe65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:26.466641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a9946-ecde-4b1c-af1d-9657ea64fe65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:26.468179 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a9946-ecde-4b1c-af1d-9657ea64fe65 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:26.482236 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026c6a4-7ffe-42bc-8acf-ca94ebfa3ad2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e3e0c278ce94ce3a132496923eef365, user_id=fe18c9b67d814fbba4614cf7491e136e, role_id=b2e8ea485659485f92e729741880d447)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:26.483862 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026c6a4-7ffe-42bc-8acf-ca94ebfa3ad2 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:26.487086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 298/602] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:26.488491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a9946-ecde-4b1c-af1d-9657ea64fe65 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:26.526111 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:26.596319 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 305/603] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:34:26 2022] PUT /identity/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/fe18c9b67d814fbba4614cf7491e136e/roles/b2e8ea485659485f92e729741880d447 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:34:26.598086 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026c6a4-7ffe-42bc-8acf-ca94ebfa3ad2 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:26.603351 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a9946-ecde-4b1c-af1d-9657ea64fe65 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:26.624125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:26.680573 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ffe5c-dc99-4930-a10a-a28d6fbf1dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:26.681265 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ffe5c-dc99-4930-a10a-a28d6fbf1dc0 None admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:26.683528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ffe5c-dc99-4930-a10a-a28d6fbf1dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:26.683841 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ffe5c-dc99-4930-a10a-a28d6fbf1dc0 None admin] PATH_INFO: `/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/a2faa7ffc99948478ec7b81842139078/roles/b2e8ea485659485f92e729741880d447` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:26.726026 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ffe5c-dc99-4930-a10a-a28d6fbf1dc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e3e0c278ce94ce3a132496923eef365, user_id=a2faa7ffc99948478ec7b81842139078, role_id=b2e8ea485659485f92e729741880d447)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:26.727874 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ffe5c-dc99-4930-a10a-a28d6fbf1dc0 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:26.771566 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026c6a4-7ffe-42bc-8acf-ca94ebfa3ad2 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:26.813387 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0262142-12ef-4744-b4ef-238e6a69f335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:26.814120 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0262142-12ef-4744-b4ef-238e6a69f335 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:26.814409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0262142-12ef-4744-b4ef-238e6a69f335 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:26.814739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0262142-12ef-4744-b4ef-238e6a69f335 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:26.822697 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0262142-12ef-4744-b4ef-238e6a69f335 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:26.828335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 299/604] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:34:26 2022] PUT /identity/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/a2faa7ffc99948478ec7b81842139078/roles/b2e8ea485659485f92e729741880d447 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:34:26.828496 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0262142-12ef-4744-b4ef-238e6a69f335 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:26.840737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-a0262142-12ef-4744-b4ef-238e6a69f335 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:26.840737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:26.840737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:26.840737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:26.840737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:26.840737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:26.840737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:26.840737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:26.840737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:26.840737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:26.840737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:26.840737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:26.840737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:26.840737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:26.840737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:26.842016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:26.842016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:26.842016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:26.842016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:26.842016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:26.842016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:26.842016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:26.842016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:26.842016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:26.842016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:26.842016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:26.842016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:26.842016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:26.842016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:26.842016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:26.842016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:26.842016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:26.842941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:26.842941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:26.842941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:26.842941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:26.842941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:26.842941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:26.842941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:26.842941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:26.842941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 306/605] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:26.850413 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ffe5c-dc99-4930-a10a-a28d6fbf1dc0 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:26.958033 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:26.968182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ceb64-5f42-4dd7-bb4b-0e2b23cfae5d None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:26.968521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ceb64-5f42-4dd7-bb4b-0e2b23cfae5d None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:26.968725 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ceb64-5f42-4dd7-bb4b-0e2b23cfae5d None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:26.972033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 307/606] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:34:26.976397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d4507-b88a-43a3-a9d8-c14a21a2c11c None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:26.976571 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ffe5c-dc99-4930-a10a-a28d6fbf1dc0 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:26.978912 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d4507-b88a-43a3-a9d8-c14a21a2c11c None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:26.978912 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d4507-b88a-43a3-a9d8-c14a21a2c11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:26.995839 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-102d4507-b88a-43a3-a9d8-c14a21a2c11c None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:26.997046 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-102d4507-b88a-43a3-a9d8-c14a21a2c11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:27.026505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431356eb-33d9-45b1-bba0-50a651e26165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:27.027644 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431356eb-33d9-45b1-bba0-50a651e26165 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:27.027934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431356eb-33d9-45b1-bba0-50a651e26165 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:27.028674 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431356eb-33d9-45b1-bba0-50a651e26165 None admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:27.029678 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431356eb-33d9-45b1-bba0-50a651e26165 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:27.030001 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431356eb-33d9-45b1-bba0-50a651e26165 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:27.032378 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431356eb-33d9-45b1-bba0-50a651e26165 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:27.057051 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 300/607] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:27.063361 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431356eb-33d9-45b1-bba0-50a651e26165 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:27.089223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:27.098991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 308/608] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:34:27.196396 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431356eb-33d9-45b1-bba0-50a651e26165 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:27.231770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd0881-fdb1-4704-812f-f9379324b54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:27.232316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd0881-fdb1-4704-812f-f9379324b54d None admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:27.232592 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd0881-fdb1-4704-812f-f9379324b54d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:27.232865 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd0881-fdb1-4704-812f-f9379324b54d None admin] PATH_INFO: `/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/221300017882415ca3a7c9192343b956/roles/b2e8ea485659485f92e729741880d447` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:27.250889 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd0881-fdb1-4704-812f-f9379324b54d None admin] RBAC: Authorizing `identity:create_grant(project_id=2e3e0c278ce94ce3a132496923eef365, user_id=221300017882415ca3a7c9192343b956, role_id=b2e8ea485659485f92e729741880d447)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:27.252880 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd0881-fdb1-4704-812f-f9379324b54d None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:27.255058 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:27.322630 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 301/609] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:34:27 2022] PUT /identity/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/221300017882415ca3a7c9192343b956/roles/b2e8ea485659485f92e729741880d447 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:34:27.433116 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d4507-b88a-43a3-a9d8-c14a21a2c11c None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:27.457211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b61543-f975-4bc5-8b0e-27515e179789 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:27.457734 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b61543-f975-4bc5-8b0e-27515e179789 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:27.457734 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b61543-f975-4bc5-8b0e-27515e179789 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:27.459396 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 302/610] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:34:27.464934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e19455-d2ec-4839-b09e-a2c184bb33db None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:27.465249 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e19455-d2ec-4839-b09e-a2c184bb33db None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:27.465476 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e19455-d2ec-4839-b09e-a2c184bb33db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:27.488146 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-b2e19455-d2ec-4839-b09e-a2c184bb33db None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:27.489282 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b2e19455-d2ec-4839-b09e-a2c184bb33db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:27.591773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d4507-b88a-43a3-a9d8-c14a21a2c11c None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:27.606426 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 303/611] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:27.633123 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b244cf-699d-4e79-97ea-6d2544f99da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:27.633767 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b244cf-699d-4e79-97ea-6d2544f99da7 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:27.634042 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b244cf-699d-4e79-97ea-6d2544f99da7 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:27.634309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b244cf-699d-4e79-97ea-6d2544f99da7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:27.649731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b244cf-699d-4e79-97ea-6d2544f99da7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:27.655255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-32b244cf-699d-4e79-97ea-6d2544f99da7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:27.655255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:27.655255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:27.655255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:27.655255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:27.655255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:27.655255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:27.655255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:27.655255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:27.655255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:27.655255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:27.655255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:27.655255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:27.655255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:27.655255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:27.655255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:27.657411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:27.657411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:27.657411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:27.657411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:27.657411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:27.657411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:27.657411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:27.657411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:27.657411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:27.657411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:27.657411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:27.657411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:27.657411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:27.657411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:27.657411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:27.657411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:27.658525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:27.658525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:27.658525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:27.658525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:27.658525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:27.658525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:27.658525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:27.658525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:27.658525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:27.658525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:27.658525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:27.658525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:27.660909 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 309/612] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:34:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:27.667008 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e19455-d2ec-4839-b09e-a2c184bb33db None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:27.790367 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e19455-d2ec-4839-b09e-a2c184bb33db None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:27.816385 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:27.832577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff40a61-4f6c-451e-8c66-9f0644dd6589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:27.833190 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff40a61-4f6c-451e-8c66-9f0644dd6589 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:27.833463 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff40a61-4f6c-451e-8c66-9f0644dd6589 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:27.833730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff40a61-4f6c-451e-8c66-9f0644dd6589 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:27.834711 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff40a61-4f6c-451e-8c66-9f0644dd6589 None admin] RBAC: Adding query filter params (name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:27.835015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff40a61-4f6c-451e-8c66-9f0644dd6589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:27.836613 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff40a61-4f6c-451e-8c66-9f0644dd6589 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:27.848452 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 304/613] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Sep 14 19:34:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:27.855292 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b244cf-699d-4e79-97ea-6d2544f99da7 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:27.941223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:27.986849 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b244cf-699d-4e79-97ea-6d2544f99da7 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:28.017312 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff40a61-4f6c-451e-8c66-9f0644dd6589 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:28.023809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8d058-6839-43cd-8d85-4bf4839f9d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:28.024444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8d058-6839-43cd-8d85-4bf4839f9d01 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:28.024721 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8d058-6839-43cd-8d85-4bf4839f9d01 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:28.024990 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8d058-6839-43cd-8d85-4bf4839f9d01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:28.035472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8d058-6839-43cd-8d85-4bf4839f9d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:28.037003 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8d058-6839-43cd-8d85-4bf4839f9d01 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:28.054846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-e7b8d058-6839-43cd-8d85-4bf4839f9d01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:28.054846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:28.054846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:28.054846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:28.054846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:28.054846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:28.054846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:28.054846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:28.054846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:28.054846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:28.054846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:28.054846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:28.054846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:28.054846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:28.054846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:28.054846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:28.055826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:28.055826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:28.055826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:28.055826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:28.055826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:28.055826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:28.055826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:28.055826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:28.055826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:28.055826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:28.055826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:28.055826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:28.055826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:28.055826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:28.055826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:28.055826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:28.055826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:28.056710 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:28.056710 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:28.056710 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:28.058772 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 310/614] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:28.063927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8d058-6839-43cd-8d85-4bf4839f9d01 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:28.217714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8d058-6839-43cd-8d85-4bf4839f9d01 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:28.228857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff40a61-4f6c-451e-8c66-9f0644dd6589 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:28.242321 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:28.284006 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb35c0-7028-4a17-b94f-0af9ceb799d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:28.284630 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb35c0-7028-4a17-b94f-0af9ceb799d6 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:28.284904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb35c0-7028-4a17-b94f-0af9ceb799d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:28.285173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb35c0-7028-4a17-b94f-0af9ceb799d6 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:28.285810 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb35c0-7028-4a17-b94f-0af9ceb799d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:28.286109 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb35c0-7028-4a17-b94f-0af9ceb799d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:28.287459 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb35c0-7028-4a17-b94f-0af9ceb799d6 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:28.300154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d16e2-0b30-4b25-9f77-e6fdeeee25a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:28.300799 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d16e2-0b30-4b25-9f77-e6fdeeee25a3 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:28.301069 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d16e2-0b30-4b25-9f77-e6fdeeee25a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:28.301330 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d16e2-0b30-4b25-9f77-e6fdeeee25a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:28.310802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 311/615] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:28.316757 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb35c0-7028-4a17-b94f-0af9ceb799d6 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:28.324247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d16e2-0b30-4b25-9f77-e6fdeeee25a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:28.329667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-724d16e2-0b30-4b25-9f77-e6fdeeee25a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:28.329667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:28.329667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:28.329667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:28.329667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:28.329667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:28.329667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:28.329667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:28.329667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:28.329667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:28.329667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:28.329667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:28.329667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:28.329667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:28.329667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:28.329667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:28.331114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:28.331114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:28.331114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:28.331114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:28.331114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:28.331114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:28.331114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:28.331114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:28.331114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:28.331114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:28.331114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:28.331114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:28.331114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:28.331114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:28.331114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:28.331114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:28.332018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:28.332018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:28.332018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:28.332018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:28.332018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:28.332018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:28.332018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:28.332018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:28.332018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:28.332018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:28.332018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:28.332018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:28.332646 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 305/616] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:34:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:28.337907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d16e2-0b30-4b25-9f77-e6fdeeee25a3 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:28.442905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb35c0-7028-4a17-b94f-0af9ceb799d6 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:28.465262 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:28.491951 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e37c3a-4d92-413d-8ba7-4c8ed33099f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:28.492621 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e37c3a-4d92-413d-8ba7-4c8ed33099f7 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:28.492894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e37c3a-4d92-413d-8ba7-4c8ed33099f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:28.493160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e37c3a-4d92-413d-8ba7-4c8ed33099f7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:28.507587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e37c3a-4d92-413d-8ba7-4c8ed33099f7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:28.509026 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e37c3a-4d92-413d-8ba7-4c8ed33099f7 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:28.532933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-02e37c3a-4d92-413d-8ba7-4c8ed33099f7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 19:34:28.532933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:28.532933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:28.532933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:28.532933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:28.532933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:28.532933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:28.532933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:28.532933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:28.532933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:28.532933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:28.532933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:28.532933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:28.532933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:28.532933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:28.532933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:28.534463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:28.534463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:28.534463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:28.534463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:28.534463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:28.534463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:28.534463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:28.534463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:28.534463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:28.534463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:28.534463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:28.534463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:28.534463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:28.534463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:28.534463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:28.534463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:28.534463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:28.534463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:28.536134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:28.536134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:28.536134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:28.536134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:28.536134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:28.536134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:28.536134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:28.536134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:28.536134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 19:34:28.536134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:28.540368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 312/617] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Sep 14 19:34:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:28.544153 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e37c3a-4d92-413d-8ba7-4c8ed33099f7 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:28.573349 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d16e2-0b30-4b25-9f77-e6fdeeee25a3 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:28.603937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:28.636649 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8c107-30aa-444b-b7d4-7ec8fc19f0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:28.637268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8c107-30aa-444b-b7d4-7ec8fc19f0d7 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:28.637549 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8c107-30aa-444b-b7d4-7ec8fc19f0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:28.637823 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8c107-30aa-444b-b7d4-7ec8fc19f0d7 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:28.638498 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8c107-30aa-444b-b7d4-7ec8fc19f0d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:28.638801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8c107-30aa-444b-b7d4-7ec8fc19f0d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:28.648313 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8c107-30aa-444b-b7d4-7ec8fc19f0d7 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:28.669970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 306/618] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Sep 14 19:34:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:28.675400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8c107-30aa-444b-b7d4-7ec8fc19f0d7 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:28.677279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e37c3a-4d92-413d-8ba7-4c8ed33099f7 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:28.711865 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802af67a-e075-48fa-bd3f-f017d735c7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:28.712477 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802af67a-e075-48fa-bd3f-f017d735c7ac None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:28.712815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802af67a-e075-48fa-bd3f-f017d735c7ac None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:28.713091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802af67a-e075-48fa-bd3f-f017d735c7ac None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:28.713874 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802af67a-e075-48fa-bd3f-f017d735c7ac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:28.714175 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802af67a-e075-48fa-bd3f-f017d735c7ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:28.715665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802af67a-e075-48fa-bd3f-f017d735c7ac None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:28.734412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 313/619] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Sep 14 19:34:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:28.739955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802af67a-e075-48fa-bd3f-f017d735c7ac None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:28.834917 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:28.843557 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802af67a-e075-48fa-bd3f-f017d735c7ac None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:28.849804 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8c107-30aa-444b-b7d4-7ec8fc19f0d7 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:28.859913 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:28.886323 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad0b66-e1b9-46ab-8259-b9e60eecc26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:28.890609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad0b66-e1b9-46ab-8259-b9e60eecc26e None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:28.890609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad0b66-e1b9-46ab-8259-b9e60eecc26e None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:28.890609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad0b66-e1b9-46ab-8259-b9e60eecc26e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:28.904372 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee4c23-128b-4af2-8801-2320b9b0b22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:28.905779 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee4c23-128b-4af2-8801-2320b9b0b22f None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:28.906493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee4c23-128b-4af2-8801-2320b9b0b22f None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:28.906884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee4c23-128b-4af2-8801-2320b9b0b22f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:28.908894 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad0b66-e1b9-46ab-8259-b9e60eecc26e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:28.910771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad0b66-e1b9-46ab-8259-b9e60eecc26e None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:28.937892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-09ad0b66-e1b9-46ab-8259-b9e60eecc26e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:28.937892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:28.937892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:28.937892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:28.937892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:28.937892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:28.937892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:28.937892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:28.937892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:28.937892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:28.937892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:28.937892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:28.937892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:28.937892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:28.937892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:28.937892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:28.939098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:28.939098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:28.939098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:28.939098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:28.939098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:28.939098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:28.939098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:28.939098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:28.939098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:28.939098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:28.939098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:28.939098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:28.939098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:28.939098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:28.939098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:28.939098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:28.939098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:28.940283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:28.940283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:28.940283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:28.942175 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 307/620] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:28.952226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad0b66-e1b9-46ab-8259-b9e60eecc26e None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:28.996634 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee4c23-128b-4af2-8801-2320b9b0b22f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:28.998117 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee4c23-128b-4af2-8801-2320b9b0b22f None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:29.128378 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad0b66-e1b9-46ab-8259-b9e60eecc26e None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:29.162794 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:29.181729 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0b2e0-f9d4-4b8c-b62b-9c15c8523320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:29.182788 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0b2e0-f9d4-4b8c-b62b-9c15c8523320 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:29.184323 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0b2e0-f9d4-4b8c-b62b-9c15c8523320 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:29.184792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0b2e0-f9d4-4b8c-b62b-9c15c8523320 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:29.186266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0b2e0-f9d4-4b8c-b62b-9c15c8523320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:29.187290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0b2e0-f9d4-4b8c-b62b-9c15c8523320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:29.188873 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0b2e0-f9d4-4b8c-b62b-9c15c8523320 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:29.193495 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 314/621] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:34:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:34:29.199115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee4c23-128b-4af2-8801-2320b9b0b22f None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:29.213632 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 308/622] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:29.219174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0b2e0-f9d4-4b8c-b62b-9c15c8523320 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:29.251015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:29.379630 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee4c23-128b-4af2-8801-2320b9b0b22f None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:29.393001 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0b2e0-f9d4-4b8c-b62b-9c15c8523320 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:29.411146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf53ed-5df9-4279-b44d-816d1edb3c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:29.411809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf53ed-5df9-4279-b44d-816d1edb3c28 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:29.412085 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf53ed-5df9-4279-b44d-816d1edb3c28 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:29.412353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf53ed-5df9-4279-b44d-816d1edb3c28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:29.425378 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf53ed-5df9-4279-b44d-816d1edb3c28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:29.426882 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf53ed-5df9-4279-b44d-816d1edb3c28 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:29.442698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-caaf53ed-5df9-4279-b44d-816d1edb3c28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:29.442698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:29.442698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:29.442698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:29.442698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:29.442698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:29.442698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:29.442698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:29.442698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:29.442698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:29.442698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:29.442698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:29.442698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:29.442698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:29.442698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:29.442698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:29.443707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:29.443707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:29.443707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:29.443707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:29.443707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:29.443707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:29.443707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:29.443707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:29.443707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:29.443707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:29.443707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:29.443707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:29.443707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:29.443707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:29.443707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:29.443707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:29.443707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:29.444635 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:29.444635 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:29.444635 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:29.444635 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 315/623] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:29.450685 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf53ed-5df9-4279-b44d-816d1edb3c28 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:29.476350 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b86d49-60e9-463f-8ec5-f428e76aca6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:29.476996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b86d49-60e9-463f-8ec5-f428e76aca6e None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:29.477285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b86d49-60e9-463f-8ec5-f428e76aca6e None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:29.477561 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b86d49-60e9-463f-8ec5-f428e76aca6e None admin] PATH_INFO: `/v3/users/swift` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:29.492656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b86d49-60e9-463f-8ec5-f428e76aca6e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:29.494124 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b86d49-60e9-463f-8ec5-f428e76aca6e None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:29.496778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:29.514687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-56b86d49-60e9-463f-8ec5-f428e76aca6e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 19:34:29.514687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:29.514687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:29.514687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:29.514687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:29.514687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:29.514687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:29.514687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:29.514687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:29.514687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:29.514687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:29.514687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:29.514687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:29.514687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:29.514687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:29.514687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:29.517024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:29.517024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:29.517024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:29.517024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:29.517024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:29.517024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:29.517024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:29.517024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:29.517024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:29.517024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:29.517024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:29.517024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:29.517024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:29.517024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:29.517024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:29.517024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:29.517024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:29.517024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:29.519272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:29.519272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:29.519272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:29.519272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:29.519272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:29.519272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:29.519272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:29.519272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:29.519272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 19:34:29.519272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:29.519272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 309/624] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:34:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:29.519272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d017b-df04-4086-975e-2bd578c29abf None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:29.519272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d017b-df04-4086-975e-2bd578c29abf None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:29.521210 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d017b-df04-4086-975e-2bd578c29abf None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:29.527575 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 310/625] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:29.527575 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d017b-df04-4086-975e-2bd578c29abf None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:29.565703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf53ed-5df9-4279-b44d-816d1edb3c28 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:29.606923 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018be17f-fdf0-43fa-b21a-401218e1d8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:29.607721 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018be17f-fdf0-43fa-b21a-401218e1d8ec None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:29.607880 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018be17f-fdf0-43fa-b21a-401218e1d8ec None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:29.608100 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018be17f-fdf0-43fa-b21a-401218e1d8ec None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:29.608753 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018be17f-fdf0-43fa-b21a-401218e1d8ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:29.609057 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018be17f-fdf0-43fa-b21a-401218e1d8ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:29.610440 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018be17f-fdf0-43fa-b21a-401218e1d8ec None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:29.619120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:29.626073 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 316/626] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:29.627622 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af4ca0-5385-42ff-8bbf-f243c813842c None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:29.634190 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af4ca0-5385-42ff-8bbf-f243c813842c None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:29.634190 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af4ca0-5385-42ff-8bbf-f243c813842c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:29.646076 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d017b-df04-4086-975e-2bd578c29abf None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:29.650158 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-84af4ca0-5385-42ff-8bbf-f243c813842c None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:29.651680 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-84af4ca0-5385-42ff-8bbf-f243c813842c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:29.685376 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa98ed8-264a-4fa1-80ad-adc53cd6ed10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:29.686459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa98ed8-264a-4fa1-80ad-adc53cd6ed10 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:29.686942 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa98ed8-264a-4fa1-80ad-adc53cd6ed10 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:29.687442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa98ed8-264a-4fa1-80ad-adc53cd6ed10 None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:29.688453 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa98ed8-264a-4fa1-80ad-adc53cd6ed10 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:29.689054 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa98ed8-264a-4fa1-80ad-adc53cd6ed10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:29.690947 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa98ed8-264a-4fa1-80ad-adc53cd6ed10 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:29.712800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 311/627] 10.222.0.15 () {56 vars in 1135 bytes} [Wed Sep 14 19:34:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:29.713930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa98ed8-264a-4fa1-80ad-adc53cd6ed10 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:29.743686 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 317/628] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:29.744851 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af4ca0-5385-42ff-8bbf-f243c813842c None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:29.784772 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:29.827241 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa98ed8-264a-4fa1-80ad-adc53cd6ed10 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:29.869857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75647fa-5ee6-4846-9261-cbf87475b437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:29.870584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75647fa-5ee6-4846-9261-cbf87475b437 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:29.870862 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75647fa-5ee6-4846-9261-cbf87475b437 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:29.871130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75647fa-5ee6-4846-9261-cbf87475b437 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:29.879901 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75647fa-5ee6-4846-9261-cbf87475b437 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:29.881374 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75647fa-5ee6-4846-9261-cbf87475b437 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:29.883525 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:29.892012 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af4ca0-5385-42ff-8bbf-f243c813842c None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:29.894722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-a75647fa-5ee6-4846-9261-cbf87475b437 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:29.894722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:29.894722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:29.894722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:29.894722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:29.894722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:29.894722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:29.894722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:29.894722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:29.894722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:29.894722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:29.894722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:29.894722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:29.894722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:29.894722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:29.895614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:29.895614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:29.895614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:29.895614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:29.895614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:29.895614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:29.895614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:29.895614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:29.895614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:29.895614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:29.895614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:29.895614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:29.895614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:29.895614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:29.895614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:29.895614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:29.895614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:29.896517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:29.896517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:29.896517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:29.896517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:29.896517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:29.896517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:29.896517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:29.896517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:29.900829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 312/629] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:29.902543 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1616d-e036-4c37-b6a0-15639bdb8178 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:29.902869 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1616d-e036-4c37-b6a0-15639bdb8178 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:29.903143 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1616d-e036-4c37-b6a0-15639bdb8178 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:29.904751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 313/630] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:29.905449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1616d-e036-4c37-b6a0-15639bdb8178 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:29.938296 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a93db-3cd7-4b1f-9e56-e515c81e0133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:29.938937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a93db-3cd7-4b1f-9e56-e515c81e0133 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:29.939213 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a93db-3cd7-4b1f-9e56-e515c81e0133 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:29.939481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a93db-3cd7-4b1f-9e56-e515c81e0133 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:29.952463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a93db-3cd7-4b1f-9e56-e515c81e0133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:29.954106 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a93db-3cd7-4b1f-9e56-e515c81e0133 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:29.970790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-c95a93db-3cd7-4b1f-9e56-e515c81e0133 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:29.970790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:29.970790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:29.970790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:29.970790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:29.970790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:29.970790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:29.970790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:29.970790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:29.970790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:29.970790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:29.970790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:29.970790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:29.970790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:29.970790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:29.970790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:29.972963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:29.972963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:29.972963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:29.972963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:29.972963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:29.972963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:29.972963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:29.972963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:29.972963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:29.972963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:29.972963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:29.972963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:29.972963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:29.972963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:29.972963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:29.972963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:29.972963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:29.974096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:29.974096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:29.974096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:29.974096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 318/631] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:29.974377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cfa7d-ab43-44c0-9cd1-40eef40f5a66 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:29.974465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cfa7d-ab43-44c0-9cd1-40eef40f5a66 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:29.974715 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cfa7d-ab43-44c0-9cd1-40eef40f5a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:29.993850 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-989cfa7d-ab43-44c0-9cd1-40eef40f5a66 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:29.995052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-989cfa7d-ab43-44c0-9cd1-40eef40f5a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:30.039530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1616d-e036-4c37-b6a0-15639bdb8178 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:30.061115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 319/632] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:30.062364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403aa89-fc2c-48dd-896c-8793637b1131 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:30.062653 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403aa89-fc2c-48dd-896c-8793637b1131 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:30.062920 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403aa89-fc2c-48dd-896c-8793637b1131 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:30.064510 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 320/633] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:30.065239 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403aa89-fc2c-48dd-896c-8793637b1131 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:30.076090 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f975e6-6efc-4eaa-9cc3-0296b6307ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:30.076788 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f975e6-6efc-4eaa-9cc3-0296b6307ecf None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:30.076968 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f975e6-6efc-4eaa-9cc3-0296b6307ecf None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:30.077239 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f975e6-6efc-4eaa-9cc3-0296b6307ecf None admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:30.077926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f975e6-6efc-4eaa-9cc3-0296b6307ecf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:30.078227 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f975e6-6efc-4eaa-9cc3-0296b6307ecf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:30.079685 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f975e6-6efc-4eaa-9cc3-0296b6307ecf None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:30.082862 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:30.095819 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 314/634] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:30.095819 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f975e6-6efc-4eaa-9cc3-0296b6307ecf None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:30.156886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:30.178069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403aa89-fc2c-48dd-896c-8793637b1131 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:30.202856 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f975e6-6efc-4eaa-9cc3-0296b6307ecf None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:30.218583 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e00aa-12f6-41a8-8163-57bc89f1d4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:30.219204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e00aa-12f6-41a8-8163-57bc89f1d4b7 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:30.219486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e00aa-12f6-41a8-8163-57bc89f1d4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:30.219783 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e00aa-12f6-41a8-8163-57bc89f1d4b7 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:30.220429 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e00aa-12f6-41a8-8163-57bc89f1d4b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:30.220731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e00aa-12f6-41a8-8163-57bc89f1d4b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:30.222666 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e00aa-12f6-41a8-8163-57bc89f1d4b7 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:30.234371 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 321/635] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:30.240152 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae1f53-e8b0-46b5-b259-a40af7d15570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:30.240473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dc92d-fa21-4a05-b6e7-b44dc1086f9b None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:30.240757 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dc92d-fa21-4a05-b6e7-b44dc1086f9b None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:30.240884 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae1f53-e8b0-46b5-b259-a40af7d15570 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:30.241038 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dc92d-fa21-4a05-b6e7-b44dc1086f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:30.241132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae1f53-e8b0-46b5-b259-a40af7d15570 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:30.241288 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae1f53-e8b0-46b5-b259-a40af7d15570 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:30.251423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae1f53-e8b0-46b5-b259-a40af7d15570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:30.256305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-e0ae1f53-e8b0-46b5-b259-a40af7d15570 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:30.256305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:30.256305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:30.256305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:30.256305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:30.256305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:30.256305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:30.256305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:30.256305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:30.256305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:30.256305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:30.256305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:30.256305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:30.256305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:30.256305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:30.256305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:30.257188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:30.257188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:30.257188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:30.257188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:30.257188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:30.257188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:30.257188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:30.257188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:30.257188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:30.257188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:30.257188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:30.257188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:30.257188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:30.257188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:30.257188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:30.257188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:30.258031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:30.258031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:30.258031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:30.258031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:30.258031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:30.258031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:30.258031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:30.258031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:30.258031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:30.258031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:30.258031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:30.258031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:30.260251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-636dc92d-fa21-4a05-b6e7-b44dc1086f9b None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:30.261436 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-636dc92d-fa21-4a05-b6e7-b44dc1086f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:30.262412 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 315/636] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:34:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:30.263084 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae1f53-e8b0-46b5-b259-a40af7d15570 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:30.329302 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 322/637] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:30.331814 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dc92d-fa21-4a05-b6e7-b44dc1086f9b None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:30.334561 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:30.378955 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae1f53-e8b0-46b5-b259-a40af7d15570 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:30.396679 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:30.421281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a9b66-3ac0-4320-a54a-0d80bf1d8a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:30.421281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a9b66-3ac0-4320-a54a-0d80bf1d8a56 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:30.421281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a9b66-3ac0-4320-a54a-0d80bf1d8a56 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:30.421281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a9b66-3ac0-4320-a54a-0d80bf1d8a56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:30.421668 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a9b66-3ac0-4320-a54a-0d80bf1d8a56 None admin] RBAC: Adding query filter params (role.id=b2e8ea485659485f92e729741880d447, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=421f6cc846b342918a177d2794eb3db8) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:30.421668 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a9b66-3ac0-4320-a54a-0d80bf1d8a56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:30.421668 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a9b66-3ac0-4320-a54a-0d80bf1d8a56 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:30.428056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 316/638] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:34:30 2022] GET /identity/v3/role_assignments?user.id=421f6cc846b342918a177d2794eb3db8&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=b2e8ea485659485f92e729741880d447 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:30.428056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a9b66-3ac0-4320-a54a-0d80bf1d8a56 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:30.458115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dc92d-fa21-4a05-b6e7-b44dc1086f9b None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:30.507138 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675c3c3-fa3a-4886-ac6e-45f198018833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:30.510494 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675c3c3-fa3a-4886-ac6e-45f198018833 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:30.510777 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675c3c3-fa3a-4886-ac6e-45f198018833 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:30.511051 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675c3c3-fa3a-4886-ac6e-45f198018833 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:30.521040 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675c3c3-fa3a-4886-ac6e-45f198018833 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:30.522513 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675c3c3-fa3a-4886-ac6e-45f198018833 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:30.535454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-3675c3c3-fa3a-4886-ac6e-45f198018833 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:30.535454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:30.535454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:30.535454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:30.535454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:30.535454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:30.535454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:30.535454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:30.535454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:30.535454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:30.535454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:30.535454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:30.535454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:30.535454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:30.535454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:30.536431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:30.536431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:30.536431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:30.536431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:30.536431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:30.536431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:30.536431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:30.536431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:30.536431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:30.536431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:30.536431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:30.536431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:30.536431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:30.536431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:30.536431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:30.536431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:30.536431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:30.537382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:30.537382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:30.537382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:30.537382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:30.537382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:30.537382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:30.537382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:30.537382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:30.537382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 323/639] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:30.537854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675c3c3-fa3a-4886-ac6e-45f198018833 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:30.564099 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a9b66-3ac0-4320-a54a-0d80bf1d8a56 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:30.607782 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:30.619730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e576a7f-0df0-48ba-8dea-43cbecea6a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:30.622985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e576a7f-0df0-48ba-8dea-43cbecea6a99 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:30.622985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e576a7f-0df0-48ba-8dea-43cbecea6a99 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:30.622985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e576a7f-0df0-48ba-8dea-43cbecea6a99 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:30.622985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e576a7f-0df0-48ba-8dea-43cbecea6a99 None admin] RBAC: Adding query filter params (name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:30.622985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e576a7f-0df0-48ba-8dea-43cbecea6a99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:30.623983 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e576a7f-0df0-48ba-8dea-43cbecea6a99 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:30.635788 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 317/640] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Sep 14 19:34:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:30.636599 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e576a7f-0df0-48ba-8dea-43cbecea6a99 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:30.653575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675c3c3-fa3a-4886-ac6e-45f198018833 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:30.687254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:30.692752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b214dc-b140-48e0-9472-e69d4e6ee96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:30.693605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b214dc-b140-48e0-9472-e69d4e6ee96e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:30.693888 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b214dc-b140-48e0-9472-e69d4e6ee96e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:30.694161 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b214dc-b140-48e0-9472-e69d4e6ee96e None admin] PATH_INFO: `/v3/roles/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:30.706510 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b214dc-b140-48e0-9472-e69d4e6ee96e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:30.711786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-78b214dc-b140-48e0-9472-e69d4e6ee96e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:30.711786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:30.711786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:30.711786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:30.711786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:30.711786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:30.711786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:30.711786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:30.711786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:30.711786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:30.711786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:30.711786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:30.711786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:30.711786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:30.711786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:30.711786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:30.715529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:30.715529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:30.715529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:30.715529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:30.715529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:30.715529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:30.715529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:30.715529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:30.715529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:30.715529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:30.715529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:30.715529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:30.715529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:30.715529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:30.715529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:30.715529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:30.716417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:30.716417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:30.716417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:30.716417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:30.716417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:30.716417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:30.716417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:30.716417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:30.716417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:30.716417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:30.716417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:30.716417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:30.716417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 324/641] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:34:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:30.716417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b214dc-b140-48e0-9472-e69d4e6ee96e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:30.754933 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e576a7f-0df0-48ba-8dea-43cbecea6a99 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:30.790168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aeb655-8c6f-45a7-b1f0-7756a789b5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:30.790782 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aeb655-8c6f-45a7-b1f0-7756a789b5da None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:30.791050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aeb655-8c6f-45a7-b1f0-7756a789b5da None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:30.791317 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aeb655-8c6f-45a7-b1f0-7756a789b5da None admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:30.792032 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aeb655-8c6f-45a7-b1f0-7756a789b5da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:30.792336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aeb655-8c6f-45a7-b1f0-7756a789b5da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:30.793750 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aeb655-8c6f-45a7-b1f0-7756a789b5da None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:30.807327 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 318/642] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:30.808165 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aeb655-8c6f-45a7-b1f0-7756a789b5da None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:30.825414 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b214dc-b140-48e0-9472-e69d4e6ee96e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:30.852642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:30.868245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79550396-1bd3-41a5-b5f2-b236180f4c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:30.868893 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79550396-1bd3-41a5-b5f2-b236180f4c74 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:30.869177 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79550396-1bd3-41a5-b5f2-b236180f4c74 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:30.869440 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79550396-1bd3-41a5-b5f2-b236180f4c74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:30.882511 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79550396-1bd3-41a5-b5f2-b236180f4c74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:30.888595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-79550396-1bd3-41a5-b5f2-b236180f4c74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:30.888595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:30.888595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:30.888595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:30.888595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:30.888595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:30.888595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:30.888595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:30.888595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:30.888595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:30.888595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:30.888595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:30.888595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:30.888595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:30.888595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:30.888595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:30.889628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:30.889628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:30.889628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:30.889628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:30.889628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:30.889628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:30.889628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:30.889628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:30.889628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:30.889628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:30.889628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:30.889628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:30.889628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:30.889628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:30.889628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:30.889628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:30.896276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:30.896276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:30.896276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:30.896276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:30.896276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:30.896276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:30.896276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:30.896276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:30.896276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:30.896276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:30.896276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:30.896276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:30.896276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 325/643] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:34:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:30.896276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79550396-1bd3-41a5-b5f2-b236180f4c74 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:30.925230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aeb655-8c6f-45a7-b1f0-7756a789b5da None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:30.928420 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:30.962028 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ea6fc-76aa-4b12-96e9-40a7c99dc156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:30.962581 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ea6fc-76aa-4b12-96e9-40a7c99dc156 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:30.962856 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ea6fc-76aa-4b12-96e9-40a7c99dc156 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:30.963124 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ea6fc-76aa-4b12-96e9-40a7c99dc156 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:30.974411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ea6fc-76aa-4b12-96e9-40a7c99dc156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:30.975895 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ea6fc-76aa-4b12-96e9-40a7c99dc156 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:30.992760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-ca4ea6fc-76aa-4b12-96e9-40a7c99dc156 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:30.992760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:30.992760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:30.992760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:30.992760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:30.992760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:30.992760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:30.992760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:30.992760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:30.992760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:30.992760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:30.992760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:30.992760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:30.992760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:30.992760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:30.992760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:30.993770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:30.993770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:30.993770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:30.993770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:30.993770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:30.993770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:30.993770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:30.993770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:30.993770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:30.993770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:30.993770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:30.993770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:30.993770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:30.993770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:30.993770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:30.993770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:30.993770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:30.994870 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:30.994870 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:30.994870 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:30.994870 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 319/644] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:30.994870 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ea6fc-76aa-4b12-96e9-40a7c99dc156 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:31.007521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79550396-1bd3-41a5-b5f2-b236180f4c74 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:31.047531 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53c7d0-2c5c-455a-832f-76a12281773f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:31.048234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53c7d0-2c5c-455a-832f-76a12281773f None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:31.048447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53c7d0-2c5c-455a-832f-76a12281773f None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:31.048712 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53c7d0-2c5c-455a-832f-76a12281773f None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:31.049370 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53c7d0-2c5c-455a-832f-76a12281773f None admin] RBAC: Adding query filter params (name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:31.049922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53c7d0-2c5c-455a-832f-76a12281773f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:31.051289 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53c7d0-2c5c-455a-832f-76a12281773f None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:31.060121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 326/645] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Sep 14 19:34:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:31.061013 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53c7d0-2c5c-455a-832f-76a12281773f None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:31.106854 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ea6fc-76aa-4b12-96e9-40a7c99dc156 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:31.110402 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:31.141208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92608961-b2c0-43f4-897b-0c80650640b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:31.141876 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92608961-b2c0-43f4-897b-0c80650640b3 None admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:31.142146 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92608961-b2c0-43f4-897b-0c80650640b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:31.142421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92608961-b2c0-43f4-897b-0c80650640b3 None admin] PATH_INFO: `/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/ee56bf9af257486e94e6ff1b33086f23/roles/b2e8ea485659485f92e729741880d447` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:31.159531 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92608961-b2c0-43f4-897b-0c80650640b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e3e0c278ce94ce3a132496923eef365, user_id=ee56bf9af257486e94e6ff1b33086f23, role_id=b2e8ea485659485f92e729741880d447)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:31.161250 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92608961-b2c0-43f4-897b-0c80650640b3 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:31.168148 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53c7d0-2c5c-455a-832f-76a12281773f None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:31.202983 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784dd8a-7190-42fb-8f89-87d00cf8a4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:31.204054 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784dd8a-7190-42fb-8f89-87d00cf8a4d9 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:31.204532 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784dd8a-7190-42fb-8f89-87d00cf8a4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:31.204985 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784dd8a-7190-42fb-8f89-87d00cf8a4d9 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:31.205753 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784dd8a-7190-42fb-8f89-87d00cf8a4d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:31.206098 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784dd8a-7190-42fb-8f89-87d00cf8a4d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:31.207709 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784dd8a-7190-42fb-8f89-87d00cf8a4d9 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:31.216312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 327/646] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Sep 14 19:34:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:31.217059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784dd8a-7190-42fb-8f89-87d00cf8a4d9 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:31.251912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 320/647] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:34:30 2022] PUT /identity/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/ee56bf9af257486e94e6ff1b33086f23/roles/b2e8ea485659485f92e729741880d447 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:34:31.254039 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92608961-b2c0-43f4-897b-0c80650640b3 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:31.272907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:31.361130 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784dd8a-7190-42fb-8f89-87d00cf8a4d9 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:31.394312 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92608961-b2c0-43f4-897b-0c80650640b3 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:31.395116 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:31.407388 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d35ed-be1e-4cd8-9f2c-ff8f920e36c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:31.408315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d35ed-be1e-4cd8-9f2c-ff8f920e36c6 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:31.408758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d35ed-be1e-4cd8-9f2c-ff8f920e36c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:31.409703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d35ed-be1e-4cd8-9f2c-ff8f920e36c6 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:31.410409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d35ed-be1e-4cd8-9f2c-ff8f920e36c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:31.410778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d35ed-be1e-4cd8-9f2c-ff8f920e36c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:31.412567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d35ed-be1e-4cd8-9f2c-ff8f920e36c6 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:31.432190 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 328/648] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:31.433683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d35ed-be1e-4cd8-9f2c-ff8f920e36c6 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:31.438372 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc74085-bdd6-407a-a129-aea9315a1218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:31.439295 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc74085-bdd6-407a-a129-aea9315a1218 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:31.439823 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc74085-bdd6-407a-a129-aea9315a1218 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:31.440495 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc74085-bdd6-407a-a129-aea9315a1218 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:31.453736 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc74085-bdd6-407a-a129-aea9315a1218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:31.455530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc74085-bdd6-407a-a129-aea9315a1218 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:31.476022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-1dc74085-bdd6-407a-a129-aea9315a1218 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:31.476022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:31.476022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:31.476022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:31.476022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:31.476022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:31.476022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:31.476022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:31.476022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:31.476022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:31.476022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:31.476022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:31.476022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:31.476022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:31.476022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:31.476022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:31.477020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:31.477020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:31.477020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:31.477020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:31.477020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:31.477020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:31.477020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:31.477020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:31.477020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:31.477020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:31.477020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:31.477020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:31.477020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:31.477020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:31.477020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:31.477020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:31.477020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:31.477906 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:31.477906 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:31.477906 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:31.480187 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 321/649] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:31.481206 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc74085-bdd6-407a-a129-aea9315a1218 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:31.542802 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:31.559946 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d35ed-be1e-4cd8-9f2c-ff8f920e36c6 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:31.590121 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc74085-bdd6-407a-a129-aea9315a1218 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:31.603379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2a4c1-4b5e-4c46-8cd4-98e85b8e898e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:31.604322 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2a4c1-4b5e-4c46-8cd4-98e85b8e898e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:31.604602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2a4c1-4b5e-4c46-8cd4-98e85b8e898e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:31.604876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2a4c1-4b5e-4c46-8cd4-98e85b8e898e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:31.623637 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2a4c1-4b5e-4c46-8cd4-98e85b8e898e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:31.625261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2a4c1-4b5e-4c46-8cd4-98e85b8e898e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:31.632045 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaba8f9-e4ae-4532-b969-479c994f2eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:31.633035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaba8f9-e4ae-4532-b969-479c994f2eb4 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:31.633622 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaba8f9-e4ae-4532-b969-479c994f2eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:31.634134 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaba8f9-e4ae-4532-b969-479c994f2eb4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:31.642622 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaba8f9-e4ae-4532-b969-479c994f2eb4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:31.642981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-79f2a4c1-4b5e-4c46-8cd4-98e85b8e898e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:31.642981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:31.642981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:31.642981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:31.642981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:31.642981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:31.642981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:31.642981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:31.642981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:31.642981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:31.642981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:31.642981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:31.642981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:31.642981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:31.642981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:31.642981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:31.643992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:31.643992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:31.643992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:31.643992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:31.643992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:31.643992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:31.643992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:31.643992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:31.643992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:31.643992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:31.643992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:31.643992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:31.643992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:31.643992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:31.643992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:31.643992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:31.643992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:31.645287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:31.645287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:31.645287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:31.647221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaba8f9-e4ae-4532-b969-479c994f2eb4 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:31.649157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 329/650] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:31.650183 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2a4c1-4b5e-4c46-8cd4-98e85b8e898e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:31.662590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-dcaba8f9-e4ae-4532-b969-479c994f2eb4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 19:34:31.662590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:31.662590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:31.662590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:31.662590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:31.662590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:31.662590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:31.662590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:31.662590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:31.662590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:31.662590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:31.662590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:31.662590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:31.662590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:31.662590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:31.662590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:31.663914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:31.663914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:31.663914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:31.663914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:31.663914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:31.663914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:31.663914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:31.663914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:31.663914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:31.663914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:31.663914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:31.663914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:31.663914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:31.663914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:31.663914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:31.663914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:31.663914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:31.663914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:31.664864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:31.664864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:31.664864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:31.664864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:31.664864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:31.664864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:31.664864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:31.664864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:31.664864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 19:34:31.664864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:31.667370 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 322/651] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:34:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:31.668491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaba8f9-e4ae-4532-b969-479c994f2eb4 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:31.675949 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:31.770095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2a4c1-4b5e-4c46-8cd4-98e85b8e898e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:31.787559 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaba8f9-e4ae-4532-b969-479c994f2eb4 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:31.808109 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:31.813843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0cce6-aee1-42b9-81d4-44af7ff761f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:31.814997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0cce6-aee1-42b9-81d4-44af7ff761f5 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:31.815780 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0cce6-aee1-42b9-81d4-44af7ff761f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:31.816204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0cce6-aee1-42b9-81d4-44af7ff761f5 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:31.817168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a0cce6-aee1-42b9-81d4-44af7ff761f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:31.818080 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a0cce6-aee1-42b9-81d4-44af7ff761f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:31.820189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a0cce6-aee1-42b9-81d4-44af7ff761f5 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:31.825810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c385a9-932b-43e8-b07d-401c6f9a7d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:31.826427 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c385a9-932b-43e8-b07d-401c6f9a7d89 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:31.826708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c385a9-932b-43e8-b07d-401c6f9a7d89 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:31.835407 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c385a9-932b-43e8-b07d-401c6f9a7d89 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:31.835407 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c385a9-932b-43e8-b07d-401c6f9a7d89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:31.835407 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c385a9-932b-43e8-b07d-401c6f9a7d89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:31.835407 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c385a9-932b-43e8-b07d-401c6f9a7d89 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:31.836327 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 330/652] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:31.837433 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0cce6-aee1-42b9-81d4-44af7ff761f5 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:31.847762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 323/653] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:31.848483 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c385a9-932b-43e8-b07d-401c6f9a7d89 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:31.968046 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c385a9-932b-43e8-b07d-401c6f9a7d89 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:31.973061 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0cce6-aee1-42b9-81d4-44af7ff761f5 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:31.976175 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:32.009361 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1493ab8-67f7-4fc3-b850-12ceedf72f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:32.010387 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1493ab8-67f7-4fc3-b850-12ceedf72f1d None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:32.010740 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1493ab8-67f7-4fc3-b850-12ceedf72f1d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:32.011088 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1493ab8-67f7-4fc3-b850-12ceedf72f1d None admin] PATH_INFO: `/v3/users/glance` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:32.018245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c031ec-385f-4c51-b206-428d733da59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:32.019388 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c031ec-385f-4c51-b206-428d733da59e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:32.019689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1493ab8-67f7-4fc3-b850-12ceedf72f1d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:32.020305 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c031ec-385f-4c51-b206-428d733da59e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:32.020773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c031ec-385f-4c51-b206-428d733da59e None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:32.021227 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1493ab8-67f7-4fc3-b850-12ceedf72f1d None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:32.021925 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c031ec-385f-4c51-b206-428d733da59e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:32.022427 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c031ec-385f-4c51-b206-428d733da59e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:32.024969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c031ec-385f-4c51-b206-428d733da59e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:32.036085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-e1493ab8-67f7-4fc3-b850-12ceedf72f1d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 19:34:32.036085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:32.036085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:32.036085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:32.036085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:32.036085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:32.036085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:32.036085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:32.036085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:32.036085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:32.036085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:32.036085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:32.036085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:32.036085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:32.036085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:32.036085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:32.037035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:32.037035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:32.037035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:32.037035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:32.037035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:32.037035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:32.037035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:32.037035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:32.037035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:32.037035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:32.037035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:32.037035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:32.037035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:32.037035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:32.037035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:32.037035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:32.037035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:32.037035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:32.037959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:32.037959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:32.037959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:32.037959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:32.037959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:32.037959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:32.037959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:32.037959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:32.037959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 14 19:34:32.037959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:32.037959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 324/654] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:34:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:32.038541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1493ab8-67f7-4fc3-b850-12ceedf72f1d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:32.048258 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 331/655] 10.222.0.15 () {56 vars in 1137 bytes} [Wed Sep 14 19:34:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:32.050558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c031ec-385f-4c51-b206-428d733da59e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:32.088731 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:32.166389 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1493ab8-67f7-4fc3-b850-12ceedf72f1d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:32.172686 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c031ec-385f-4c51-b206-428d733da59e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:32.206121 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029368ed-92a0-4af2-a044-55ed68905fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:32.207201 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029368ed-92a0-4af2-a044-55ed68905fbf None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:32.207800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029368ed-92a0-4af2-a044-55ed68905fbf None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:32.208382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029368ed-92a0-4af2-a044-55ed68905fbf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:32.210136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac64cfe-185d-49a7-b3a6-fa33cb727e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:32.210755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac64cfe-185d-49a7-b3a6-fa33cb727e84 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:32.211164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac64cfe-185d-49a7-b3a6-fa33cb727e84 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:32.211280 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac64cfe-185d-49a7-b3a6-fa33cb727e84 None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:32.212050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac64cfe-185d-49a7-b3a6-fa33cb727e84 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:32.212357 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac64cfe-185d-49a7-b3a6-fa33cb727e84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:32.213787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac64cfe-185d-49a7-b3a6-fa33cb727e84 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:32.216427 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:32.219617 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029368ed-92a0-4af2-a044-55ed68905fbf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:32.221339 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029368ed-92a0-4af2-a044-55ed68905fbf None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:32.232863 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 332/656] 10.222.0.15 () {56 vars in 1137 bytes} [Wed Sep 14 19:34:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:32.233804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac64cfe-185d-49a7-b3a6-fa33cb727e84 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:32.235078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-029368ed-92a0-4af2-a044-55ed68905fbf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 19:34:32.235078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:32.235078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:32.235078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:32.235078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:32.235078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:32.235078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:32.235078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:32.235078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:32.235078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:32.235078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:32.235078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:32.235078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:32.235078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:32.235078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:32.235078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:32.236011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:32.236011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:32.236011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:32.236011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:32.236011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:32.236011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:32.236011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:32.236011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:32.236011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:32.236011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:32.236011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:32.236011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:32.236011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:32.236011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:32.236011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:32.236011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:32.236011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:32.236011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:32.236959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:32.236959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:32.236959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:32.236959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:32.236959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:32.236959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:32.236959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:32.236959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:32.236959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 19:34:32.236959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:32.239772 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 325/657] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:34:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:32.240812 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029368ed-92a0-4af2-a044-55ed68905fbf None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:32.350966 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:32.352053 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac64cfe-185d-49a7-b3a6-fa33cb727e84 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:32.355729 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029368ed-92a0-4af2-a044-55ed68905fbf None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:32.388944 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75930282-b414-423c-9f46-cb4124bdeb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:32.389568 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75930282-b414-423c-9f46-cb4124bdeb02 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:32.389851 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75930282-b414-423c-9f46-cb4124bdeb02 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:32.390128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75930282-b414-423c-9f46-cb4124bdeb02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:32.399875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248a899-dd88-49c2-9410-0ea6072c37f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:32.400777 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248a899-dd88-49c2-9410-0ea6072c37f0 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:32.401262 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248a899-dd88-49c2-9410-0ea6072c37f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:32.402089 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248a899-dd88-49c2-9410-0ea6072c37f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:32.453965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:32.461939 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75930282-b414-423c-9f46-cb4124bdeb02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:32.463234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75930282-b414-423c-9f46-cb4124bdeb02 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:32.479467 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248a899-dd88-49c2-9410-0ea6072c37f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:32.481268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248a899-dd88-49c2-9410-0ea6072c37f0 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:32.568872 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 333/658] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:34:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:34:32.569657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75930282-b414-423c-9f46-cb4124bdeb02 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:32.591219 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:32.597117 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 326/659] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:34:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:34:32.598316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248a899-dd88-49c2-9410-0ea6072c37f0 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:32.691309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:32.700748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75930282-b414-423c-9f46-cb4124bdeb02 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:32.709122 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248a899-dd88-49c2-9410-0ea6072c37f0 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:32.749146 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17273a8d-4cde-40e6-85ca-1501c429ec13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:32.750181 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17273a8d-4cde-40e6-85ca-1501c429ec13 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:32.750735 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17273a8d-4cde-40e6-85ca-1501c429ec13 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:32.751121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93486fb0-d0fa-403f-84ac-aff15e848e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:32.751446 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17273a8d-4cde-40e6-85ca-1501c429ec13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:32.751899 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93486fb0-d0fa-403f-84ac-aff15e848e06 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:32.752242 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93486fb0-d0fa-403f-84ac-aff15e848e06 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:32.752808 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93486fb0-d0fa-403f-84ac-aff15e848e06 None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:32.753627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93486fb0-d0fa-403f-84ac-aff15e848e06 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:32.754187 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93486fb0-d0fa-403f-84ac-aff15e848e06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:32.756349 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93486fb0-d0fa-403f-84ac-aff15e848e06 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:32.765538 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17273a8d-4cde-40e6-85ca-1501c429ec13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:32.766976 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17273a8d-4cde-40e6-85ca-1501c429ec13 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:32.780929 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 334/660] 10.222.0.15 () {56 vars in 1139 bytes} [Wed Sep 14 19:34:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:32.782077 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93486fb0-d0fa-403f-84ac-aff15e848e06 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:32.783255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-17273a8d-4cde-40e6-85ca-1501c429ec13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:32.783255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:32.783255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:32.783255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:32.783255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:32.783255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:32.783255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:32.783255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:32.783255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:32.783255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:32.783255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:32.783255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:32.783255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:32.783255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:32.783255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:32.783255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:32.784794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:32.784794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:32.784794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:32.784794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:32.784794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:32.784794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:32.784794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:32.784794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:32.784794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:32.784794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:32.784794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:32.784794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:32.784794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:32.784794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:32.784794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:32.784794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:32.784794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:32.785674 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:32.785674 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:32.785674 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:32.785674 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 327/661] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:32.786920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17273a8d-4cde-40e6-85ca-1501c429ec13 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:32.840891 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:32.894462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17273a8d-4cde-40e6-85ca-1501c429ec13 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:32.906856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93486fb0-d0fa-403f-84ac-aff15e848e06 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:32.931957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9d986-fe1d-47d1-ac89-e6375731a15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:32.932614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9d986-fe1d-47d1-ac89-e6375731a15b None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:32.932843 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9d986-fe1d-47d1-ac89-e6375731a15b None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:32.933117 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9d986-fe1d-47d1-ac89-e6375731a15b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:32.946042 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef54615-f1d8-4ac2-b20a-062e90e961c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:32.946600 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef54615-f1d8-4ac2-b20a-062e90e961c2 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:32.946879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef54615-f1d8-4ac2-b20a-062e90e961c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:32.947155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef54615-f1d8-4ac2-b20a-062e90e961c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:32.958366 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef54615-f1d8-4ac2-b20a-062e90e961c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:32.959834 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef54615-f1d8-4ac2-b20a-062e90e961c2 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:32.974997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-7ef54615-f1d8-4ac2-b20a-062e90e961c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:32.974997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:32.974997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:32.974997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:32.974997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:32.974997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:32.974997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:32.974997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:32.974997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:32.974997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:32.974997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:32.974997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:32.974997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:32.974997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:32.974997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:32.974997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:32.976045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:32.976045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:32.976045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:32.976045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:32.976045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:32.976045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:32.976045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:32.976045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:32.976045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:32.976045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:32.976045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:32.976045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:32.976045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:32.976045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:32.976045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:32.976045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:32.976045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:32.981714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:32.981714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:32.981714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:32.981714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 335/662] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:32.981714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef54615-f1d8-4ac2-b20a-062e90e961c2 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:32.984267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:33.009553 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9d986-fe1d-47d1-ac89-e6375731a15b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:33.011043 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9d986-fe1d-47d1-ac89-e6375731a15b None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:33.062333 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:33.086146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef54615-f1d8-4ac2-b20a-062e90e961c2 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:33.113510 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 328/663] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:34:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:34:33.114771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99557fb-7302-4b99-a9f1-1f6c2b358383 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:33.115048 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99557fb-7302-4b99-a9f1-1f6c2b358383 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:33.115313 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99557fb-7302-4b99-a9f1-1f6c2b358383 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:33.116724 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 329/664] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:33.120637 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99557fb-7302-4b99-a9f1-1f6c2b358383 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:33.131027 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecab05d-2bf8-478e-9c40-2a4a16b37147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:33.131680 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecab05d-2bf8-478e-9c40-2a4a16b37147 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:33.131962 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecab05d-2bf8-478e-9c40-2a4a16b37147 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:33.132232 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecab05d-2bf8-478e-9c40-2a4a16b37147 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:33.132876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecab05d-2bf8-478e-9c40-2a4a16b37147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:33.133178 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecab05d-2bf8-478e-9c40-2a4a16b37147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:33.134547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecab05d-2bf8-478e-9c40-2a4a16b37147 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:33.147452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 336/665] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:33.148313 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecab05d-2bf8-478e-9c40-2a4a16b37147 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:33.215076 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:33.238897 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99557fb-7302-4b99-a9f1-1f6c2b358383 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:33.258136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecab05d-2bf8-478e-9c40-2a4a16b37147 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:33.274882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8a696-b076-4b13-b3ea-43ddb2f59489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:33.275495 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8a696-b076-4b13-b3ea-43ddb2f59489 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:33.275798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8a696-b076-4b13-b3ea-43ddb2f59489 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:33.276074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8a696-b076-4b13-b3ea-43ddb2f59489 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:33.276971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8a696-b076-4b13-b3ea-43ddb2f59489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:33.277285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8a696-b076-4b13-b3ea-43ddb2f59489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:33.278648 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8a696-b076-4b13-b3ea-43ddb2f59489 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:33.290545 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 330/666] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:33.291977 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad7853-b017-40b0-9d6a-79451fb6b4a3 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:33.292422 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad7853-b017-40b0-9d6a-79451fb6b4a3 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:33.292853 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad7853-b017-40b0-9d6a-79451fb6b4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:33.301483 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea884cc-3ed0-45c5-a544-fc07d9d53861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:33.302126 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea884cc-3ed0-45c5-a544-fc07d9d53861 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:33.302410 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea884cc-3ed0-45c5-a544-fc07d9d53861 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:33.302710 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea884cc-3ed0-45c5-a544-fc07d9d53861 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:33.312365 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-b9ad7853-b017-40b0-9d6a-79451fb6b4a3 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:33.313396 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea884cc-3ed0-45c5-a544-fc07d9d53861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:33.313526 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b9ad7853-b017-40b0-9d6a-79451fb6b4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:33.314853 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea884cc-3ed0-45c5-a544-fc07d9d53861 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:33.318007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:33.330579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-dea884cc-3ed0-45c5-a544-fc07d9d53861 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:33.330579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:33.330579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:33.330579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:33.330579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:33.330579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:33.330579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:33.330579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:33.330579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:33.330579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:33.330579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:33.330579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:33.330579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:33.330579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:33.330579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:33.330579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:33.332336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:33.332336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:33.332336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:33.332336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:33.332336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:33.332336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:33.332336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:33.332336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:33.332336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:33.332336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:33.332336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:33.332336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:33.332336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:33.332336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:33.332336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:33.332336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:33.332336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:33.333290 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:33.333290 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:33.333290 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:33.333290 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 337/667] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:33.333290 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea884cc-3ed0-45c5-a544-fc07d9d53861 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:33.411574 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 331/668] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:33.411574 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad7853-b017-40b0-9d6a-79451fb6b4a3 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:33.461653 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea884cc-3ed0-45c5-a544-fc07d9d53861 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:33.483832 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:33.504475 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f9ff6-7743-4ff4-b05a-66d0a26ebd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:33.505182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f9ff6-7743-4ff4-b05a-66d0a26ebd4e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:33.505470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f9ff6-7743-4ff4-b05a-66d0a26ebd4e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:33.508761 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f9ff6-7743-4ff4-b05a-66d0a26ebd4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:33.513212 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f9ff6-7743-4ff4-b05a-66d0a26ebd4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:33.514882 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f9ff6-7743-4ff4-b05a-66d0a26ebd4e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:33.524086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad7853-b017-40b0-9d6a-79451fb6b4a3 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:33.527716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-923f9ff6-7743-4ff4-b05a-66d0a26ebd4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:33.527716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:33.527716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:33.527716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:33.527716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:33.527716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:33.527716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:33.527716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:33.527716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:33.527716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:33.527716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:33.527716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:33.527716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:33.527716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:33.527716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:33.528768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:33.528768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:33.528768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:33.528768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:33.528768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:33.528768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:33.528768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:33.528768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:33.528768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:33.528768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:33.528768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:33.528768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:33.528768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:33.528768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:33.528768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:33.528768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:33.528768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:33.529857 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:33.529857 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:33.529857 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:33.529857 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:33.529857 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:33.529857 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:33.529857 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:33.529857 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:33.531594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 338/669] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:33.532524 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f9ff6-7743-4ff4-b05a-66d0a26ebd4e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:33.564875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a3dad-8be4-4516-86a8-25c121f66b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:33.565590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a3dad-8be4-4516-86a8-25c121f66b48 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:33.565865 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a3dad-8be4-4516-86a8-25c121f66b48 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:33.566137 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a3dad-8be4-4516-86a8-25c121f66b48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:33.572969 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a3dad-8be4-4516-86a8-25c121f66b48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:33.574404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a3dad-8be4-4516-86a8-25c121f66b48 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:33.577581 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:33.587289 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-c01a3dad-8be4-4516-86a8-25c121f66b48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:33.587289 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:33.587289 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:33.587289 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:33.587289 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:33.587289 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:33.587289 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:33.587289 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:33.587289 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:33.587289 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:33.587289 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:33.587289 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:33.587289 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:33.587289 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:33.587289 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:33.594319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:33.594319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:33.594319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:33.594319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:33.594319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:33.594319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:33.594319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:33.594319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:33.594319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:33.594319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:33.594319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:33.594319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:33.594319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:33.594319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:33.594319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:33.594319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:33.594319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:33.595423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:33.595423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:33.595423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:33.595423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:33.595423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:33.595423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:33.595423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:33.595423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:33.595423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 332/670] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:33.595423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84dc9c-98b3-4a3e-a25c-894cac22b933 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:33.595423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84dc9c-98b3-4a3e-a25c-894cac22b933 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:33.596213 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84dc9c-98b3-4a3e-a25c-894cac22b933 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:33.596213 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 333/671] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:33.596956 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84dc9c-98b3-4a3e-a25c-894cac22b933 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:33.660681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f9ff6-7743-4ff4-b05a-66d0a26ebd4e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:33.696280 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05915e-a756-4f6a-a732-b3b2e0dd291a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:33.696948 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05915e-a756-4f6a-a732-b3b2e0dd291a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:33.697493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05915e-a756-4f6a-a732-b3b2e0dd291a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:33.697493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05915e-a756-4f6a-a732-b3b2e0dd291a None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:33.698110 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05915e-a756-4f6a-a732-b3b2e0dd291a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:33.698498 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05915e-a756-4f6a-a732-b3b2e0dd291a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:33.699867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05915e-a756-4f6a-a732-b3b2e0dd291a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:33.710309 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84dc9c-98b3-4a3e-a25c-894cac22b933 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:33.711265 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 339/672] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:33.712521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fd361-c164-4c90-a7ed-8cc484cf01fa None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:33.712801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fd361-c164-4c90-a7ed-8cc484cf01fa None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:33.713071 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fd361-c164-4c90-a7ed-8cc484cf01fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:33.732060 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-bf1fd361-c164-4c90-a7ed-8cc484cf01fa None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:33.733250 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-bf1fd361-c164-4c90-a7ed-8cc484cf01fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:33.744776 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6eda90-22aa-445b-81da-d88a64676ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:33.745320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6eda90-22aa-445b-81da-d88a64676ed3 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:33.745596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6eda90-22aa-445b-81da-d88a64676ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:33.745864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6eda90-22aa-445b-81da-d88a64676ed3 None admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:33.746557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6eda90-22aa-445b-81da-d88a64676ed3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:33.746862 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6eda90-22aa-445b-81da-d88a64676ed3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:33.748305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6eda90-22aa-445b-81da-d88a64676ed3 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:33.760508 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 334/673] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:33.761304 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6eda90-22aa-445b-81da-d88a64676ed3 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:33.761601 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:33.807089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 340/674] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:33.807959 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fd361-c164-4c90-a7ed-8cc484cf01fa None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:33.820036 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:33.861563 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6eda90-22aa-445b-81da-d88a64676ed3 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:33.897827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc4118-b96e-4264-996b-cdbd1599d2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:33.898587 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc4118-b96e-4264-996b-cdbd1599d2c4 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:33.898859 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc4118-b96e-4264-996b-cdbd1599d2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:33.899132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc4118-b96e-4264-996b-cdbd1599d2c4 None admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:33.899902 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc4118-b96e-4264-996b-cdbd1599d2c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:33.900204 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc4118-b96e-4264-996b-cdbd1599d2c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:33.902141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc4118-b96e-4264-996b-cdbd1599d2c4 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:33.914373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 335/675] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:33.915166 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc4118-b96e-4264-996b-cdbd1599d2c4 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:33.924417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fd361-c164-4c90-a7ed-8cc484cf01fa None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:33.963441 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024e28b-c7dd-4a12-88bc-5a1c323a7834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:33.964100 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024e28b-c7dd-4a12-88bc-5a1c323a7834 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:33.964380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024e28b-c7dd-4a12-88bc-5a1c323a7834 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:33.964648 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024e28b-c7dd-4a12-88bc-5a1c323a7834 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:33.976214 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024e28b-c7dd-4a12-88bc-5a1c323a7834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:33.982518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-8024e28b-c7dd-4a12-88bc-5a1c323a7834 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:34:33.982518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:33.982518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:33.982518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:33.982518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:33.982518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:33.982518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:33.982518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:33.982518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:33.982518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:33.982518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:33.982518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:33.982518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:33.982518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:33.982518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:33.982518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:33.983450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:33.983450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:33.983450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:33.983450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:33.983450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:33.983450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:33.983450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:33.983450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:33.983450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:33.983450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:33.983450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:33.983450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:33.983450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:33.983450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:33.983450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:33.983450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:33.984615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:33.984615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:33.984615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:33.984615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:33.984615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:33.984615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:33.984615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:33.984615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:33.984615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:33.984615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:33.984615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:34:33.984615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:33.990651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 341/676] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:34:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:33.990651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024e28b-c7dd-4a12-88bc-5a1c323a7834 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:34.020973 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:34.025877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc4118-b96e-4264-996b-cdbd1599d2c4 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:34.047896 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:34.063290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11fcf4-685d-455e-abab-56993a920933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:34.063807 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11fcf4-685d-455e-abab-56993a920933 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:34.064122 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11fcf4-685d-455e-abab-56993a920933 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:34.064436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11fcf4-685d-455e-abab-56993a920933 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:34.071917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11fcf4-685d-455e-abab-56993a920933 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:34.073415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11fcf4-685d-455e-abab-56993a920933 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:34.085156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-ec11fcf4-685d-455e-abab-56993a920933 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:34.085156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:34.085156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:34.085156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:34.085156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:34.085156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:34.085156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:34.085156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:34.085156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:34.085156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:34.085156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:34.085156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:34.085156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:34.085156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:34.085156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:34.086242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:34.086242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:34.086242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:34.086242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:34.086242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:34.086242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:34.086242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:34.086242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:34.086242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:34.086242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:34.086242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:34.086242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:34.086242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:34.086242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:34.086242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:34.086242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:34.086242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:34.087129 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:34.087129 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:34.087129 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:34.087129 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:34.087129 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:34.087129 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:34.087129 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:34.087129 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:34.087129 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 336/677] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:34.087129 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11fcf4-685d-455e-abab-56993a920933 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:34.100008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024e28b-c7dd-4a12-88bc-5a1c323a7834 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:34.135519 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869793d-013f-4404-a74f-add6614b83ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:34.136149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869793d-013f-4404-a74f-add6614b83ff None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:34.136425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869793d-013f-4404-a74f-add6614b83ff None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:34.136701 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869793d-013f-4404-a74f-add6614b83ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:34.137414 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869793d-013f-4404-a74f-add6614b83ff None admin] RBAC: Adding query filter params (role.id=b2e8ea485659485f92e729741880d447, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=fe18c9b67d814fbba4614cf7491e136e) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:34.137720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869793d-013f-4404-a74f-add6614b83ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:34.139189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869793d-013f-4404-a74f-add6614b83ff None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:34.145180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 342/678] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:34:33 2022] GET /identity/v3/role_assignments?user.id=fe18c9b67d814fbba4614cf7491e136e&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=b2e8ea485659485f92e729741880d447 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:34.145948 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869793d-013f-4404-a74f-add6614b83ff None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:34.200875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11fcf4-685d-455e-abab-56993a920933 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:34.243488 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20569bc0-56e8-4374-8365-95ea6aae6402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:34.244201 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20569bc0-56e8-4374-8365-95ea6aae6402 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:34.244642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20569bc0-56e8-4374-8365-95ea6aae6402 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:34.244924 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20569bc0-56e8-4374-8365-95ea6aae6402 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:34.245982 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20569bc0-56e8-4374-8365-95ea6aae6402 None admin] RBAC: Adding query filter params (role.id=b2e8ea485659485f92e729741880d447, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=a2faa7ffc99948478ec7b81842139078) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:34.246297 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20569bc0-56e8-4374-8365-95ea6aae6402 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:34.247787 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20569bc0-56e8-4374-8365-95ea6aae6402 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:34.251602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:34.258072 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 337/679] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:34:34 2022] GET /identity/v3/role_assignments?user.id=a2faa7ffc99948478ec7b81842139078&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=b2e8ea485659485f92e729741880d447 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:34.259035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20569bc0-56e8-4374-8365-95ea6aae6402 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:34.263485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869793d-013f-4404-a74f-add6614b83ff None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:34.305295 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1669435-9c7c-4fc9-944c-d0dc993613c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:34.306245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1669435-9c7c-4fc9-944c-d0dc993613c9 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:34.306677 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1669435-9c7c-4fc9-944c-d0dc993613c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:34.307147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1669435-9c7c-4fc9-944c-d0dc993613c9 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:34.308029 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1669435-9c7c-4fc9-944c-d0dc993613c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:34.308517 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1669435-9c7c-4fc9-944c-d0dc993613c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:34.310169 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1669435-9c7c-4fc9-944c-d0dc993613c9 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:34.321346 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 343/680] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:34:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:34.323382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1669435-9c7c-4fc9-944c-d0dc993613c9 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:34.326744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:34.413663 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20569bc0-56e8-4374-8365-95ea6aae6402 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:34.456299 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1669435-9c7c-4fc9-944c-d0dc993613c9 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:34.463450 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f699512-afce-4a96-b238-57fd99f19eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:34.464202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f699512-afce-4a96-b238-57fd99f19eb0 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:34.464479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f699512-afce-4a96-b238-57fd99f19eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:34.464746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f699512-afce-4a96-b238-57fd99f19eb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:34.478299 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f699512-afce-4a96-b238-57fd99f19eb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:34.483683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-3f699512-afce-4a96-b238-57fd99f19eb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:34.483683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:34.483683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:34.483683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:34.483683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:34.483683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:34.483683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:34.483683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:34.483683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:34.483683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:34.483683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:34.483683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:34.483683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:34.483683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:34.483683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:34.483683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:34.484597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:34.484597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:34.484597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:34.484597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:34.484597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:34.484597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:34.484597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:34.484597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:34.484597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:34.484597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:34.484597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:34.484597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:34.484597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:34.484597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:34.484597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:34.484597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:34.485411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:34.485411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:34.485411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:34.485411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:34.485411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:34.485411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:34.485411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:34.485411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:34.485411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:34.485411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:34.485411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:34.485411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:34.485411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 338/681] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:34:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:34.486088 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f699512-afce-4a96-b238-57fd99f19eb0 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:34.495154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6253e-0228-4e43-adcc-0335e01f008b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:34.495811 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6253e-0228-4e43-adcc-0335e01f008b None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:34.496086 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6253e-0228-4e43-adcc-0335e01f008b None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:34.496353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6253e-0228-4e43-adcc-0335e01f008b None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:34.497043 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6253e-0228-4e43-adcc-0335e01f008b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:34.497352 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6253e-0228-4e43-adcc-0335e01f008b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:34.498763 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6253e-0228-4e43-adcc-0335e01f008b None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:34.516652 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 344/682] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:34.516652 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6253e-0228-4e43-adcc-0335e01f008b None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:34.530923 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:34.622862 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f699512-afce-4a96-b238-57fd99f19eb0 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:34.634480 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:34.652421 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6253e-0228-4e43-adcc-0335e01f008b None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:34.668505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9f493-a1fd-401a-bd5d-a3aa55f11985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:34.669152 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9f493-a1fd-401a-bd5d-a3aa55f11985 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:34.669430 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9f493-a1fd-401a-bd5d-a3aa55f11985 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:34.669699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9f493-a1fd-401a-bd5d-a3aa55f11985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:34.681655 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9f493-a1fd-401a-bd5d-a3aa55f11985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:34.683509 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9f493-a1fd-401a-bd5d-a3aa55f11985 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:34.696318 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eec44e-d49f-44a1-b83c-e4f03d44c433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:34.697625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eec44e-d49f-44a1-b83c-e4f03d44c433 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:34.698112 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eec44e-d49f-44a1-b83c-e4f03d44c433 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:34.698590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eec44e-d49f-44a1-b83c-e4f03d44c433 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:34.699352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-19d9f493-a1fd-401a-bd5d-a3aa55f11985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:34.699352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:34.699352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:34.699352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:34.699352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:34.699352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:34.699352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:34.699352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:34.699352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:34.699352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:34.699352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:34.699352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:34.699352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:34.699352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:34.699352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:34.699352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:34.700294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:34.700294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:34.700294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:34.700294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:34.700294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:34.700294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:34.700294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:34.700294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:34.700294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:34.700294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:34.700294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:34.700294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:34.700294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:34.700294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:34.700294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:34.700294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:34.700294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:34.701578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:34.701578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:34.701578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:34.702185 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eec44e-d49f-44a1-b83c-e4f03d44c433 None admin] RBAC: Adding query filter params (name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:34.702706 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eec44e-d49f-44a1-b83c-e4f03d44c433 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:34.704331 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eec44e-d49f-44a1-b83c-e4f03d44c433 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:34.705290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 339/683] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:34.706148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9f493-a1fd-401a-bd5d-a3aa55f11985 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:34.720110 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 345/684] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Sep 14 19:34:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:34.721360 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eec44e-d49f-44a1-b83c-e4f03d44c433 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:34.810087 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:34.817313 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9f493-a1fd-401a-bd5d-a3aa55f11985 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:34.843595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eec44e-d49f-44a1-b83c-e4f03d44c433 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:34.862161 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361d615-731a-4a81-9cbc-3bedf512d40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:34.864385 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361d615-731a-4a81-9cbc-3bedf512d40e None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:34.864818 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361d615-731a-4a81-9cbc-3bedf512d40e None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:34.865499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361d615-731a-4a81-9cbc-3bedf512d40e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:34.866404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361d615-731a-4a81-9cbc-3bedf512d40e None admin] RBAC: Adding query filter params (role.id=b2e8ea485659485f92e729741880d447, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=221300017882415ca3a7c9192343b956) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:34.867109 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361d615-731a-4a81-9cbc-3bedf512d40e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:34.869408 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361d615-731a-4a81-9cbc-3bedf512d40e None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:34.883651 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 340/685] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:34:34 2022] GET /identity/v3/role_assignments?user.id=221300017882415ca3a7c9192343b956&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=b2e8ea485659485f92e729741880d447 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:34.883651 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361d615-731a-4a81-9cbc-3bedf512d40e None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:34.885471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987ffca-2344-4412-868c-d987d6b25fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:34.885471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987ffca-2344-4412-868c-d987d6b25fa8 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:34.885471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987ffca-2344-4412-868c-d987d6b25fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:34.885471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987ffca-2344-4412-868c-d987d6b25fa8 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:34.886543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987ffca-2344-4412-868c-d987d6b25fa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:34.886543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987ffca-2344-4412-868c-d987d6b25fa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:34.887791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987ffca-2344-4412-868c-d987d6b25fa8 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:34.916775 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 346/686] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:34.918948 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987ffca-2344-4412-868c-d987d6b25fa8 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:34.929568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:35.094126 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361d615-731a-4a81-9cbc-3bedf512d40e None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:35.109416 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987ffca-2344-4412-868c-d987d6b25fa8 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:35.148610 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af9d35-d6a8-46fe-bd70-c28241690794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:35.149532 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af9d35-d6a8-46fe-bd70-c28241690794 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:35.149815 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af9d35-d6a8-46fe-bd70-c28241690794 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:35.150084 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af9d35-d6a8-46fe-bd70-c28241690794 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:35.154338 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaee733-4695-42de-82be-f0972d841a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:35.155249 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaee733-4695-42de-82be-f0972d841a7c None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:35.155715 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaee733-4695-42de-82be-f0972d841a7c None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:35.156168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaee733-4695-42de-82be-f0972d841a7c None admin] PATH_INFO: `/v3/users/nova` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:35.159520 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:35.163339 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af9d35-d6a8-46fe-bd70-c28241690794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:35.164869 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af9d35-d6a8-46fe-bd70-c28241690794 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:35.167605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaee733-4695-42de-82be-f0972d841a7c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:35.169266 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaee733-4695-42de-82be-f0972d841a7c None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:35.183424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-68af9d35-d6a8-46fe-bd70-c28241690794 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:35.183424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:35.183424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:35.183424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:35.183424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:35.183424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:35.183424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:35.183424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:35.183424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:35.183424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:35.183424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:35.183424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:35.183424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:35.183424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:35.183424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:35.183424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:35.190402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:35.190402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:35.190402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:35.190402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:35.190402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:35.190402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:35.190402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:35.190402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:35.190402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:35.190402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:35.190402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:35.190402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:35.190402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:35.190402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:35.190402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:35.190402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:35.190402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:35.192008 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:35.192008 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:35.192008 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:35.192200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-cdaee733-4695-42de-82be-f0972d841a7c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 19:34:35.192200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:35.192200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:35.192200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:35.192200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:35.192200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:35.192200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:35.192200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:35.192200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:35.192200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:35.192200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:35.192200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:35.192200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:35.192200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:35.192200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:35.192200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:35.193033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:35.193033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:35.193033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:35.193033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:35.193033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:35.193033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:35.193033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:35.193033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:35.193033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:35.193033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:35.193033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:35.193033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:35.193033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:35.193033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:35.193033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:35.193033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:35.193033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:35.193033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:35.193982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:35.193982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:35.193982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:35.193982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:35.193982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:35.193982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:35.193982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:35.193982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:35.193982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 19:34:35.193982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:35.194495 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 341/687] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:35.194565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 347/688] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Sep 14 19:34:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:35.194630 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af9d35-d6a8-46fe-bd70-c28241690794 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:35.194696 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaee733-4695-42de-82be-f0972d841a7c None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:35.289890 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:35.314031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaee733-4695-42de-82be-f0972d841a7c None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:35.334965 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af9d35-d6a8-46fe-bd70-c28241690794 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:35.362530 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606bc36-1647-4655-8ad4-4506bbf03707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:35.363675 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606bc36-1647-4655-8ad4-4506bbf03707 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:35.363995 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606bc36-1647-4655-8ad4-4506bbf03707 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:35.364267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606bc36-1647-4655-8ad4-4506bbf03707 None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:35.365286 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606bc36-1647-4655-8ad4-4506bbf03707 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:35.365600 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606bc36-1647-4655-8ad4-4506bbf03707 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:35.367325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606bc36-1647-4655-8ad4-4506bbf03707 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:35.379821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54c694-feb1-468e-bf89-ddb9ecd8bcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:35.380741 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54c694-feb1-468e-bf89-ddb9ecd8bcae None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:35.381214 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54c694-feb1-468e-bf89-ddb9ecd8bcae None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:35.381677 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54c694-feb1-468e-bf89-ddb9ecd8bcae None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:35.382528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54c694-feb1-468e-bf89-ddb9ecd8bcae None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:35.383038 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54c694-feb1-468e-bf89-ddb9ecd8bcae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:35.384670 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54c694-feb1-468e-bf89-ddb9ecd8bcae None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:35.388740 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 348/689] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Sep 14 19:34:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:35.397501 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606bc36-1647-4655-8ad4-4506bbf03707 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:35.407511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 342/690] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:35.415412 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54c694-feb1-468e-bf89-ddb9ecd8bcae None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:35.498492 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:35.589289 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606bc36-1647-4655-8ad4-4506bbf03707 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:35.605181 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54c694-feb1-468e-bf89-ddb9ecd8bcae None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:35.637140 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:35.644334 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f29c42-24f4-43a0-96c7-ceb0c44ef210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:35.647176 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f29c42-24f4-43a0-96c7-ceb0c44ef210 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:35.647176 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f29c42-24f4-43a0-96c7-ceb0c44ef210 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:35.647176 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f29c42-24f4-43a0-96c7-ceb0c44ef210 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:35.654458 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f29c42-24f4-43a0-96c7-ceb0c44ef210 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:35.656191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f29c42-24f4-43a0-96c7-ceb0c44ef210 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:35.669236 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58960625-3341-412f-8eb5-8715d7adbf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:35.669716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-21f29c42-24f4-43a0-96c7-ceb0c44ef210 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 19:34:35.669716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:35.669716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:35.669716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:35.669716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:35.669716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:35.669716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:35.669716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:35.669716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:35.669716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:35.669716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:35.669716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:35.669716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:35.669716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:35.669716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:35.669716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:35.670687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:35.670687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:35.670687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:35.670687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:35.670687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:35.670687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:35.670687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:35.670687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:35.670687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:35.670687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:35.670687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:35.670687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:35.670687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:35.670687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:35.670687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:35.670687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:35.670687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:35.670687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:35.671656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:35.671656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:35.671656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:35.671656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:35.671656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:35.671656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:35.671656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:35.671656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:35.671656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 19:34:35.671656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:35.672193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58960625-3341-412f-8eb5-8715d7adbf7e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:35.672193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58960625-3341-412f-8eb5-8715d7adbf7e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:35.672193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58960625-3341-412f-8eb5-8715d7adbf7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:35.674337 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 343/691] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:34:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:35.688562 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f29c42-24f4-43a0-96c7-ceb0c44ef210 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:35.750667 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58960625-3341-412f-8eb5-8715d7adbf7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:35.752175 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58960625-3341-412f-8eb5-8715d7adbf7e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:35.807892 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:35.858352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f29c42-24f4-43a0-96c7-ceb0c44ef210 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:35.899060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcf67a-9281-49e8-844c-df00d3e0b34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:35.900058 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcf67a-9281-49e8-844c-df00d3e0b34c None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:35.900537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcf67a-9281-49e8-844c-df00d3e0b34c None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:35.901055 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcf67a-9281-49e8-844c-df00d3e0b34c None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:35.902015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcf67a-9281-49e8-844c-df00d3e0b34c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:35.902765 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcf67a-9281-49e8-844c-df00d3e0b34c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:35.904583 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcf67a-9281-49e8-844c-df00d3e0b34c None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:35.914706 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 349/692] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:34:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 19:34:35.920961 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58960625-3341-412f-8eb5-8715d7adbf7e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:35.924749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 344/693] 10.222.0.15 () {56 vars in 1135 bytes} [Wed Sep 14 19:34:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:35.937358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcf67a-9281-49e8-844c-df00d3e0b34c None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:35.999576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:36.094448 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58960625-3341-412f-8eb5-8715d7adbf7e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:36.109591 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcf67a-9281-49e8-844c-df00d3e0b34c None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:36.134595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd3a9b-2988-4d7a-936f-acaf717c1469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:36.135703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd3a9b-2988-4d7a-936f-acaf717c1469 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:36.136189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd3a9b-2988-4d7a-936f-acaf717c1469 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:36.136663 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd3a9b-2988-4d7a-936f-acaf717c1469 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:36.148450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd3a9b-2988-4d7a-936f-acaf717c1469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:36.150280 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd3a9b-2988-4d7a-936f-acaf717c1469 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:36.167268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-cafd3a9b-2988-4d7a-936f-acaf717c1469 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:36.167268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:36.167268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:36.167268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:36.167268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:36.167268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:36.167268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:36.167268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:36.167268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:36.167268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:36.167268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:36.167268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:36.167268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:36.167268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:36.167268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:36.167268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:36.168243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:36.168243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:36.168243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:36.168243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:36.168243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:36.168243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:36.168243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:36.168243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:36.168243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:36.168243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:36.168243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:36.168243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:36.168243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:36.168243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:36.168243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:36.168243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:36.168243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:36.169165 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:36.169165 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:36.169165 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:36.171328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 350/694] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:36.176898 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd3a9b-2988-4d7a-936f-acaf717c1469 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:36.186611 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d43087-d9d5-45de-ab72-c69ab758f6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:36.187492 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d43087-d9d5-45de-ab72-c69ab758f6a7 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:36.189628 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d43087-d9d5-45de-ab72-c69ab758f6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:36.190174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d43087-d9d5-45de-ab72-c69ab758f6a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:36.198132 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:36.314980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d43087-d9d5-45de-ab72-c69ab758f6a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:36.316530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d43087-d9d5-45de-ab72-c69ab758f6a7 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:36.316982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd3a9b-2988-4d7a-936f-acaf717c1469 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:36.376875 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798e694-c358-4e62-a157-64ca74536b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:36.377836 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798e694-c358-4e62-a157-64ca74536b47 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:36.378427 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798e694-c358-4e62-a157-64ca74536b47 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:36.378968 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798e694-c358-4e62-a157-64ca74536b47 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:36.380044 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798e694-c358-4e62-a157-64ca74536b47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:36.380566 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798e694-c358-4e62-a157-64ca74536b47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:36.382186 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798e694-c358-4e62-a157-64ca74536b47 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:36.408598 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 351/695] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:36.414013 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798e694-c358-4e62-a157-64ca74536b47 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:36.424666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:36.505346 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 345/696] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:34:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 19:34:36.508277 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d43087-d9d5-45de-ab72-c69ab758f6a7 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:36.550572 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:36.620591 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798e694-c358-4e62-a157-64ca74536b47 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:36.656679 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d0a00-c73e-4fa7-9ae3-99d89828d497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:36.657320 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d0a00-c73e-4fa7-9ae3-99d89828d497 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:36.657594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d0a00-c73e-4fa7-9ae3-99d89828d497 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:36.657864 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d0a00-c73e-4fa7-9ae3-99d89828d497 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:36.664965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d0a00-c73e-4fa7-9ae3-99d89828d497 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:36.666436 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d0a00-c73e-4fa7-9ae3-99d89828d497 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:36.679192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-6a7d0a00-c73e-4fa7-9ae3-99d89828d497 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:36.679192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:36.679192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:36.679192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:36.679192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:36.679192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:36.679192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:36.679192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:36.679192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:36.679192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:36.679192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:36.679192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:36.679192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:36.679192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:36.679192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:36.680168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:36.680168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:36.680168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:36.680168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:36.680168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:36.680168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:36.680168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:36.680168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:36.680168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:36.680168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:36.680168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:36.680168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:36.680168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:36.680168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:36.680168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:36.680168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:36.680168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:36.681279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:36.681279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:36.681279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:36.681279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:36.681279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:36.681279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:36.681279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:36.681279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:36.681279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 352/697] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:36.687576 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d0a00-c73e-4fa7-9ae3-99d89828d497 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:36.754035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d43087-d9d5-45de-ab72-c69ab758f6a7 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:36.804484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d0a00-c73e-4fa7-9ae3-99d89828d497 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:36.832076 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:36.839835 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374911c6-ed06-4cc8-81ba-84fd6ea35947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:36.840564 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374911c6-ed06-4cc8-81ba-84fd6ea35947 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:36.840882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374911c6-ed06-4cc8-81ba-84fd6ea35947 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:36.841050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760d074-1b55-4e95-98ac-7409cb12f680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:36.841159 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374911c6-ed06-4cc8-81ba-84fd6ea35947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:36.841688 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760d074-1b55-4e95-98ac-7409cb12f680 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:36.841976 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760d074-1b55-4e95-98ac-7409cb12f680 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:36.842247 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760d074-1b55-4e95-98ac-7409cb12f680 None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:36.842950 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760d074-1b55-4e95-98ac-7409cb12f680 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:36.843257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760d074-1b55-4e95-98ac-7409cb12f680 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:36.844737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760d074-1b55-4e95-98ac-7409cb12f680 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:36.852311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374911c6-ed06-4cc8-81ba-84fd6ea35947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:36.853758 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374911c6-ed06-4cc8-81ba-84fd6ea35947 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:36.867824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 353/698] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:36.867824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793bb0e-257c-47d8-b916-b4f16aaca003 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:36.867824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793bb0e-257c-47d8-b916-b4f16aaca003 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:36.867824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793bb0e-257c-47d8-b916-b4f16aaca003 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:36.867824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 354/699] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:36.867824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dd387-77c0-43e2-b45a-4432b26f5a6f None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:36.868316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dd387-77c0-43e2-b45a-4432b26f5a6f None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:36.868316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dd387-77c0-43e2-b45a-4432b26f5a6f None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:36.868316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 355/700] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:36.868316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4dd387-77c0-43e2-b45a-4432b26f5a6f None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:36.876557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-374911c6-ed06-4cc8-81ba-84fd6ea35947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:36.876557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:36.876557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:36.876557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:36.876557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:36.876557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:36.876557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:36.876557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:36.876557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:36.876557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:36.876557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:36.876557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:36.876557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:36.876557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:36.876557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:36.876557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:36.883779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:36.883779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:36.883779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:36.883779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:36.883779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:36.883779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:36.883779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:36.883779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:36.883779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:36.883779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:36.883779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:36.883779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:36.883779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:36.883779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:36.883779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:36.883779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:36.883779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:36.884691 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:36.884691 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:36.884691 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:36.884691 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 346/701] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:36.884691 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b939fdd-146f-4626-8531-53fc425548bd None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:36.884691 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b939fdd-146f-4626-8531-53fc425548bd None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:36.884691 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b939fdd-146f-4626-8531-53fc425548bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:36.888321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:36.900800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-1b939fdd-146f-4626-8531-53fc425548bd None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:36.902102 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1b939fdd-146f-4626-8531-53fc425548bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:36.969931 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 347/702] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:36.971102 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ec400-0d52-4c89-bf76-c06f0ba5d33e None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:36.971388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ec400-0d52-4c89-bf76-c06f0ba5d33e None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:36.971696 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ec400-0d52-4c89-bf76-c06f0ba5d33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:36.985710 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4dd387-77c0-43e2-b45a-4432b26f5a6f None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:37.001131 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-b25ec400-0d52-4c89-bf76-c06f0ba5d33e None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:37.002633 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b25ec400-0d52-4c89-bf76-c06f0ba5d33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:37.027996 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000767b3-4dcb-401a-801f-8479b59936a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:37.028429 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000767b3-4dcb-401a-801f-8479b59936a3 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:37.028711 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000767b3-4dcb-401a-801f-8479b59936a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:37.028984 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000767b3-4dcb-401a-801f-8479b59936a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:37.029710 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000767b3-4dcb-401a-801f-8479b59936a3 None admin] RBAC: Adding query filter params (role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=421f6cc846b342918a177d2794eb3db8) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:37.030034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000767b3-4dcb-401a-801f-8479b59936a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:37.031657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000767b3-4dcb-401a-801f-8479b59936a3 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:37.047607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 356/703] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:34:36 2022] GET /identity/v3/role_assignments?user.id=421f6cc846b342918a177d2794eb3db8&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:37.047607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000767b3-4dcb-401a-801f-8479b59936a3 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:37.100038 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:37.122924 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 348/704] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:37.180575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000767b3-4dcb-401a-801f-8479b59936a3 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:37.223655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a253875-329c-46ba-b9b1-f3ae9ec86d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:37.224227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a253875-329c-46ba-b9b1-f3ae9ec86d69 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:37.224509 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a253875-329c-46ba-b9b1-f3ae9ec86d69 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:37.224786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a253875-329c-46ba-b9b1-f3ae9ec86d69 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:37.225445 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a253875-329c-46ba-b9b1-f3ae9ec86d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:37.225754 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a253875-329c-46ba-b9b1-f3ae9ec86d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:37.227225 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a253875-329c-46ba-b9b1-f3ae9ec86d69 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:37.241522 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 357/705] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:37.247322 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ec400-0d52-4c89-bf76-c06f0ba5d33e None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:37.269752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a253875-329c-46ba-b9b1-f3ae9ec86d69 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:37.345606 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:37.394940 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ec400-0d52-4c89-bf76-c06f0ba5d33e None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:37.417064 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a253875-329c-46ba-b9b1-f3ae9ec86d69 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:37.427436 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:37.455938 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881cff5-c9b1-491f-abca-dd6f70087dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:37.456960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881cff5-c9b1-491f-abca-dd6f70087dc4 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:37.457410 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881cff5-c9b1-491f-abca-dd6f70087dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:37.457818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881cff5-c9b1-491f-abca-dd6f70087dc4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:37.458545 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881cff5-c9b1-491f-abca-dd6f70087dc4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:37.459223 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff881db1-85c6-4ca7-9c21-7fa2f865379f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:37.459946 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff881db1-85c6-4ca7-9c21-7fa2f865379f None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:37.460226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff881db1-85c6-4ca7-9c21-7fa2f865379f None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:37.460364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881cff5-c9b1-491f-abca-dd6f70087dc4 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:37.460494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff881db1-85c6-4ca7-9c21-7fa2f865379f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:37.468592 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff881db1-85c6-4ca7-9c21-7fa2f865379f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:37.470062 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff881db1-85c6-4ca7-9c21-7fa2f865379f None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:37.475605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-6881cff5-c9b1-491f-abca-dd6f70087dc4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 19:34:37.475605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:37.475605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:34:37.475605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:34:37.475605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:34:37.475605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:34:37.475605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:34:37.475605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:34:37.475605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 19:34:37.475605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:37.475605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:34:37.475605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:37.475605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:37.475605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:37.475605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:37.475605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:37.475605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:37.476683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:37.476683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:37.476683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:37.476683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:37.476683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:37.476683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:37.476683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:34:37.476683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:34:37.476683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:34:37.476683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:34:37.476683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:37.476683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:37.476683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:37.476683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:37.476683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:37.476683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:37.477515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:37.477515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:37.477515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:37.477515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:37.477515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:37.477515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:37.477515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:37.477515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:37.477515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:37.477515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:37.477515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:34:37.477515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:34:37.477515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 19:34:37.477515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:37.477515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 358/706] 10.222.0.15 () {56 vars in 1129 bytes} [Wed Sep 14 19:34:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:37.478319 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881cff5-c9b1-491f-abca-dd6f70087dc4 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:37.491077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-ff881db1-85c6-4ca7-9c21-7fa2f865379f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:37.491077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:37.491077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:37.491077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:37.491077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:37.491077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:37.491077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:37.491077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:37.491077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:37.491077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:37.491077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:37.491077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:37.491077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:37.491077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:37.491077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:37.492118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:37.492118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:37.492118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:37.492118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:37.492118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:37.492118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:37.492118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:37.492118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:37.492118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:37.492118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:37.492118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:37.492118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:37.492118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:37.492118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:37.492118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:37.492118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:37.492118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:37.492992 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:37.492992 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:37.492992 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:37.492992 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:37.492992 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:37.492992 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:37.492992 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:37.492992 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:37.492992 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 349/707] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:37.493475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff881db1-85c6-4ca7-9c21-7fa2f865379f None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:37.602791 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff881db1-85c6-4ca7-9c21-7fa2f865379f None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:37.612004 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881cff5-c9b1-491f-abca-dd6f70087dc4 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:37.624855 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:37.636738 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7b52e-6959-46d7-b4ae-e609de603664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:37.637351 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7b52e-6959-46d7-b4ae-e609de603664 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:37.650159 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7b52e-6959-46d7-b4ae-e609de603664 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:37.650159 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7b52e-6959-46d7-b4ae-e609de603664 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:37.650159 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7b52e-6959-46d7-b4ae-e609de603664 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:37.650159 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7b52e-6959-46d7-b4ae-e609de603664 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:37.650159 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7b52e-6959-46d7-b4ae-e609de603664 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:37.650159 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 350/708] 10.222.0.15 () {56 vars in 1124 bytes} [Wed Sep 14 19:34:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:37.650750 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7b52e-6959-46d7-b4ae-e609de603664 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:37.657875 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298faa2-2828-4751-a415-5bb140e2d18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:37.658749 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298faa2-2828-4751-a415-5bb140e2d18a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:37.659223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298faa2-2828-4751-a415-5bb140e2d18a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:37.660003 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298faa2-2828-4751-a415-5bb140e2d18a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:37.671470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298faa2-2828-4751-a415-5bb140e2d18a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:37.673141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298faa2-2828-4751-a415-5bb140e2d18a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:37.688650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-9298faa2-2828-4751-a415-5bb140e2d18a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:37.688650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:37.688650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:37.688650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:37.688650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:37.688650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:37.688650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:37.688650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:37.688650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:37.688650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:37.688650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:37.688650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:37.688650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:37.688650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:37.688650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:37.688650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:37.689859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:37.689859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:37.689859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:37.689859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:37.689859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:37.689859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:37.689859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:37.689859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:37.689859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:37.689859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:37.689859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:37.689859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:37.689859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:37.689859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:37.689859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:37.689859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:37.689859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:37.691513 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:37.691513 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:37.691513 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:37.692946 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 359/709] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:37.694251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeee9f3-a0e0-4cb2-b202-b17a9ec48ca2 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:37.694536 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeee9f3-a0e0-4cb2-b202-b17a9ec48ca2 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:37.694812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeee9f3-a0e0-4cb2-b202-b17a9ec48ca2 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:37.699584 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 360/710] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:37.699584 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeee9f3-a0e0-4cb2-b202-b17a9ec48ca2 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:37.726092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:37.759136 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7b52e-6959-46d7-b4ae-e609de603664 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:37.795224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77fa75-5853-43b7-a0f1-d9416c75709d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:37.795871 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77fa75-5853-43b7-a0f1-d9416c75709d None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:37.803063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77fa75-5853-43b7-a0f1-d9416c75709d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:37.803063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77fa75-5853-43b7-a0f1-d9416c75709d None admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:37.803063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77fa75-5853-43b7-a0f1-d9416c75709d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:37.803063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77fa75-5853-43b7-a0f1-d9416c75709d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:37.803063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77fa75-5853-43b7-a0f1-d9416c75709d None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:37.812797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 351/711] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:37.813746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77fa75-5853-43b7-a0f1-d9416c75709d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:37.818841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeee9f3-a0e0-4cb2-b202-b17a9ec48ca2 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:37.857634 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33c2e0-e648-4a95-a65d-56379bc8b5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:37.858247 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33c2e0-e648-4a95-a65d-56379bc8b5d7 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:37.858529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33c2e0-e648-4a95-a65d-56379bc8b5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:37.858804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33c2e0-e648-4a95-a65d-56379bc8b5d7 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:37.859587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33c2e0-e648-4a95-a65d-56379bc8b5d7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:37.859782 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33c2e0-e648-4a95-a65d-56379bc8b5d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:37.861148 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33c2e0-e648-4a95-a65d-56379bc8b5d7 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:37.867080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:37.873033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 361/712] 10.222.0.15 () {56 vars in 1124 bytes} [Wed Sep 14 19:34:37 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:37.873033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe1437-507d-4a4d-b761-99333df6861d None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:37.873033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe1437-507d-4a4d-b761-99333df6861d None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:37.873033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe1437-507d-4a4d-b761-99333df6861d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:37.900437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-9dbe1437-507d-4a4d-b761-99333df6861d None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:37.901690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-9dbe1437-507d-4a4d-b761-99333df6861d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:37.928274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77fa75-5853-43b7-a0f1-d9416c75709d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:37.969375 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97775ab-3c1d-4f56-bb14-9703c53496f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:37.969998 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97775ab-3c1d-4f56-bb14-9703c53496f9 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:37.970279 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97775ab-3c1d-4f56-bb14-9703c53496f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:37.970548 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97775ab-3c1d-4f56-bb14-9703c53496f9 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:37.971202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97775ab-3c1d-4f56-bb14-9703c53496f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:37.971503 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97775ab-3c1d-4f56-bb14-9703c53496f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:37.973218 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97775ab-3c1d-4f56-bb14-9703c53496f9 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:37.990330 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 352/713] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:37.991136 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97775ab-3c1d-4f56-bb14-9703c53496f9 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:38.009218 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 362/714] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:38.010749 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe1437-507d-4a4d-b761-99333df6861d None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:38.056592 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:38.166859 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97775ab-3c1d-4f56-bb14-9703c53496f9 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:38.177115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:38.186049 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe1437-507d-4a4d-b761-99333df6861d None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:38.210930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169a221-9146-4aa7-92c8-b3fab5df798b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:38.211563 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169a221-9146-4aa7-92c8-b3fab5df798b None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:38.211853 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169a221-9146-4aa7-92c8-b3fab5df798b None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:38.212204 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169a221-9146-4aa7-92c8-b3fab5df798b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:38.213408 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169a221-9146-4aa7-92c8-b3fab5df798b None admin] RBAC: Adding query filter params (role.id=b2e8ea485659485f92e729741880d447, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=ee56bf9af257486e94e6ff1b33086f23) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:38.213726 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169a221-9146-4aa7-92c8-b3fab5df798b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:38.215164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169a221-9146-4aa7-92c8-b3fab5df798b None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:38.224536 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 353/715] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:34:37 2022] GET /identity/v3/role_assignments?user.id=ee56bf9af257486e94e6ff1b33086f23&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=b2e8ea485659485f92e729741880d447 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:38.252570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da4b92-328c-4237-a503-fa66ec0bdf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:38.253133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da4b92-328c-4237-a503-fa66ec0bdf45 None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:38.254176 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da4b92-328c-4237-a503-fa66ec0bdf45 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:38.254351 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da4b92-328c-4237-a503-fa66ec0bdf45 None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:38.255042 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da4b92-328c-4237-a503-fa66ec0bdf45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:38.256641 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da4b92-328c-4237-a503-fa66ec0bdf45 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:38.320812 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169a221-9146-4aa7-92c8-b3fab5df798b None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:38.353620 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 363/716] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Sep 14 19:34:38 2022] POST /identity/v3/users => generated 254 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:34:38.451438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169a221-9146-4aa7-92c8-b3fab5df798b None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:38.499188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98725ebf-6902-46f9-831d-8d6bdd843141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:38.499866 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98725ebf-6902-46f9-831d-8d6bdd843141 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:38.500243 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98725ebf-6902-46f9-831d-8d6bdd843141 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:38.500520 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98725ebf-6902-46f9-831d-8d6bdd843141 None admin] PATH_INFO: `/v3/services/network` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:38.501115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98725ebf-6902-46f9-831d-8d6bdd843141 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:38.502537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98725ebf-6902-46f9-831d-8d6bdd843141 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:38.515792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-98725ebf-6902-46f9-831d-8d6bdd843141 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 19:34:38.515792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:38.515792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:34:38.515792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:34:38.515792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:34:38.515792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:34:38.515792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:34:38.515792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:34:38.515792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 19:34:38.515792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:38.515792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:34:38.515792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:38.515792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:38.515792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:38.515792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:38.515792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:38.515792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:38.518247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:38.518247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:38.518247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:38.518247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:38.518247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:38.518247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:38.518247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:34:38.518247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:34:38.518247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:34:38.518247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:34:38.518247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:38.518247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:38.518247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:38.518247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:38.518247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:38.518247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:38.519442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:38.519442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:38.519442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:38.519442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:38.519442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:38.519442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:38.519442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:38.519442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:38.519442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:38.519442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:38.519442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:34:38.519442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:34:38.519442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 19:34:38.519442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:38.519442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 354/717] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:38 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:38.523524 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da4b92-328c-4237-a503-fa66ec0bdf45 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:38.615522 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:38.641878 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da4b92-328c-4237-a503-fa66ec0bdf45 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:38.679448 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0059772-9d5c-4b53-998f-4583bee57a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:38.680098 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0059772-9d5c-4b53-998f-4583bee57a55 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:38.680382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0059772-9d5c-4b53-998f-4583bee57a55 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:38.680657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0059772-9d5c-4b53-998f-4583bee57a55 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:38.681289 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0059772-9d5c-4b53-998f-4583bee57a55 None admin] RBAC: Adding query filter params (name=network) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:38.681644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0059772-9d5c-4b53-998f-4583bee57a55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:38.683065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0059772-9d5c-4b53-998f-4583bee57a55 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:38.688756 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 364/718] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Sep 14 19:34:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:38.693193 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98725ebf-6902-46f9-831d-8d6bdd843141 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:38.740719 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:38.815725 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98725ebf-6902-46f9-831d-8d6bdd843141 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:38.865619 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b827f4-2350-4d54-92ae-fdbe24603101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:38.866241 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b827f4-2350-4d54-92ae-fdbe24603101 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:38.866515 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b827f4-2350-4d54-92ae-fdbe24603101 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:38.866787 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b827f4-2350-4d54-92ae-fdbe24603101 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:38.867427 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b827f4-2350-4d54-92ae-fdbe24603101 None admin] RBAC: Adding query filter params (type=network) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:38.867754 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b827f4-2350-4d54-92ae-fdbe24603101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:38.869133 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b827f4-2350-4d54-92ae-fdbe24603101 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:38.879448 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 355/719] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Sep 14 19:34:38 2022] GET /identity/v3/services?type=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:39.616801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781533e-7ac6-4733-b76c-8d25fc95f123 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:39.617352 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781533e-7ac6-4733-b76c-8d25fc95f123 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:39.617352 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781533e-7ac6-4733-b76c-8d25fc95f123 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:39.618936 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 365/720] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:39.624084 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534713a7-27e1-4764-aeb9-1641578963a2 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:39.624319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534713a7-27e1-4764-aeb9-1641578963a2 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:39.624596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534713a7-27e1-4764-aeb9-1641578963a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:39.643009 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-534713a7-27e1-4764-aeb9-1641578963a2 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:39.644840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-534713a7-27e1-4764-aeb9-1641578963a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:39.739467 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 356/721] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:40.188563 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781533e-7ac6-4733-b76c-8d25fc95f123 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:40.336772 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781533e-7ac6-4733-b76c-8d25fc95f123 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:40.395602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38552e2-4c49-4d67-a903-2accebdb6956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:40.396257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38552e2-4c49-4d67-a903-2accebdb6956 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:40.396537 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38552e2-4c49-4d67-a903-2accebdb6956 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:40.396813 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38552e2-4c49-4d67-a903-2accebdb6956 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:40.404334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:40.409093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38552e2-4c49-4d67-a903-2accebdb6956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:40.418251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-b38552e2-4c49-4d67-a903-2accebdb6956 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:34:40.418251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:40.418251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:40.418251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:40.418251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:40.418251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:40.418251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:40.418251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:40.418251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:40.418251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:40.418251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:40.418251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:40.418251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:40.418251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:40.418251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:40.418251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:40.423809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:40.423809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:40.423809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:40.423809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:40.423809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:40.423809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:40.423809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:40.423809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:40.423809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:40.423809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:40.423809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:40.423809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:40.423809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:40.423809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:40.423809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:40.423809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:40.424649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:40.424649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:40.424649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:40.424649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:40.424649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:40.424649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:40.424649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:40.424649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:40.424649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:40.424649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:40.424649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:34:40.424649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:40.424649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 366/722] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:34:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:40.427242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534713a7-27e1-4764-aeb9-1641578963a2 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:40.460403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:40.534738 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88052290-244f-4ca6-824f-b8771e287462 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:40.535174 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88052290-244f-4ca6-824f-b8771e287462 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:40.535420 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88052290-244f-4ca6-824f-b8771e287462 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:40.536674 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 367/723] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:34:40.542189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0da6dd-0311-4077-8ca0-a99d1362e419 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:40.542569 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0da6dd-0311-4077-8ca0-a99d1362e419 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:40.542917 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0da6dd-0311-4077-8ca0-a99d1362e419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:40.555226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534713a7-27e1-4764-aeb9-1641578963a2 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:40.576566 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-6e0da6dd-0311-4077-8ca0-a99d1362e419 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:40.577870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-6e0da6dd-0311-4077-8ca0-a99d1362e419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:40.594902 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3a7da-e2e0-483b-8e35-8efa7aae4d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:40.595842 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3a7da-e2e0-483b-8e35-8efa7aae4d04 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:40.596443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3a7da-e2e0-483b-8e35-8efa7aae4d04 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:40.598088 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3a7da-e2e0-483b-8e35-8efa7aae4d04 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:40.599239 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3a7da-e2e0-483b-8e35-8efa7aae4d04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:40.599963 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3a7da-e2e0-483b-8e35-8efa7aae4d04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:40.601538 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3a7da-e2e0-483b-8e35-8efa7aae4d04 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:40.621021 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 357/724] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:34:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:40.628030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3a7da-e2e0-483b-8e35-8efa7aae4d04 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:40.701550 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 368/725] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:40.770539 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:40.781580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3a7da-e2e0-483b-8e35-8efa7aae4d04 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:40.826666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d941ba-c916-4317-8611-2b7b74113dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:40.827313 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d941ba-c916-4317-8611-2b7b74113dbb None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:40.827616 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d941ba-c916-4317-8611-2b7b74113dbb None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:40.827893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d941ba-c916-4317-8611-2b7b74113dbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:40.844436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d941ba-c916-4317-8611-2b7b74113dbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:40.845900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d941ba-c916-4317-8611-2b7b74113dbb None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:40.861762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-33d941ba-c916-4317-8611-2b7b74113dbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:40.861762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:40.861762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:40.861762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:40.861762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:40.861762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:40.861762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:40.861762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:40.861762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:40.861762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:40.861762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:40.861762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:40.861762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:40.861762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:40.861762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:40.861762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:40.862746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:40.862746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:40.862746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:40.862746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:40.862746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:40.862746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:40.862746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:40.862746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:40.862746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:40.862746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:40.862746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:40.862746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:40.862746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:40.862746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:40.862746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:40.862746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:40.862746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:40.864239 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:40.864239 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:40.864239 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:40.867888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 358/726] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:40.873103 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0da6dd-0311-4077-8ca0-a99d1362e419 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:40.996099 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0da6dd-0311-4077-8ca0-a99d1362e419 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:41.030074 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:41.043432 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9816ea-15eb-4b7d-ab0f-0d17a2af9eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:41.044139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9816ea-15eb-4b7d-ab0f-0d17a2af9eec None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:41.044424 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9816ea-15eb-4b7d-ab0f-0d17a2af9eec None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:41.044700 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9816ea-15eb-4b7d-ab0f-0d17a2af9eec None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:41.045355 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9816ea-15eb-4b7d-ab0f-0d17a2af9eec None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:41.045663 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9816ea-15eb-4b7d-ab0f-0d17a2af9eec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:41.047058 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9816ea-15eb-4b7d-ab0f-0d17a2af9eec None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:41.066961 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 369/727] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:41.072611 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d941ba-c916-4317-8611-2b7b74113dbb None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:41.169529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9816ea-15eb-4b7d-ab0f-0d17a2af9eec None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:41.188914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d941ba-c916-4317-8611-2b7b74113dbb None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:41.232676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12fcde-2dbe-476b-a656-da6e70545eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:41.233468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12fcde-2dbe-476b-a656-da6e70545eaa None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:41.233582 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12fcde-2dbe-476b-a656-da6e70545eaa None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:41.233849 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12fcde-2dbe-476b-a656-da6e70545eaa None admin] PATH_INFO: `/v3/users/nova` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:41.242799 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12fcde-2dbe-476b-a656-da6e70545eaa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:41.244284 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12fcde-2dbe-476b-a656-da6e70545eaa None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:41.260421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-4a12fcde-2dbe-476b-a656-da6e70545eaa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 19:34:41.260421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:41.260421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:41.260421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:41.260421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:41.260421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:41.260421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:41.260421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:41.260421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:41.260421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:41.260421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:41.260421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:41.260421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:41.260421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:41.260421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:41.260421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:41.261445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:41.261445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:41.261445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:41.261445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:41.261445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:41.261445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:41.261445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:41.261445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:41.261445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:41.261445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:41.261445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:41.261445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:41.261445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:41.261445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:41.261445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:41.261445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:41.261445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:41.261445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:41.262382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:41.262382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:41.262382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:41.262382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:41.262382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:41.262382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:41.262382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:41.262382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:41.262382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 19:34:41.262382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:41.265228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 359/728] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Sep 14 19:34:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:41.266574 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85da9b-cdb0-426a-b776-53f6963de674 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:41.272127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85da9b-cdb0-426a-b776-53f6963de674 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:41.272436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85da9b-cdb0-426a-b776-53f6963de674 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:41.278253 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 360/729] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:41.278253 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85da9b-cdb0-426a-b776-53f6963de674 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:41.279276 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:41.301285 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9816ea-15eb-4b7d-ab0f-0d17a2af9eec None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:41.344956 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89040f0d-a218-4f7f-9a1e-59de4d5e5f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:41.345992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89040f0d-a218-4f7f-9a1e-59de4d5e5f11 None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:41.346609 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89040f0d-a218-4f7f-9a1e-59de4d5e5f11 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:41.347111 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89040f0d-a218-4f7f-9a1e-59de4d5e5f11 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:41.348714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89040f0d-a218-4f7f-9a1e-59de4d5e5f11 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:41.351634 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89040f0d-a218-4f7f-9a1e-59de4d5e5f11 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:41.389241 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85da9b-cdb0-426a-b776-53f6963de674 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:41.425198 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f25e8-3c4a-428b-bbfb-bf4b7c0c5193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:41.425950 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f25e8-3c4a-428b-bbfb-bf4b7c0c5193 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:41.426229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f25e8-3c4a-428b-bbfb-bf4b7c0c5193 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:41.426503 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f25e8-3c4a-428b-bbfb-bf4b7c0c5193 None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:41.427200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 370/730] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Sep 14 19:34:41 2022] POST /identity/v3/services => generated 251 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:34:41.427940 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f25e8-3c4a-428b-bbfb-bf4b7c0c5193 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:41.433236 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8ed7e-6d2f-4815-9712-93ab7db263ab None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:41.433236 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8ed7e-6d2f-4815-9712-93ab7db263ab None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:41.433437 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f25e8-3c4a-428b-bbfb-bf4b7c0c5193 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:41.433511 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8ed7e-6d2f-4815-9712-93ab7db263ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:41.433581 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f25e8-3c4a-428b-bbfb-bf4b7c0c5193 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:41.455307 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 361/731] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Sep 14 19:34:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:41.456246 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-dec8ed7e-6d2f-4815-9712-93ab7db263ab None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:41.456701 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14540ba-7ae0-4fbc-b604-fc92d495901a None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:41.457620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14540ba-7ae0-4fbc-b604-fc92d495901a None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:41.457985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14540ba-7ae0-4fbc-b604-fc92d495901a None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:41.461811 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-dec8ed7e-6d2f-4815-9712-93ab7db263ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:41.464158 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 362/732] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:41.466239 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14540ba-7ae0-4fbc-b604-fc92d495901a None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:41.518583 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:41.555963 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:41.571777 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 371/733] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:41 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:41.573758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a5473-2239-424d-9749-0372a000ae7d None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:41.574283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a5473-2239-424d-9749-0372a000ae7d None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:41.574797 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a5473-2239-424d-9749-0372a000ae7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:41.611789 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14540ba-7ae0-4fbc-b604-fc92d495901a None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:41.614441 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-d56a5473-2239-424d-9749-0372a000ae7d None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:41.617629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-d56a5473-2239-424d-9749-0372a000ae7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:41.660416 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705b8e5-ae33-4e72-9ae9-b439a966e903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:41.661075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705b8e5-ae33-4e72-9ae9-b439a966e903 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:41.661358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705b8e5-ae33-4e72-9ae9-b439a966e903 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:41.661633 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705b8e5-ae33-4e72-9ae9-b439a966e903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:41.675083 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705b8e5-ae33-4e72-9ae9-b439a966e903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:41.677803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705b8e5-ae33-4e72-9ae9-b439a966e903 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:41.703388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-9705b8e5-ae33-4e72-9ae9-b439a966e903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:41.703388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:41.703388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:41.703388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:41.703388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:41.703388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:41.703388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:41.703388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:41.703388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:41.703388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:41.703388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:41.703388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:41.703388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:41.703388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:41.703388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:41.703388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:41.704447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:41.704447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:41.704447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:41.704447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:41.704447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:41.704447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:41.704447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:41.704447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:41.704447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:41.704447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:41.704447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:41.704447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:41.704447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:41.704447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:41.704447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:41.704447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:41.704447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:41.705346 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:41.705346 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:41.705346 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:41.708696 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 363/734] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:41.716531 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705b8e5-ae33-4e72-9ae9-b439a966e903 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:41.718303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 372/735] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:41 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 19:34:41.736287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cbe32-c6e7-4dfc-ba8e-c24904b479a0 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:41.736859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cbe32-c6e7-4dfc-ba8e-c24904b479a0 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:41.737146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cbe32-c6e7-4dfc-ba8e-c24904b479a0 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:41.739581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 373/736] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:41.744788 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d380239-9dd8-4ce8-b506-f23de188d9a0 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:41.745226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d380239-9dd8-4ce8-b506-f23de188d9a0 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:41.745606 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d380239-9dd8-4ce8-b506-f23de188d9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:41.773602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-5d380239-9dd8-4ce8-b506-f23de188d9a0 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:41.775276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-5d380239-9dd8-4ce8-b506-f23de188d9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:41.844304 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705b8e5-ae33-4e72-9ae9-b439a966e903 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:41.858245 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:41.875577 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 374/737] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:41 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 19:34:41.892914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1143e0-38f5-4f79-9c43-962713a8ee84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:41.893542 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1143e0-38f5-4f79-9c43-962713a8ee84 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:41.893823 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1143e0-38f5-4f79-9c43-962713a8ee84 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:41.894099 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1143e0-38f5-4f79-9c43-962713a8ee84 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:41.895493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1143e0-38f5-4f79-9c43-962713a8ee84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:41.895627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d380239-9dd8-4ce8-b506-f23de188d9a0 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:41.895827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1143e0-38f5-4f79-9c43-962713a8ee84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:41.897209 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1143e0-38f5-4f79-9c43-962713a8ee84 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:41.912625 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 364/738] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:41.918197 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1143e0-38f5-4f79-9c43-962713a8ee84 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:41.953303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:42.031282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d380239-9dd8-4ce8-b506-f23de188d9a0 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:42.075017 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734e82a-5eb9-4bac-a3d2-1844448fa882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:42.075697 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734e82a-5eb9-4bac-a3d2-1844448fa882 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:42.075982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734e82a-5eb9-4bac-a3d2-1844448fa882 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:42.076255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734e82a-5eb9-4bac-a3d2-1844448fa882 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:42.092140 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734e82a-5eb9-4bac-a3d2-1844448fa882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:42.099451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-8734e82a-5eb9-4bac-a3d2-1844448fa882 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:34:42.099451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:42.099451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:42.099451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:42.099451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:42.099451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:42.099451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:42.099451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:42.099451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:42.099451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:42.099451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:42.099451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:42.099451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:42.099451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:42.099451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:42.099451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:42.100406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:42.100406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:42.100406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:42.100406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:42.100406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:42.100406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:42.100406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:42.100406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:42.100406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:42.100406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:42.100406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:42.100406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:42.100406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:42.100406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:42.100406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:42.100406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:42.101264 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:42.101264 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:42.101264 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:42.101264 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:42.101264 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:42.101264 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:42.101264 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:42.101264 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:42.101264 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:42.101264 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:42.101264 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:34:42.101264 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:42.101264 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 375/739] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:34:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:42.101953 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734e82a-5eb9-4bac-a3d2-1844448fa882 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:42.125621 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1143e0-38f5-4f79-9c43-962713a8ee84 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:42.163537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25460f89-c931-4c96-af23-8bde34540880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:42.164208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25460f89-c931-4c96-af23-8bde34540880 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:42.164491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25460f89-c931-4c96-af23-8bde34540880 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:42.164762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25460f89-c931-4c96-af23-8bde34540880 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:42.172203 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25460f89-c931-4c96-af23-8bde34540880 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:42.173660 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25460f89-c931-4c96-af23-8bde34540880 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:42.186170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-25460f89-c931-4c96-af23-8bde34540880 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:42.186170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:42.186170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:42.186170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:42.186170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:42.186170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:42.186170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:42.186170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:42.186170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:42.186170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:42.186170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:42.186170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:42.186170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:42.186170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:42.186170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:42.187101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:42.187101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:42.187101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:42.187101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:42.187101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:42.187101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:42.187101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:42.187101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:42.187101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:42.187101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:42.187101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:42.187101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:42.187101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:42.187101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:42.187101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:42.187101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:42.187101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:42.188070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:42.188070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:42.188070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:42.188070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:42.188070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:42.188070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:42.188070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:42.188070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:42.188070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 365/740] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:42.188070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25460f89-c931-4c96-af23-8bde34540880 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:42.219577 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:42.226830 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:42.227203 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734e82a-5eb9-4bac-a3d2-1844448fa882 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:42.263609 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcab88a-1dc3-450a-b365-0464a773beb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:42.264255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcab88a-1dc3-450a-b365-0464a773beb9 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:42.264536 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcab88a-1dc3-450a-b365-0464a773beb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:42.264813 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcab88a-1dc3-450a-b365-0464a773beb9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:42.277200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcab88a-1dc3-450a-b365-0464a773beb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:42.282342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-8dcab88a-1dc3-450a-b365-0464a773beb9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:42.282342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:42.282342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:42.282342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:42.282342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:42.282342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:42.282342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:42.282342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:42.282342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:42.282342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:42.282342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:42.282342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:42.282342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:42.282342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:42.282342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:42.282342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:42.283259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:42.283259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:42.283259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:42.283259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:42.283259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:42.283259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:42.283259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:42.283259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:42.283259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:42.283259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:42.283259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:42.283259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:42.283259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:42.283259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:42.283259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:42.283259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:42.284157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:42.284157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:42.284157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:42.284157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:42.284157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:42.284157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:42.284157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:42.284157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:42.284157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:42.284157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:42.284157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:42.284157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:42.284157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 376/741] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:34:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:42.284850 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcab88a-1dc3-450a-b365-0464a773beb9 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:42.307395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25460f89-c931-4c96-af23-8bde34540880 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:42.342720 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b90137-7b3a-463b-abb9-0fb439b5fba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:42.343340 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b90137-7b3a-463b-abb9-0fb439b5fba3 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:42.343638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b90137-7b3a-463b-abb9-0fb439b5fba3 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:42.343908 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b90137-7b3a-463b-abb9-0fb439b5fba3 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:42.344570 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b90137-7b3a-463b-abb9-0fb439b5fba3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:42.344866 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b90137-7b3a-463b-abb9-0fb439b5fba3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:42.346224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b90137-7b3a-463b-abb9-0fb439b5fba3 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:42.355298 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 366/742] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:34:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:42.355997 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b90137-7b3a-463b-abb9-0fb439b5fba3 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:42.400985 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcab88a-1dc3-450a-b365-0464a773beb9 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:42.439354 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29998e-3b7a-453e-8724-f3c59e7a5d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:42.440006 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29998e-3b7a-453e-8724-f3c59e7a5d55 None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:42.440282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29998e-3b7a-453e-8724-f3c59e7a5d55 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:42.440556 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29998e-3b7a-453e-8724-f3c59e7a5d55 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:42.441204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29998e-3b7a-453e-8724-f3c59e7a5d55 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:42.443158 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29998e-3b7a-453e-8724-f3c59e7a5d55 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:42.462336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:42.468812 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b90137-7b3a-463b-abb9-0fb439b5fba3 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:42.502576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63513446-8be3-405d-9c82-8c1de321bfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:42.503223 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63513446-8be3-405d-9c82-8c1de321bfc6 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:42.503499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63513446-8be3-405d-9c82-8c1de321bfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:42.503871 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63513446-8be3-405d-9c82-8c1de321bfc6 None admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:42.505157 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63513446-8be3-405d-9c82-8c1de321bfc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:42.505465 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63513446-8be3-405d-9c82-8c1de321bfc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:42.506880 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63513446-8be3-405d-9c82-8c1de321bfc6 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:42.518084 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 367/743] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:42.518873 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63513446-8be3-405d-9c82-8c1de321bfc6 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:42.532210 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 377/744] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Sep 14 19:34:42 2022] POST /identity/v3/services => generated 240 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:34:42.533333 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29998e-3b7a-453e-8724-f3c59e7a5d55 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:42.557487 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:42.647404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63513446-8be3-405d-9c82-8c1de321bfc6 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:42.671406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29998e-3b7a-453e-8724-f3c59e7a5d55 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:42.686207 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd03bbb-2d46-4034-9c32-ffd89785568b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:42.687048 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd03bbb-2d46-4034-9c32-ffd89785568b None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:42.687431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd03bbb-2d46-4034-9c32-ffd89785568b None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:42.687845 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd03bbb-2d46-4034-9c32-ffd89785568b None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:42.688705 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd03bbb-2d46-4034-9c32-ffd89785568b None admin] RBAC: Adding query filter params (name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:42.689117 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd03bbb-2d46-4034-9c32-ffd89785568b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:42.690629 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd03bbb-2d46-4034-9c32-ffd89785568b None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:42.700658 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 368/745] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Sep 14 19:34:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:42.701759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd03bbb-2d46-4034-9c32-ffd89785568b None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:42.716167 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520286cc-a57d-4cb6-bd91-ad48745fb1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:42.717071 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520286cc-a57d-4cb6-bd91-ad48745fb1f5 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:42.717350 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520286cc-a57d-4cb6-bd91-ad48745fb1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:42.717623 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520286cc-a57d-4cb6-bd91-ad48745fb1f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:42.723918 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:42.731171 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520286cc-a57d-4cb6-bd91-ad48745fb1f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:42.732892 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520286cc-a57d-4cb6-bd91-ad48745fb1f5 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:42.749731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-520286cc-a57d-4cb6-bd91-ad48745fb1f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:42.749731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:42.749731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:42.749731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:42.749731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:42.749731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:42.749731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:42.749731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:42.749731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:42.749731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:42.749731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:42.749731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:42.749731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:42.749731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:42.749731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:42.749731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:42.750720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:42.750720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:42.750720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:42.750720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:42.750720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:42.750720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:42.750720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:42.750720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:42.750720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:42.750720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:42.750720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:42.750720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:42.750720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:42.750720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:42.750720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:42.750720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:42.750720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:42.751645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:42.751645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:42.751645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:42.751645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 378/746] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:42.752699 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520286cc-a57d-4cb6-bd91-ad48745fb1f5 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:42.832178 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd03bbb-2d46-4034-9c32-ffd89785568b None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:42.857490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:42.871136 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8a6af-3f23-494e-b6d9-466fa95e752f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:42.872700 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8a6af-3f23-494e-b6d9-466fa95e752f None admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:42.873213 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8a6af-3f23-494e-b6d9-466fa95e752f None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:42.875799 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8a6af-3f23-494e-b6d9-466fa95e752f None admin] PATH_INFO: `/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/421f6cc846b342918a177d2794eb3db8/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:42.876485 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8a6af-3f23-494e-b6d9-466fa95e752f None admin] RBAC: Authorizing `identity:create_grant(project_id=2e3e0c278ce94ce3a132496923eef365, user_id=421f6cc846b342918a177d2794eb3db8, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:42.878371 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8a6af-3f23-494e-b6d9-466fa95e752f None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:42.886688 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520286cc-a57d-4cb6-bd91-ad48745fb1f5 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:42.925940 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b983d-bb02-447c-971e-47e561001564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:42.926683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b983d-bb02-447c-971e-47e561001564 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:42.926972 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b983d-bb02-447c-971e-47e561001564 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:42.927314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b983d-bb02-447c-971e-47e561001564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:42.938451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b983d-bb02-447c-971e-47e561001564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:42.940007 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b983d-bb02-447c-971e-47e561001564 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:42.959309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-136b983d-bb02-447c-971e-47e561001564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:42.959309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:42.959309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:42.959309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:42.959309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:42.959309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:42.959309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:42.959309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:42.959309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:42.959309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:42.959309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:42.959309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:42.959309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:42.959309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:42.959309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:42.959309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:42.960329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:42.960329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:42.960329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:42.960329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:42.960329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:42.960329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:42.960329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:42.960329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:42.960329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:42.960329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:42.960329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:42.960329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:42.960329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:42.960329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:42.960329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:42.960329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:42.960329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:42.961270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:42.961270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:42.961270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:42.963696 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 379/747] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:42.964715 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b983d-bb02-447c-971e-47e561001564 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:42.968563 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 369/748] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:34:42 2022] PUT /identity/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/421f6cc846b342918a177d2794eb3db8/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:34:42.969413 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8a6af-3f23-494e-b6d9-466fa95e752f None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:43.097841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b983d-bb02-447c-971e-47e561001564 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:43.115519 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:43.140826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfca2e-d323-4c97-82c4-d9b1712d6e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:43.141876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfca2e-d323-4c97-82c4-d9b1712d6e1a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:43.142463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfca2e-d323-4c97-82c4-d9b1712d6e1a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:43.143002 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfca2e-d323-4c97-82c4-d9b1712d6e1a None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:43.144116 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfca2e-d323-4c97-82c4-d9b1712d6e1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:43.145164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfca2e-d323-4c97-82c4-d9b1712d6e1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:43.146782 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfca2e-d323-4c97-82c4-d9b1712d6e1a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:43.163643 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 380/749] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:43.173041 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfca2e-d323-4c97-82c4-d9b1712d6e1a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:43.177902 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:43.218512 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8a6af-3f23-494e-b6d9-466fa95e752f None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:43.262408 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e65cbe-df84-4f55-be53-50e13119e878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:43.263192 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e65cbe-df84-4f55-be53-50e13119e878 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:43.263588 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e65cbe-df84-4f55-be53-50e13119e878 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:43.264156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e65cbe-df84-4f55-be53-50e13119e878 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:43.266044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e65cbe-df84-4f55-be53-50e13119e878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:43.266455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e65cbe-df84-4f55-be53-50e13119e878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:43.268119 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e65cbe-df84-4f55-be53-50e13119e878 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:43.281831 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 370/750] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:43.287922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e65cbe-df84-4f55-be53-50e13119e878 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:43.306252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfca2e-d323-4c97-82c4-d9b1712d6e1a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:43.347209 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bad49b-be32-4ad9-b35c-e187d1d3c3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:43.348443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bad49b-be32-4ad9-b35c-e187d1d3c3fe None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:43.348891 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bad49b-be32-4ad9-b35c-e187d1d3c3fe None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:43.349308 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bad49b-be32-4ad9-b35c-e187d1d3c3fe None admin] PATH_INFO: `/v3/users/swift` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:43.362324 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bad49b-be32-4ad9-b35c-e187d1d3c3fe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:43.365185 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bad49b-be32-4ad9-b35c-e187d1d3c3fe None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:43.379131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-84bad49b-be32-4ad9-b35c-e187d1d3c3fe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 19:34:43.379131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:43.379131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:43.379131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:43.379131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:43.379131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:43.379131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:43.379131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:43.379131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:43.379131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:43.379131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:43.379131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:43.379131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:43.379131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:43.379131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:43.379131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:43.380159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:43.380159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:43.380159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:43.380159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:43.380159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:43.380159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:43.380159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:43.380159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:43.380159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:43.380159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:43.380159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:43.380159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:43.380159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:43.380159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:43.380159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:43.380159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:43.380159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:43.380159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:43.381081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:43.381081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:43.381081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:43.381081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:43.381081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:43.381081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:43.381081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:43.381081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:43.381081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 19:34:43.381081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:43.383810 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 381/751] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:34:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:43.392694 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bad49b-be32-4ad9-b35c-e187d1d3c3fe None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:43.425857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e65cbe-df84-4f55-be53-50e13119e878 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:43.462860 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570b169-32fd-4154-89e2-47b62d04bb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:43.463486 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570b169-32fd-4154-89e2-47b62d04bb25 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:43.463830 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570b169-32fd-4154-89e2-47b62d04bb25 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:43.464178 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570b169-32fd-4154-89e2-47b62d04bb25 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:43.470095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:43.475102 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570b169-32fd-4154-89e2-47b62d04bb25 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:43.476974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570b169-32fd-4154-89e2-47b62d04bb25 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:43.478043 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:43.496824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-f570b169-32fd-4154-89e2-47b62d04bb25 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 19:34:43.496824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:43.496824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:43.496824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:43.496824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:43.496824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:43.496824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:43.496824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:43.496824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:43.496824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:43.496824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:43.496824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:43.496824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:43.496824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:43.496824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:43.496824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:43.498211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:43.498211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:43.498211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:43.498211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:43.498211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:43.498211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:43.498211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:43.498211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:43.498211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:43.498211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:43.498211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:43.498211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:43.498211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:43.498211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:43.498211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:43.498211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:43.498211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:43.498211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:43.499383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:43.499383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:43.499383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:43.499383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:43.499383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:43.499383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:43.499383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:43.499383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:43.499383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 19:34:43.499383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:43.502801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 371/752] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Sep 14 19:34:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:43.509386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570b169-32fd-4154-89e2-47b62d04bb25 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:43.575478 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bad49b-be32-4ad9-b35c-e187d1d3c3fe None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:43.615788 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c7863-2dd5-4038-84fc-c0552e795076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:43.617161 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c7863-2dd5-4038-84fc-c0552e795076 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:43.617644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c7863-2dd5-4038-84fc-c0552e795076 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:43.618097 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c7863-2dd5-4038-84fc-c0552e795076 None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:43.618976 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c7863-2dd5-4038-84fc-c0552e795076 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:43.619436 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c7863-2dd5-4038-84fc-c0552e795076 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:43.621358 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c7863-2dd5-4038-84fc-c0552e795076 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:43.662883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 382/753] 10.222.0.15 () {56 vars in 1135 bytes} [Wed Sep 14 19:34:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:43.668724 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c7863-2dd5-4038-84fc-c0552e795076 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:43.704997 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570b169-32fd-4154-89e2-47b62d04bb25 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:43.749993 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dda36-8eb8-4014-a52f-c0bcd3574f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:43.750918 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dda36-8eb8-4014-a52f-c0bcd3574f91 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:43.751348 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dda36-8eb8-4014-a52f-c0bcd3574f91 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:43.751823 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dda36-8eb8-4014-a52f-c0bcd3574f91 None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:43.752700 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dda36-8eb8-4014-a52f-c0bcd3574f91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:43.753154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dda36-8eb8-4014-a52f-c0bcd3574f91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:43.755704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dda36-8eb8-4014-a52f-c0bcd3574f91 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:43.775359 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 372/754] 10.222.0.15 () {56 vars in 1149 bytes} [Wed Sep 14 19:34:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:43.785760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dda36-8eb8-4014-a52f-c0bcd3574f91 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:43.853580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:43.864910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c7863-2dd5-4038-84fc-c0552e795076 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:43.929421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:43.952774 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55745c0-f698-419e-b0ce-cbdb1ae6cadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:43.954581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55745c0-f698-419e-b0ce-cbdb1ae6cadd None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:43.954867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55745c0-f698-419e-b0ce-cbdb1ae6cadd None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:43.955141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55745c0-f698-419e-b0ce-cbdb1ae6cadd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:44.005797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dda36-8eb8-4014-a52f-c0bcd3574f91 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:44.048630 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33488692-b7cc-42c4-8e2f-a9d090768016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:44.049280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33488692-b7cc-42c4-8e2f-a9d090768016 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:44.050145 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33488692-b7cc-42c4-8e2f-a9d090768016 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:44.050431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33488692-b7cc-42c4-8e2f-a9d090768016 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:44.052796 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55745c0-f698-419e-b0ce-cbdb1ae6cadd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:44.054332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55745c0-f698-419e-b0ce-cbdb1ae6cadd None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:44.147468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33488692-b7cc-42c4-8e2f-a9d090768016 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:44.149523 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33488692-b7cc-42c4-8e2f-a9d090768016 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:44.150484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:44.162335 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 383/755] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:34:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 19:34:44.163833 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03883ab5-0761-4773-b1f1-b44f0e7ae069 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:44.164189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03883ab5-0761-4773-b1f1-b44f0e7ae069 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:44.164519 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03883ab5-0761-4773-b1f1-b44f0e7ae069 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:44.166080 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 384/756] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:44.167278 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03883ab5-0761-4773-b1f1-b44f0e7ae069 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:44.231895 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:44.280809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03883ab5-0761-4773-b1f1-b44f0e7ae069 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:44.288154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 373/757] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:34:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 19:34:44.289661 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658c99c-55bd-46e3-b809-d29ff928e518 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:44.290088 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658c99c-55bd-46e3-b809-d29ff928e518 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:44.290493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658c99c-55bd-46e3-b809-d29ff928e518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:44.309100 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-3658c99c-55bd-46e3-b809-d29ff928e518 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:44.310514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3658c99c-55bd-46e3-b809-d29ff928e518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:44.323186 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44046b-8fb6-413b-a5a6-c0a52eb55b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:44.323656 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44046b-8fb6-413b-a5a6-c0a52eb55b35 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:44.323933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44046b-8fb6-413b-a5a6-c0a52eb55b35 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:44.324205 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44046b-8fb6-413b-a5a6-c0a52eb55b35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:44.334759 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44046b-8fb6-413b-a5a6-c0a52eb55b35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:44.336579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44046b-8fb6-413b-a5a6-c0a52eb55b35 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:44.352616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-0a44046b-8fb6-413b-a5a6-c0a52eb55b35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:44.352616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:44.352616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:44.352616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:44.352616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:44.352616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:44.352616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:44.352616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:44.352616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:44.352616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:44.352616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:44.352616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:44.352616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:44.352616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:44.352616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:44.352616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:44.353587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:44.353587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:44.353587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:44.353587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:44.353587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:44.353587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:44.353587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:44.353587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:44.353587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:44.353587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:44.353587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:44.353587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:44.353587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:44.353587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:44.353587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:44.353587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:44.353587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:44.354487 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:44.354487 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:44.354487 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:44.354487 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 385/758] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:44.355154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44046b-8fb6-413b-a5a6-c0a52eb55b35 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:44.395634 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 374/759] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:34:44.396899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658c99c-55bd-46e3-b809-d29ff928e518 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:44.411567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:44.463415 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44046b-8fb6-413b-a5a6-c0a52eb55b35 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:44.499653 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240946c-3489-4a0c-a603-5c48d80be710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:44.500293 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240946c-3489-4a0c-a603-5c48d80be710 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:44.500625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240946c-3489-4a0c-a603-5c48d80be710 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:44.500902 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240946c-3489-4a0c-a603-5c48d80be710 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:44.513026 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240946c-3489-4a0c-a603-5c48d80be710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:44.514524 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240946c-3489-4a0c-a603-5c48d80be710 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:44.546154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-7240946c-3489-4a0c-a603-5c48d80be710 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:44.546154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:44.546154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:44.546154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:44.546154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:44.546154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:44.546154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:44.546154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:44.546154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:44.546154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:44.546154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:44.546154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:44.546154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:44.546154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:44.546154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:44.546154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:44.547144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:44.547144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:44.547144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:44.547144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:44.547144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:44.547144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:44.547144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:44.547144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:44.547144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:44.547144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:44.547144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:44.547144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:44.547144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:44.547144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:44.547144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:44.547144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:44.547144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:44.548103 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:44.548103 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:44.548103 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:44.548103 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 386/760] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:44.553807 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240946c-3489-4a0c-a603-5c48d80be710 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:44.556393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:44.574146 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658c99c-55bd-46e3-b809-d29ff928e518 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:44.610473 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42315d-93f1-441f-a174-077d7410ab30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:44.611461 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42315d-93f1-441f-a174-077d7410ab30 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:44.612014 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42315d-93f1-441f-a174-077d7410ab30 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:44.612501 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42315d-93f1-441f-a174-077d7410ab30 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:44.613897 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42315d-93f1-441f-a174-077d7410ab30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:44.614485 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42315d-93f1-441f-a174-077d7410ab30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:44.616108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42315d-93f1-441f-a174-077d7410ab30 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:44.628796 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 375/761] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:44.633915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42315d-93f1-441f-a174-077d7410ab30 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:44.736888 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:44.746921 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240946c-3489-4a0c-a603-5c48d80be710 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:44.805691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ff0f3-a6f3-4eac-9cc2-91fcf18d8dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:44.806814 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ff0f3-a6f3-4eac-9cc2-91fcf18d8dbd None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:44.807653 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ff0f3-a6f3-4eac-9cc2-91fcf18d8dbd None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:44.808424 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ff0f3-a6f3-4eac-9cc2-91fcf18d8dbd None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:44.809283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ff0f3-a6f3-4eac-9cc2-91fcf18d8dbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:44.809786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ff0f3-a6f3-4eac-9cc2-91fcf18d8dbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:44.811427 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ff0f3-a6f3-4eac-9cc2-91fcf18d8dbd None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:44.812996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42315d-93f1-441f-a174-077d7410ab30 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:44.830997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 387/762] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:44.832994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ff0f3-a6f3-4eac-9cc2-91fcf18d8dbd None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:44.850771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adc428-1198-4005-bc44-9054e5275b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:44.851164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adc428-1198-4005-bc44-9054e5275b99 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:44.851451 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adc428-1198-4005-bc44-9054e5275b99 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:44.851751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adc428-1198-4005-bc44-9054e5275b99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:44.858700 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adc428-1198-4005-bc44-9054e5275b99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:44.860268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adc428-1198-4005-bc44-9054e5275b99 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:44.872882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-51adc428-1198-4005-bc44-9054e5275b99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:44.872882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:44.872882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:44.872882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:44.872882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:44.872882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:44.872882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:44.872882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:44.872882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:44.872882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:44.872882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:44.872882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:44.872882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:44.872882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:44.872882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:44.873806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:44.873806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:44.873806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:44.873806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:44.873806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:44.873806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:44.873806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:44.873806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:44.873806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:44.873806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:44.873806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:44.873806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:44.873806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:44.873806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:44.873806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:44.873806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:44.873806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:44.875086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:44.875086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:44.875086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:44.875086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:44.875086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:44.875086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:44.875086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:44.875086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:44.875086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 376/763] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:44.875086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adc428-1198-4005-bc44-9054e5275b99 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:44.878814 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:44.953712 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ff0f3-a6f3-4eac-9cc2-91fcf18d8dbd None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:44.983190 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adc428-1198-4005-bc44-9054e5275b99 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:44.993378 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12b4ca-2011-4886-9755-c054893877a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:44.994312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12b4ca-2011-4886-9755-c054893877a0 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:44.994800 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12b4ca-2011-4886-9755-c054893877a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:44.995266 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12b4ca-2011-4886-9755-c054893877a0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:44.996074 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12b4ca-2011-4886-9755-c054893877a0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:44.997640 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12b4ca-2011-4886-9755-c054893877a0 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:45.008163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-6b12b4ca-2011-4886-9755-c054893877a0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 19:34:45.008163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:45.008163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:34:45.008163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:34:45.008163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:34:45.008163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:34:45.008163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:34:45.008163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:34:45.008163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 19:34:45.008163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:45.008163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:34:45.008163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:45.008163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:45.008163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:45.008163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:45.008163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:45.008163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:45.009125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:45.009125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:45.009125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:45.009125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:45.009125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:45.009125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:45.009125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:34:45.009125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:34:45.009125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:34:45.009125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:34:45.009125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:45.009125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:45.009125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:45.009125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:45.009125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:45.009125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:45.009957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:45.009957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:45.009957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:45.009957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:45.009957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:45.009957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:45.009957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:45.009957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:45.009957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:45.009957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:45.009957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:34:45.009957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:34:45.009957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 19:34:45.009957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:45.013155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 388/764] 10.222.0.15 () {56 vars in 1129 bytes} [Wed Sep 14 19:34:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:45.014129 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12b4ca-2011-4886-9755-c054893877a0 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:45.027937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a801107-00c4-43ff-8ea5-9bf6abd85bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:45.029543 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a801107-00c4-43ff-8ea5-9bf6abd85bfe None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:45.029970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a801107-00c4-43ff-8ea5-9bf6abd85bfe None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:45.030409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a801107-00c4-43ff-8ea5-9bf6abd85bfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:45.040668 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a801107-00c4-43ff-8ea5-9bf6abd85bfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:45.042964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a801107-00c4-43ff-8ea5-9bf6abd85bfe None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:45.046753 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:45.068270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-7a801107-00c4-43ff-8ea5-9bf6abd85bfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:45.068270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:45.068270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:45.068270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:45.068270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:45.068270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:45.068270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:45.068270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:45.068270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:45.068270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:45.068270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:45.068270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:45.068270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:45.068270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:45.068270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:45.069270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:45.069270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:45.069270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:45.069270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:45.069270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:45.069270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:45.069270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:45.069270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:45.069270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:45.069270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:45.069270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:45.069270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:45.069270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:45.069270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:45.069270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:45.069270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:45.069270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:45.070141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:45.070141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:45.070141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:45.070141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:45.070141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:45.070141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:45.070141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:45.070141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:45.070141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 377/765] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:45.070141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a801107-00c4-43ff-8ea5-9bf6abd85bfe None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:45.149149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12b4ca-2011-4886-9755-c054893877a0 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:45.156047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:45.195254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff694036-56f6-48a0-9b6a-71269b1b18bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:45.196458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff694036-56f6-48a0-9b6a-71269b1b18bb None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:45.196882 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff694036-56f6-48a0-9b6a-71269b1b18bb None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:45.197297 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff694036-56f6-48a0-9b6a-71269b1b18bb None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:45.198153 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff694036-56f6-48a0-9b6a-71269b1b18bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:45.198594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff694036-56f6-48a0-9b6a-71269b1b18bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:45.200230 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff694036-56f6-48a0-9b6a-71269b1b18bb None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:45.201322 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a801107-00c4-43ff-8ea5-9bf6abd85bfe None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:45.215603 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 389/766] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:45.216789 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff694036-56f6-48a0-9b6a-71269b1b18bb None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:45.238133 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a34628-7ac0-48e5-86d2-89a70c95586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:45.239065 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a34628-7ac0-48e5-86d2-89a70c95586d None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:45.239476 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a34628-7ac0-48e5-86d2-89a70c95586d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:45.239902 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a34628-7ac0-48e5-86d2-89a70c95586d None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:45.240637 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a34628-7ac0-48e5-86d2-89a70c95586d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:45.241043 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a34628-7ac0-48e5-86d2-89a70c95586d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:45.242627 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a34628-7ac0-48e5-86d2-89a70c95586d None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:45.251666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 378/767] 10.222.0.15 () {56 vars in 1124 bytes} [Wed Sep 14 19:34:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:45.252784 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a34628-7ac0-48e5-86d2-89a70c95586d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:45.308567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:45.338988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff694036-56f6-48a0-9b6a-71269b1b18bb None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:45.361592 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a34628-7ac0-48e5-86d2-89a70c95586d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:45.385526 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02daf9-5a02-463f-a343-96e9f89c08eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:45.386144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02daf9-5a02-463f-a343-96e9f89c08eb None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:45.386453 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02daf9-5a02-463f-a343-96e9f89c08eb None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:45.386728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02daf9-5a02-463f-a343-96e9f89c08eb None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:45.387423 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02daf9-5a02-463f-a343-96e9f89c08eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:45.387759 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02daf9-5a02-463f-a343-96e9f89c08eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:45.389191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02daf9-5a02-463f-a343-96e9f89c08eb None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:45.394227 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:45.400964 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 390/768] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:45.403855 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674dd48-3b2b-40c4-88db-1e0c7c18ce75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:45.404469 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674dd48-3b2b-40c4-88db-1e0c7c18ce75 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:45.404745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674dd48-3b2b-40c4-88db-1e0c7c18ce75 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:45.410742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674dd48-3b2b-40c4-88db-1e0c7c18ce75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:45.410742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674dd48-3b2b-40c4-88db-1e0c7c18ce75 None admin] RBAC: Adding query filter params (role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=ee56bf9af257486e94e6ff1b33086f23) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:45.410742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674dd48-3b2b-40c4-88db-1e0c7c18ce75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:45.411093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ab591-62b5-43b3-857a-72bca5a14ed0 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:45.411224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674dd48-3b2b-40c4-88db-1e0c7c18ce75 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:45.411345 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ab591-62b5-43b3-857a-72bca5a14ed0 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:45.411345 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ab591-62b5-43b3-857a-72bca5a14ed0 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:45.411345 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 391/769] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:45.411345 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ab591-62b5-43b3-857a-72bca5a14ed0 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:45.418080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 379/770] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:34:45 2022] GET /identity/v3/role_assignments?user.id=ee56bf9af257486e94e6ff1b33086f23&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:45.419122 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674dd48-3b2b-40c4-88db-1e0c7c18ce75 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:45.549973 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ab591-62b5-43b3-857a-72bca5a14ed0 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:45.550857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674dd48-3b2b-40c4-88db-1e0c7c18ce75 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:45.591524 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b21abc-9bce-4158-b707-6ed6214ec42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:45.592650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b21abc-9bce-4158-b707-6ed6214ec42e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:45.593487 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b21abc-9bce-4158-b707-6ed6214ec42e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:45.594222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b21abc-9bce-4158-b707-6ed6214ec42e None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:45.595129 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b21abc-9bce-4158-b707-6ed6214ec42e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:45.595642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b21abc-9bce-4158-b707-6ed6214ec42e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:45.597215 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b21abc-9bce-4158-b707-6ed6214ec42e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:45.598236 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0a1c0-9cee-4a38-b334-74ba3c69d9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:45.598926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0a1c0-9cee-4a38-b334-74ba3c69d9d7 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:45.599248 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0a1c0-9cee-4a38-b334-74ba3c69d9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:45.599523 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0a1c0-9cee-4a38-b334-74ba3c69d9d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:45.600670 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0a1c0-9cee-4a38-b334-74ba3c69d9d7 None admin] RBAC: Adding query filter params (role.id=b2e8ea485659485f92e729741880d447, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=15fbda6263b44352b3ac560372bef725) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:45.600980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0a1c0-9cee-4a38-b334-74ba3c69d9d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:45.603429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0a1c0-9cee-4a38-b334-74ba3c69d9d7 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:45.610024 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 392/771] 10.222.0.15 () {56 vars in 1124 bytes} [Wed Sep 14 19:34:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:45.611669 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964d399-0c1e-4358-97c1-2d0c14f0aa5b None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:45.612150 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964d399-0c1e-4358-97c1-2d0c14f0aa5b None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:45.612430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964d399-0c1e-4358-97c1-2d0c14f0aa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:45.615580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 380/772] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:34:45 2022] GET /identity/v3/role_assignments?user.id=15fbda6263b44352b3ac560372bef725&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=b2e8ea485659485f92e729741880d447 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:45.616913 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0a1c0-9cee-4a38-b334-74ba3c69d9d7 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:45.623956 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:45.642176 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-a964d399-0c1e-4358-97c1-2d0c14f0aa5b None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:45.644040 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a964d399-0c1e-4358-97c1-2d0c14f0aa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:45.700342 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:45.750213 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 393/773] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:34:45.764694 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeba2ba-0f2b-4d2d-9bd4-fbd58d39d429 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:45.765096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeba2ba-0f2b-4d2d-9bd4-fbd58d39d429 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:45.765438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeba2ba-0f2b-4d2d-9bd4-fbd58d39d429 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:45.767266 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 394/774] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:34:45.777519 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0a1c0-9cee-4a38-b334-74ba3c69d9d7 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:45.781198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccb554-052d-452f-addd-6b2b74d8ed90 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:45.781483 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccb554-052d-452f-addd-6b2b74d8ed90 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:45.781759 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccb554-052d-452f-addd-6b2b74d8ed90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:45.817434 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-b7ccb554-052d-452f-addd-6b2b74d8ed90 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:45.818792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-b7ccb554-052d-452f-addd-6b2b74d8ed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:45.842439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbec98-73d6-41a7-8278-5e6f0e766b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:45.843048 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbec98-73d6-41a7-8278-5e6f0e766b89 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:45.843324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbec98-73d6-41a7-8278-5e6f0e766b89 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:45.843662 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbec98-73d6-41a7-8278-5e6f0e766b89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:45.844380 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbec98-73d6-41a7-8278-5e6f0e766b89 None admin] RBAC: Adding query filter params (interface=public, service_id=719d71a0b1b04a948db4624f851286e1, region_id=RegionOne) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:45.844688 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbec98-73d6-41a7-8278-5e6f0e766b89 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:45.846264 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbec98-73d6-41a7-8278-5e6f0e766b89 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:45.857266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 381/775] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Sep 14 19:34:45 2022] GET /identity/v3/endpoints?service_id=719d71a0b1b04a948db4624f851286e1&interface=public®ion_id=RegionOne => generated 194 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:45.862748 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbec98-73d6-41a7-8278-5e6f0e766b89 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:45.912278 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 395/776] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 19:34:45.974627 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbec98-73d6-41a7-8278-5e6f0e766b89 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:45.994975 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:46.021841 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18732e-608d-4c8e-8856-bbfe416ccc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:46.022476 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18732e-608d-4c8e-8856-bbfe416ccc50 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:46.022754 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18732e-608d-4c8e-8856-bbfe416ccc50 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:46.023027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18732e-608d-4c8e-8856-bbfe416ccc50 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:46.023672 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18732e-608d-4c8e-8856-bbfe416ccc50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:46.025310 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18732e-608d-4c8e-8856-bbfe416ccc50 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:46.031957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 382/777] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Sep 14 19:34:45 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:46.051682 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccb554-052d-452f-addd-6b2b74d8ed90 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:46.134549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:46.199770 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccb554-052d-452f-addd-6b2b74d8ed90 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:46.242372 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af116479-1b70-4efe-b074-d572698005a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:46.243061 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af116479-1b70-4efe-b074-d572698005a5 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:46.243345 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af116479-1b70-4efe-b074-d572698005a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:46.243639 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af116479-1b70-4efe-b074-d572698005a5 None admin] PATH_INFO: `/v3/services/network` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:46.244227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af116479-1b70-4efe-b074-d572698005a5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:46.245590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af116479-1b70-4efe-b074-d572698005a5 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:46.254690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-af116479-1b70-4efe-b074-d572698005a5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 19:34:46.254690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:46.254690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:34:46.254690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:34:46.254690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:34:46.254690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:34:46.254690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:34:46.254690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:34:46.254690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 19:34:46.254690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:46.254690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:34:46.254690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:46.254690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:46.254690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:46.254690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:46.254690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:46.254690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:46.255728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:46.255728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:46.255728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:46.255728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:46.255728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:46.255728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:46.255728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:34:46.255728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:34:46.255728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:34:46.255728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:34:46.255728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:46.255728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:46.255728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:46.255728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:46.255728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:46.255728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:46.256574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:46.256574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:46.256574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:46.256574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:46.256574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:46.256574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:46.256574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:46.256574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:46.256574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:46.256574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:46.256574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:34:46.256574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:34:46.256574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 19:34:46.256574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:46.257306 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 396/778] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:46 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:46.263815 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18732e-608d-4c8e-8856-bbfe416ccc50 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:46.321154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af116479-1b70-4efe-b074-d572698005a5 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:46.398151 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18732e-608d-4c8e-8856-bbfe416ccc50 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:46.440601 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af116479-1b70-4efe-b074-d572698005a5 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:46.452290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3c858-992b-4722-abb5-308d89a3e899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:46.452886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3c858-992b-4722-abb5-308d89a3e899 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:46.453166 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3c858-992b-4722-abb5-308d89a3e899 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:46.453440 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3c858-992b-4722-abb5-308d89a3e899 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:46.454075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3c858-992b-4722-abb5-308d89a3e899 None admin] RBAC: Adding query filter params (name=network) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:46.454381 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3c858-992b-4722-abb5-308d89a3e899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:46.455803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3c858-992b-4722-abb5-308d89a3e899 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:46.465529 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 383/779] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Sep 14 19:34:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:46.471410 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3c858-992b-4722-abb5-308d89a3e899 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:46.490159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:46.505329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051d82d-2add-47a7-81ad-f8418eb57647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:46.505972 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051d82d-2add-47a7-81ad-f8418eb57647 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:46.507115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051d82d-2add-47a7-81ad-f8418eb57647 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:46.507115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051d82d-2add-47a7-81ad-f8418eb57647 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:46.527421 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051d82d-2add-47a7-81ad-f8418eb57647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:46.533713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-1051d82d-2add-47a7-81ad-f8418eb57647 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:34:46.533713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:46.533713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:46.533713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:46.533713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:46.533713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:46.533713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:46.533713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:46.533713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:46.533713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:46.533713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:46.533713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:46.533713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:46.533713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:46.533713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:46.533713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:46.534627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:46.534627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:46.534627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:46.534627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:46.534627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:46.534627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:46.534627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:46.534627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:46.534627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:46.534627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:46.534627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:46.534627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:46.534627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:46.534627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:46.534627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:46.534627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:46.536654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:46.536654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:46.536654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:46.536654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:46.536654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:46.536654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:46.536654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:46.536654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:46.536654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:46.536654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:46.536654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:34:46.536654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:46.536654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 397/780] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:34:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:46.546752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051d82d-2add-47a7-81ad-f8418eb57647 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:46.573790 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:46.691037 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3c858-992b-4722-abb5-308d89a3e899 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:46.699498 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051d82d-2add-47a7-81ad-f8418eb57647 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:46.741217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ac129-a9ac-4c9f-9f19-0e81da896cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:46.741217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ac129-a9ac-4c9f-9f19-0e81da896cfd None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:46.741217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ac129-a9ac-4c9f-9f19-0e81da896cfd None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:46.741580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ac129-a9ac-4c9f-9f19-0e81da896cfd None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:46.742282 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ac129-a9ac-4c9f-9f19-0e81da896cfd None admin] RBAC: Adding query filter params (type=network) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:46.742813 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ac129-a9ac-4c9f-9f19-0e81da896cfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:46.745063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ac129-a9ac-4c9f-9f19-0e81da896cfd None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:46.754045 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 384/781] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Sep 14 19:34:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:46.762902 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ac129-a9ac-4c9f-9f19-0e81da896cfd None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:46.790242 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd013e-4c71-405d-a26e-e5a0a76c3cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:46.791244 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd013e-4c71-405d-a26e-e5a0a76c3cdd None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:46.791753 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd013e-4c71-405d-a26e-e5a0a76c3cdd None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:46.793600 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd013e-4c71-405d-a26e-e5a0a76c3cdd None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:46.794476 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd013e-4c71-405d-a26e-e5a0a76c3cdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:46.795003 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd013e-4c71-405d-a26e-e5a0a76c3cdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:46.796690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd013e-4c71-405d-a26e-e5a0a76c3cdd None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:46.811573 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 398/782] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:34:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:46.817612 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd013e-4c71-405d-a26e-e5a0a76c3cdd None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:46.875567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:46.974123 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd013e-4c71-405d-a26e-e5a0a76c3cdd None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:47.025459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ac129-a9ac-4c9f-9f19-0e81da896cfd None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:47.049271 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483132b-c0c2-40f4-96ba-764df96d832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:47.052120 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483132b-c0c2-40f4-96ba-764df96d832b None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:47.053099 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:47.054876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483132b-c0c2-40f4-96ba-764df96d832b None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:47.056798 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483132b-c0c2-40f4-96ba-764df96d832b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:47.084609 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483132b-c0c2-40f4-96ba-764df96d832b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:47.087588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483132b-c0c2-40f4-96ba-764df96d832b None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:47.089646 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d4c6a-b423-42f5-99ec-db726381c939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:47.090618 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d4c6a-b423-42f5-99ec-db726381c939 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:47.090974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d4c6a-b423-42f5-99ec-db726381c939 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:47.091318 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d4c6a-b423-42f5-99ec-db726381c939 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:47.092193 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d4c6a-b423-42f5-99ec-db726381c939 None admin] RBAC: Adding query filter params (interface=public, service_id=a24e6a2385904abbbcc8a4aec0589bda, region_id=RegionOne) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:47.093156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d4c6a-b423-42f5-99ec-db726381c939 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:47.094673 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d4c6a-b423-42f5-99ec-db726381c939 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:47.103428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 385/783] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Sep 14 19:34:46 2022] GET /identity/v3/endpoints?service_id=a24e6a2385904abbbcc8a4aec0589bda&interface=public®ion_id=RegionOne => generated 194 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:47.111409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-c483132b-c0c2-40f4-96ba-764df96d832b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:47.111409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:47.111409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:47.111409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:47.111409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:47.111409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:47.111409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:47.111409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:47.111409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:47.111409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:47.111409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:47.111409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:47.111409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:47.111409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:47.111409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:47.111409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:47.112379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:47.112379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:47.112379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:47.112379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:47.112379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:47.112379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:47.112379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:47.112379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:47.112379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:47.112379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:47.112379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:47.112379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:47.112379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:47.112379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:47.112379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:47.112379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:47.112379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:47.113289 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:47.113289 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:47.113289 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:47.114463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 399/784] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:47.114590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d4c6a-b423-42f5-99ec-db726381c939 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:47.124511 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483132b-c0c2-40f4-96ba-764df96d832b None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:47.274858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483132b-c0c2-40f4-96ba-764df96d832b None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:47.276371 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:47.321743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c16cbe-25e2-4205-b132-3643f1cd2fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:47.323378 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c16cbe-25e2-4205-b132-3643f1cd2fd9 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:47.323924 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c16cbe-25e2-4205-b132-3643f1cd2fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:47.324202 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c16cbe-25e2-4205-b132-3643f1cd2fd9 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:47.324855 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c16cbe-25e2-4205-b132-3643f1cd2fd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:47.325160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c16cbe-25e2-4205-b132-3643f1cd2fd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:47.326530 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c16cbe-25e2-4205-b132-3643f1cd2fd9 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:47.343991 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d4c6a-b423-42f5-99ec-db726381c939 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:47.355026 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 400/785] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:47.361110 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c16cbe-25e2-4205-b132-3643f1cd2fd9 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:47.396540 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bbccd-fc59-4148-a2f1-f29900c79aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:47.397172 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bbccd-fc59-4148-a2f1-f29900c79aa2 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:47.397467 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bbccd-fc59-4148-a2f1-f29900c79aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:47.397727 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bbccd-fc59-4148-a2f1-f29900c79aa2 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:47.400609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bbccd-fc59-4148-a2f1-f29900c79aa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:47.407753 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bbccd-fc59-4148-a2f1-f29900c79aa2 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:47.421631 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 386/786] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Sep 14 19:34:47 2022] GET /identity/v3/services => generated 772 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:47.642729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c16cbe-25e2-4205-b132-3643f1cd2fd9 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:47.690217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667add45-e386-40aa-b5a0-a4e976018b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:47.690858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667add45-e386-40aa-b5a0-a4e976018b02 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:47.691130 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667add45-e386-40aa-b5a0-a4e976018b02 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:47.691397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667add45-e386-40aa-b5a0-a4e976018b02 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:47.703569 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667add45-e386-40aa-b5a0-a4e976018b02 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:47.705027 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667add45-e386-40aa-b5a0-a4e976018b02 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:47.720868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-667add45-e386-40aa-b5a0-a4e976018b02 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 19:34:47.720868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:47.720868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:47.720868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:47.720868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:47.720868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:47.720868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:47.720868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:47.720868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:47.720868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:47.720868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:47.720868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:47.720868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:47.720868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:47.720868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:47.720868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:47.721894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:47.721894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:47.721894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:47.721894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:47.721894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:47.721894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:47.721894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:47.721894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:47.721894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:47.721894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:47.721894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:47.721894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:47.721894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:47.721894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:47.721894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:47.721894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:47.721894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:47.721894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:47.722841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:47.722841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:47.722841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:47.722841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:47.722841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:47.722841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:47.722841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:47.722841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:47.722841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 19:34:47.722841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:47.726126 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 401/787] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Sep 14 19:34:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:47.732485 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bbccd-fc59-4148-a2f1-f29900c79aa2 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:47.795694 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:47.873522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bbccd-fc59-4148-a2f1-f29900c79aa2 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:47.924348 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c2309-e180-4976-941f-0723216ada68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:47.924882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c2309-e180-4976-941f-0723216ada68 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:47.925216 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c2309-e180-4976-941f-0723216ada68 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:47.925492 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c2309-e180-4976-941f-0723216ada68 None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:47.926252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c2309-e180-4976-941f-0723216ada68 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:47.926552 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c2309-e180-4976-941f-0723216ada68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:47.928015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c2309-e180-4976-941f-0723216ada68 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:47.953087 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 387/788] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Sep 14 19:34:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:47.959255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667add45-e386-40aa-b5a0-a4e976018b02 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:48.013049 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:48.141758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667add45-e386-40aa-b5a0-a4e976018b02 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:48.183182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b45095-48d0-4d88-b10b-aaf36922de76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:48.183747 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b45095-48d0-4d88-b10b-aaf36922de76 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:48.184027 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b45095-48d0-4d88-b10b-aaf36922de76 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:48.184298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b45095-48d0-4d88-b10b-aaf36922de76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:48.216747 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe389f-9e4e-414b-9635-f4a74d204ea6 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:48.217367 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe389f-9e4e-414b-9635-f4a74d204ea6 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:48.217869 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe389f-9e4e-414b-9635-f4a74d204ea6 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:48.219651 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 388/789] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:48.225658 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbe178-1f35-408c-9d2c-6d2f5172d711 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:48.226226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbe178-1f35-408c-9d2c-6d2f5172d711 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:48.226721 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbe178-1f35-408c-9d2c-6d2f5172d711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:48.267732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-d8fbe178-1f35-408c-9d2c-6d2f5172d711 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:48.268946 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d8fbe178-1f35-408c-9d2c-6d2f5172d711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:48.284266 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b45095-48d0-4d88-b10b-aaf36922de76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:48.285866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b45095-48d0-4d88-b10b-aaf36922de76 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:48.328892 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:48.390487 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 389/790] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 19:34:48.489605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 402/791] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:34:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 19:34:48.495137 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbe178-1f35-408c-9d2c-6d2f5172d711 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:48.535776 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:48.555285 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb72c35-6aaf-43fa-91d6-e90c4faff8e0 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:48.555656 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb72c35-6aaf-43fa-91d6-e90c4faff8e0 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:48.555867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb72c35-6aaf-43fa-91d6-e90c4faff8e0 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:48.558457 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 403/792] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:48.562588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee78735-1c26-4f4b-a599-8e3bd7cf20dc None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:48.563100 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee78735-1c26-4f4b-a599-8e3bd7cf20dc None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:48.563621 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee78735-1c26-4f4b-a599-8e3bd7cf20dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:48.608580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-6ee78735-1c26-4f4b-a599-8e3bd7cf20dc None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:48.610128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-6ee78735-1c26-4f4b-a599-8e3bd7cf20dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:48.619568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbe178-1f35-408c-9d2c-6d2f5172d711 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:48.654661 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282242eb-0fcf-4782-9631-452f19870dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:48.655294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282242eb-0fcf-4782-9631-452f19870dc9 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:48.655589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282242eb-0fcf-4782-9631-452f19870dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:48.656027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282242eb-0fcf-4782-9631-452f19870dc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:48.667115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282242eb-0fcf-4782-9631-452f19870dc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:48.668916 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282242eb-0fcf-4782-9631-452f19870dc9 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:48.685435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-282242eb-0fcf-4782-9631-452f19870dc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:48.685435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:48.685435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:48.685435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:48.685435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:48.685435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:48.685435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:48.685435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:48.685435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:48.685435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:48.685435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:48.685435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:48.685435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:48.685435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:48.685435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:48.685435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:48.686597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:48.686597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:48.686597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:48.686597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:48.686597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:48.686597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:48.686597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:48.686597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:48.686597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:48.686597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:48.686597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:48.686597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:48.686597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:48.686597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:48.686597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:48.686597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:48.686597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:48.687766 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:48.687766 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:48.687766 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:48.689364 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 390/793] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:48.690755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f86c8d-6c32-4759-bd21-6ace78411a61 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:48.691232 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f86c8d-6c32-4759-bd21-6ace78411a61 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:48.694231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f86c8d-6c32-4759-bd21-6ace78411a61 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:48.695947 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 391/794] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:48.696909 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f86c8d-6c32-4759-bd21-6ace78411a61 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:48.707780 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 404/795] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:34:48.709226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71980fe-40ea-4d4f-a8d3-322d9a37dff2 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:48.709512 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71980fe-40ea-4d4f-a8d3-322d9a37dff2 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:48.709854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71980fe-40ea-4d4f-a8d3-322d9a37dff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:48.742127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-f71980fe-40ea-4d4f-a8d3-322d9a37dff2 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:48.743234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f71980fe-40ea-4d4f-a8d3-322d9a37dff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:48.790762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:48.802563 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:48.817201 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f86c8d-6c32-4759-bd21-6ace78411a61 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:48.824356 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 405/796] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:34:48.825421 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71980fe-40ea-4d4f-a8d3-322d9a37dff2 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:48.882145 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b0bf6-297f-4685-8dff-2341f70dc1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:48.882762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b0bf6-297f-4685-8dff-2341f70dc1c7 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:48.883038 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b0bf6-297f-4685-8dff-2341f70dc1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:48.883305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b0bf6-297f-4685-8dff-2341f70dc1c7 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:48.883966 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b0bf6-297f-4685-8dff-2341f70dc1c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:48.884265 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b0bf6-297f-4685-8dff-2341f70dc1c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:48.885623 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b0bf6-297f-4685-8dff-2341f70dc1c7 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:48.912204 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 392/797] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:48.917730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b0bf6-297f-4685-8dff-2341f70dc1c7 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:48.934535 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71980fe-40ea-4d4f-a8d3-322d9a37dff2 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:49.016443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4fabc-5360-4de9-870d-cf61389cf56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:49.017424 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4fabc-5360-4de9-870d-cf61389cf56e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:49.017924 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4fabc-5360-4de9-870d-cf61389cf56e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:49.018396 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4fabc-5360-4de9-870d-cf61389cf56e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:49.027114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b0bf6-297f-4685-8dff-2341f70dc1c7 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:49.043961 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4fabc-5360-4de9-870d-cf61389cf56e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:49.048967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-b2d4fabc-5360-4de9-870d-cf61389cf56e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:34:49.048967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:49.048967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:49.048967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:49.048967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:49.048967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:49.048967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:49.048967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:49.048967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:49.048967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:49.048967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:49.048967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:49.048967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:49.048967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:49.048967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:49.048967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:49.049903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:49.049903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:49.049903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:49.049903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:49.049903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:49.049903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:49.049903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:49.049903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:49.049903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:49.049903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:49.049903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:49.049903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:49.049903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:49.049903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:49.049903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:49.049903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:49.050743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:49.050743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:49.050743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:49.050743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:49.050743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:49.050743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:49.050743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:49.050743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:49.050743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:49.050743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:49.050743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:34:49.050743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:49.052571 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 406/798] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:34:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:49.053655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4fabc-5360-4de9-870d-cf61389cf56e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:49.064356 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500fbd2-e6c1-45e9-8623-e99e41090b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:49.064989 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500fbd2-e6c1-45e9-8623-e99e41090b5b None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:49.065263 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500fbd2-e6c1-45e9-8623-e99e41090b5b None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:49.065532 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500fbd2-e6c1-45e9-8623-e99e41090b5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:49.072623 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500fbd2-e6c1-45e9-8623-e99e41090b5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:49.074141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500fbd2-e6c1-45e9-8623-e99e41090b5b None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:49.076751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:49.087409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-3500fbd2-e6c1-45e9-8623-e99e41090b5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:49.087409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:49.087409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:49.087409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:49.087409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:49.087409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:49.087409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:49.087409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:49.087409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:49.087409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:49.087409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:49.087409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:49.087409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:49.087409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:49.087409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:49.095496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:49.095496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:49.095496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:49.095496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:49.095496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:49.095496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:49.095496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:49.095496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:49.095496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:49.095496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:49.095496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:49.095496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:49.095496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:49.095496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:49.095496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:49.095496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:49.095496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:49.096638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:49.096638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:49.096638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:49.096638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:49.096638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:49.096638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:49.096638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:49.096638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:49.096638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 393/799] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:49.096638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500fbd2-e6c1-45e9-8623-e99e41090b5b None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:49.134534 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:49.177644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4fabc-5360-4de9-870d-cf61389cf56e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:49.194515 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500fbd2-e6c1-45e9-8623-e99e41090b5b None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:49.215868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba317271-4dfc-42e5-a132-1c4e752b18a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:49.216512 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba317271-4dfc-42e5-a132-1c4e752b18a8 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:49.216792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba317271-4dfc-42e5-a132-1c4e752b18a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:49.217066 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba317271-4dfc-42e5-a132-1c4e752b18a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:49.227979 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba317271-4dfc-42e5-a132-1c4e752b18a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:49.229822 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79991307-4ec3-4aeb-9ac5-d42231251d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:49.230432 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79991307-4ec3-4aeb-9ac5-d42231251d53 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:49.230707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79991307-4ec3-4aeb-9ac5-d42231251d53 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:49.230975 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79991307-4ec3-4aeb-9ac5-d42231251d53 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:49.231652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79991307-4ec3-4aeb-9ac5-d42231251d53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:49.231954 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79991307-4ec3-4aeb-9ac5-d42231251d53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:49.232766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-ba317271-4dfc-42e5-a132-1c4e752b18a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:49.232766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:49.232766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:49.232766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:49.232766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:49.232766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:49.232766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:49.232766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:49.232766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:49.232766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:49.232766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:49.232766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:49.232766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:49.232766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:49.232766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:49.232766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:49.233651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:49.233651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:49.233651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:49.233651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:49.233651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:49.233651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:49.233651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:49.233651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:49.233651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:49.233651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:49.233651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:49.233651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:49.233651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:49.233651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:49.233651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:49.233651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:49.234560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:49.234560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:49.234560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:49.234560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:49.234560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:49.234560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:49.234560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:49.234560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:49.234560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:49.234560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:49.234560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:49.234560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:49.235187 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79991307-4ec3-4aeb-9ac5-d42231251d53 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:49.238776 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 407/800] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:34:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:49.239744 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba317271-4dfc-42e5-a132-1c4e752b18a8 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:49.243739 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 394/801] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:34:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:49.243739 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79991307-4ec3-4aeb-9ac5-d42231251d53 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:49.308940 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:49.347768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba317271-4dfc-42e5-a132-1c4e752b18a8 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:49.350094 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:49.353301 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79991307-4ec3-4aeb-9ac5-d42231251d53 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:49.385221 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf88a3-326b-4215-bd4a-c512ecbf14d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:49.385844 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf88a3-326b-4215-bd4a-c512ecbf14d6 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:49.386147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf88a3-326b-4215-bd4a-c512ecbf14d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:49.386457 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf88a3-326b-4215-bd4a-c512ecbf14d6 None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:49.387152 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf88a3-326b-4215-bd4a-c512ecbf14d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:49.387462 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf88a3-326b-4215-bd4a-c512ecbf14d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:49.388943 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf88a3-326b-4215-bd4a-c512ecbf14d6 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:49.396402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e57ef-b0b2-4340-a73d-3d73c4dfcb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:49.397040 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e57ef-b0b2-4340-a73d-3d73c4dfcb14 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:49.397315 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e57ef-b0b2-4340-a73d-3d73c4dfcb14 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:49.397591 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e57ef-b0b2-4340-a73d-3d73c4dfcb14 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:49.398171 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e57ef-b0b2-4340-a73d-3d73c4dfcb14 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:49.399532 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e57ef-b0b2-4340-a73d-3d73c4dfcb14 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:49.408027 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 408/802] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:49.408856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf88a3-326b-4215-bd4a-c512ecbf14d6 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:49.409035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-724e57ef-b0b2-4340-a73d-3d73c4dfcb14 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 19:34:49.409035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:49.409035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:34:49.409035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:34:49.409035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:34:49.409035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:34:49.409035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:34:49.409035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:34:49.409035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 19:34:49.409035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:49.409035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:34:49.409035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:49.409035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:49.409035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:49.409035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:49.409035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:49.409035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:49.409962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:49.409962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:49.409962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:49.409962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:49.409962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:49.409962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:49.409962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:34:49.409962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:34:49.409962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:34:49.409962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:34:49.409962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:49.409962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:49.409962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:49.409962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:49.409962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:49.409962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:49.410852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:49.410852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:49.410852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:49.410852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:49.410852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:49.410852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:49.410852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:49.410852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:49.410852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:49.410852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:49.410852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:34:49.410852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:34:49.410852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 19:34:49.410852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:49.410852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 395/803] 10.222.0.15 () {56 vars in 1129 bytes} [Wed Sep 14 19:34:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:49.411936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e57ef-b0b2-4340-a73d-3d73c4dfcb14 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:49.518084 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e57ef-b0b2-4340-a73d-3d73c4dfcb14 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:49.521101 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf88a3-326b-4215-bd4a-c512ecbf14d6 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:49.545728 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:49.555288 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3463e6-bf6c-443c-90fb-54774a5f3062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:49.555953 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3463e6-bf6c-443c-90fb-54774a5f3062 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:49.556234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3463e6-bf6c-443c-90fb-54774a5f3062 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:49.556507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3463e6-bf6c-443c-90fb-54774a5f3062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:49.557626 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382d127-4035-4a7e-8aaa-c5e11d9521b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:49.558508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382d127-4035-4a7e-8aaa-c5e11d9521b6 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:49.558602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382d127-4035-4a7e-8aaa-c5e11d9521b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:49.558824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382d127-4035-4a7e-8aaa-c5e11d9521b6 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:49.559529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382d127-4035-4a7e-8aaa-c5e11d9521b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:49.559864 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382d127-4035-4a7e-8aaa-c5e11d9521b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:49.561213 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382d127-4035-4a7e-8aaa-c5e11d9521b6 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:49.568635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3463e6-bf6c-443c-90fb-54774a5f3062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:49.574543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 409/804] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Sep 14 19:34:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:49.574673 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3463e6-bf6c-443c-90fb-54774a5f3062 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:49.574752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382d127-4035-4a7e-8aaa-c5e11d9521b6 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:49.591336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-3c3463e6-bf6c-443c-90fb-54774a5f3062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:49.591336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:49.591336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:49.591336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:49.591336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:49.591336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:49.591336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:49.591336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:49.591336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:49.591336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:49.591336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:49.591336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:49.591336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:49.591336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:49.591336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:49.591336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:49.592504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:49.592504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:49.592504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:49.592504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:49.592504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:49.592504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:49.592504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:49.592504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:49.592504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:49.592504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:49.592504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:49.592504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:49.592504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:49.592504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:49.592504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:49.592504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:49.592504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:49.593388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:49.593388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:49.593388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:49.593388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 396/805] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:49.593388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3463e6-bf6c-443c-90fb-54774a5f3062 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:49.605579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:49.686706 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382d127-4035-4a7e-8aaa-c5e11d9521b6 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:49.707914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3463e6-bf6c-443c-90fb-54774a5f3062 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:49.724210 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650efd44-02f1-492e-8ddd-78bb871a2f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:49.724832 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650efd44-02f1-492e-8ddd-78bb871a2f5c None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:49.725108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650efd44-02f1-492e-8ddd-78bb871a2f5c None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:49.725385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650efd44-02f1-492e-8ddd-78bb871a2f5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:49.726107 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650efd44-02f1-492e-8ddd-78bb871a2f5c None admin] RBAC: Adding query filter params (role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=421f6cc846b342918a177d2794eb3db8) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:49.726418 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650efd44-02f1-492e-8ddd-78bb871a2f5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:49.727864 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650efd44-02f1-492e-8ddd-78bb871a2f5c None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:49.733959 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 410/806] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:34:49 2022] GET /identity/v3/role_assignments?user.id=421f6cc846b342918a177d2794eb3db8&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:49.734756 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650efd44-02f1-492e-8ddd-78bb871a2f5c None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:49.756286 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d366965-f1e8-49f4-b7b1-e7b3e793ecdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:49.757397 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d366965-f1e8-49f4-b7b1-e7b3e793ecdf None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:49.757851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d366965-f1e8-49f4-b7b1-e7b3e793ecdf None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:49.758321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d366965-f1e8-49f4-b7b1-e7b3e793ecdf None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:49.759154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d366965-f1e8-49f4-b7b1-e7b3e793ecdf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:49.759752 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d366965-f1e8-49f4-b7b1-e7b3e793ecdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:49.761549 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d366965-f1e8-49f4-b7b1-e7b3e793ecdf None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:49.773156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 397/807] 10.222.0.15 () {56 vars in 1124 bytes} [Wed Sep 14 19:34:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:49.773570 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d366965-f1e8-49f4-b7b1-e7b3e793ecdf None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:49.833682 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:49.865762 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:49.884391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650efd44-02f1-492e-8ddd-78bb871a2f5c None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:49.916643 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d366965-f1e8-49f4-b7b1-e7b3e793ecdf None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:49.934720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc9380-a89e-483c-99e3-7d756438a07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:49.935763 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc9380-a89e-483c-99e3-7d756438a07d None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:49.936227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc9380-a89e-483c-99e3-7d756438a07d None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:49.936681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc9380-a89e-483c-99e3-7d756438a07d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:49.950531 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc9380-a89e-483c-99e3-7d756438a07d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:49.952088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc9380-a89e-483c-99e3-7d756438a07d None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:49.964192 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c939e-5874-4b83-9351-0e44476f46b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:49.964798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c939e-5874-4b83-9351-0e44476f46b4 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:49.965074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c939e-5874-4b83-9351-0e44476f46b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:49.965342 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c939e-5874-4b83-9351-0e44476f46b4 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:49.965982 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c939e-5874-4b83-9351-0e44476f46b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:49.966281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c939e-5874-4b83-9351-0e44476f46b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:49.969193 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c939e-5874-4b83-9351-0e44476f46b4 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:49.969303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-39fc9380-a89e-483c-99e3-7d756438a07d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:49.969303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:49.969303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:49.969303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:49.969303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:49.969303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:49.969303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:49.969303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:49.969303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:49.969303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:49.969303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:49.969303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:49.969303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:49.969303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:49.969303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:49.969303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:49.970198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:49.970198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:49.970198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:49.970198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:49.970198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:49.970198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:49.970198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:49.970198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:49.970198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:49.970198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:49.970198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:49.970198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:49.970198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:49.970198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:49.970198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:49.970198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:49.970198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:49.971118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:49.971118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:49.971118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:49.971118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 411/808] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:49.976083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc9380-a89e-483c-99e3-7d756438a07d None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:49.983154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 398/809] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:49.984306 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c939e-5874-4b83-9351-0e44476f46b4 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:50.105413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc9380-a89e-483c-99e3-7d756438a07d None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:50.109268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c939e-5874-4b83-9351-0e44476f46b4 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:50.111058 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:50.141768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69368da-6563-4dde-ae16-56442f511cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:50.142436 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69368da-6563-4dde-ae16-56442f511cff None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:50.142714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69368da-6563-4dde-ae16-56442f511cff None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:50.143155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69368da-6563-4dde-ae16-56442f511cff None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:50.143739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69368da-6563-4dde-ae16-56442f511cff None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:50.144010 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69368da-6563-4dde-ae16-56442f511cff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:50.145355 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69368da-6563-4dde-ae16-56442f511cff None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:50.147687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ae701-e9d9-473d-b587-9c921f79495e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:50.148425 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ae701-e9d9-473d-b587-9c921f79495e None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:50.148680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ae701-e9d9-473d-b587-9c921f79495e None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:50.148937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ae701-e9d9-473d-b587-9c921f79495e None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:50.149489 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ae701-e9d9-473d-b587-9c921f79495e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:50.149787 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ae701-e9d9-473d-b587-9c921f79495e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:50.155232 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 412/810] 10.222.0.15 () {56 vars in 1124 bytes} [Wed Sep 14 19:34:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:50.155384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ae701-e9d9-473d-b587-9c921f79495e None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:50.155464 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69368da-6563-4dde-ae16-56442f511cff None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:50.160208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:50.163234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 399/811] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:50.168246 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a0969-3e7c-46db-90bf-c23b16a01e22 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:50.168246 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a0969-3e7c-46db-90bf-c23b16a01e22 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:50.168246 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a0969-3e7c-46db-90bf-c23b16a01e22 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:50.168246 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 400/812] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:50.168246 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a0969-3e7c-46db-90bf-c23b16a01e22 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:50.263907 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69368da-6563-4dde-ae16-56442f511cff None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:50.271100 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a0969-3e7c-46db-90bf-c23b16a01e22 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:50.298460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda32ef7-e934-465c-b14c-7435040bde32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:50.299245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda32ef7-e934-465c-b14c-7435040bde32 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:50.299537 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda32ef7-e934-465c-b14c-7435040bde32 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:50.299863 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda32ef7-e934-465c-b14c-7435040bde32 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:50.304705 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95304773-2a08-4df9-949f-e7df65c7a0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:50.305312 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95304773-2a08-4df9-949f-e7df65c7a0e6 None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:50.305585 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95304773-2a08-4df9-949f-e7df65c7a0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:50.305851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95304773-2a08-4df9-949f-e7df65c7a0e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:50.306508 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95304773-2a08-4df9-949f-e7df65c7a0e6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:50.307889 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95304773-2a08-4df9-949f-e7df65c7a0e6 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:50.308066 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda32ef7-e934-465c-b14c-7435040bde32 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:50.309476 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda32ef7-e934-465c-b14c-7435040bde32 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:50.321980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-cda32ef7-e934-465c-b14c-7435040bde32 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 19:34:50.321980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:50.321980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:50.321980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:50.321980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:50.321980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:50.321980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:50.321980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:50.321980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:50.321980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:50.321980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:50.321980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:50.321980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:50.321980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:50.321980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:50.321980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:50.323083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:50.323083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:50.323083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:50.323083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:50.323083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:50.323083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:50.323083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:50.323083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:50.323083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:50.323083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:50.323083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:50.323083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:50.323083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:50.323083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:50.323083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:50.323083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:50.323083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:50.323083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:50.326298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:50.326298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:50.326298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:50.326298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:50.326298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:50.326298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:50.326298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:50.326298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:50.326298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 19:34:50.326298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:50.326298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 413/813] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:34:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:50.326298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda32ef7-e934-465c-b14c-7435040bde32 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:50.401045 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 401/814] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:34:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:34:50.401045 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e5b34-6113-40a4-9e2b-98c3eca19ccf None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:50.401045 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e5b34-6113-40a4-9e2b-98c3eca19ccf None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:50.401045 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e5b34-6113-40a4-9e2b-98c3eca19ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:50.403586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:50.416389 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-8e0e5b34-6113-40a4-9e2b-98c3eca19ccf None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:50.417663 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-8e0e5b34-6113-40a4-9e2b-98c3eca19ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:50.434342 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:50.462834 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda32ef7-e934-465c-b14c-7435040bde32 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:50.512359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53619a-8197-49ea-990a-212be0a6104e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:50.513067 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53619a-8197-49ea-990a-212be0a6104e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:50.513344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53619a-8197-49ea-990a-212be0a6104e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:50.513615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53619a-8197-49ea-990a-212be0a6104e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:50.519692 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 402/815] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:34:50.521823 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e5b34-6113-40a4-9e2b-98c3eca19ccf None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:50.534702 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53619a-8197-49ea-990a-212be0a6104e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:50.539742 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53619a-8197-49ea-990a-212be0a6104e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:50.557149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-de53619a-8197-49ea-990a-212be0a6104e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 19:34:50.557149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:50.557149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:50.557149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:50.557149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:50.557149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:50.557149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:50.557149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:50.557149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:50.557149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:50.557149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:50.557149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:50.557149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:50.557149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:50.557149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:50.557149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:50.558179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:50.558179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:50.558179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:50.558179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:50.558179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:50.558179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:50.558179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:50.558179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:50.558179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:50.558179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:50.558179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:50.558179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:50.558179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:50.558179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:50.558179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:50.558179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:50.558179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:50.558179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:50.559506 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:50.559506 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:50.559506 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:50.559506 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:50.559506 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:50.559506 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:50.559506 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:50.559506 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:50.559506 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 19:34:50.559506 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:50.559506 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 414/816] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Sep 14 19:34:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:50.566118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53619a-8197-49ea-990a-212be0a6104e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:50.684634 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e5b34-6113-40a4-9e2b-98c3eca19ccf None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:50.704572 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53619a-8197-49ea-990a-212be0a6104e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:50.729466 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:50.740099 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436a791-87e1-4f72-a72b-80f18a29345f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:50.740580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436a791-87e1-4f72-a72b-80f18a29345f None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:50.743812 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436a791-87e1-4f72-a72b-80f18a29345f None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:50.743812 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436a791-87e1-4f72-a72b-80f18a29345f None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:50.743812 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436a791-87e1-4f72-a72b-80f18a29345f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:50.743812 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436a791-87e1-4f72-a72b-80f18a29345f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:50.744258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436a791-87e1-4f72-a72b-80f18a29345f None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:50.747412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37eb1e-c397-4cdc-9566-2c2e587696b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:50.748334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37eb1e-c397-4cdc-9566-2c2e587696b2 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:50.748845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37eb1e-c397-4cdc-9566-2c2e587696b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:50.749266 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37eb1e-c397-4cdc-9566-2c2e587696b2 None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:50.750314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37eb1e-c397-4cdc-9566-2c2e587696b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:50.750783 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37eb1e-c397-4cdc-9566-2c2e587696b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:50.752437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37eb1e-c397-4cdc-9566-2c2e587696b2 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:50.769060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 403/817] 10.222.0.15 () {56 vars in 1135 bytes} [Wed Sep 14 19:34:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:50.778235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436a791-87e1-4f72-a72b-80f18a29345f None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:50.778578 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 415/818] 10.222.0.15 () {56 vars in 1149 bytes} [Wed Sep 14 19:34:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:50.782049 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37eb1e-c397-4cdc-9566-2c2e587696b2 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:50.785271 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:50.902655 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436a791-87e1-4f72-a72b-80f18a29345f None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:50.913352 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37eb1e-c397-4cdc-9566-2c2e587696b2 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:50.938576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35077d93-46fb-47b2-8bb1-27c073f9b727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:50.939137 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35077d93-46fb-47b2-8bb1-27c073f9b727 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:50.939411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35077d93-46fb-47b2-8bb1-27c073f9b727 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:50.939710 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35077d93-46fb-47b2-8bb1-27c073f9b727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:50.951236 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35077d93-46fb-47b2-8bb1-27c073f9b727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:50.952725 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35077d93-46fb-47b2-8bb1-27c073f9b727 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:50.955991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc301346-71f1-4b77-9291-548441e349de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:50.956860 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc301346-71f1-4b77-9291-548441e349de None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:50.957491 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc301346-71f1-4b77-9291-548441e349de None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:50.958039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc301346-71f1-4b77-9291-548441e349de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:50.968506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-35077d93-46fb-47b2-8bb1-27c073f9b727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:50.968506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:50.968506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:50.968506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:50.968506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:50.968506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:50.968506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:50.968506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:50.968506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:50.968506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:50.968506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:50.968506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:50.968506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:50.968506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:50.968506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:50.968506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:50.969494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:50.969494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:50.969494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:50.969494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:50.969494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:50.969494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:50.969494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:50.969494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:50.969494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:50.969494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:50.969494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:50.969494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:50.969494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:50.969494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:50.969494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:50.969494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:50.969494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:50.970377 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:50.970377 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:50.970377 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:50.970377 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 404/819] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:50.971083 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35077d93-46fb-47b2-8bb1-27c073f9b727 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:50.971857 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc301346-71f1-4b77-9291-548441e349de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:50.974029 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc301346-71f1-4b77-9291-548441e349de None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:50.993180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-fc301346-71f1-4b77-9291-548441e349de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:50.993180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:50.993180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:50.993180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:50.993180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:50.993180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:50.993180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:50.993180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:50.993180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:50.993180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:50.993180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:50.993180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:50.993180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:50.993180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:50.993180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:50.993180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:50.994274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:50.994274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:50.994274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:50.994274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:50.994274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:50.994274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:50.994274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:50.994274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:50.994274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:50.994274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:50.994274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:50.994274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:50.994274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:50.994274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:50.994274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:50.994274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:50.994274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:50.995163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:50.995163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:50.995163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:50.997707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 416/820] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:50.998667 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc301346-71f1-4b77-9291-548441e349de None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:51.039154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:51.041324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:51.091636 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35077d93-46fb-47b2-8bb1-27c073f9b727 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:51.122222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc301346-71f1-4b77-9291-548441e349de None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:51.137907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2f2ca-40c6-4a72-b4c8-5f3f043ac742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:51.139247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2f2ca-40c6-4a72-b4c8-5f3f043ac742 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:51.139934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2f2ca-40c6-4a72-b4c8-5f3f043ac742 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:51.140358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2f2ca-40c6-4a72-b4c8-5f3f043ac742 None admin] PATH_INFO: `/v3/services/network` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:51.141346 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2f2ca-40c6-4a72-b4c8-5f3f043ac742 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:51.143237 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2f2ca-40c6-4a72-b4c8-5f3f043ac742 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:51.155113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-13f2f2ca-40c6-4a72-b4c8-5f3f043ac742 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 19:34:51.155113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:51.155113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:34:51.155113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:34:51.155113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:34:51.155113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:34:51.155113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:34:51.155113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:34:51.155113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 19:34:51.155113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:51.155113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:34:51.155113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:51.155113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:51.155113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:51.155113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:51.155113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:51.155113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:51.156423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:51.156423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:51.156423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:51.156423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:51.156423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:51.156423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:51.156423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:34:51.156423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:34:51.156423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:34:51.156423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:34:51.156423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:51.156423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:51.156423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:51.156423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:51.156423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:51.156423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:51.157459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:51.157459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:51.157459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:51.157459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:51.157459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:51.157459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:51.157459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:51.157459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:51.157459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:51.157459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:51.157459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:34:51.157459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:34:51.157459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 19:34:51.157459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:51.165947 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 405/821] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:50 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:51.166728 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2f2ca-40c6-4a72-b4c8-5f3f043ac742 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:51.169899 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1b81d-f517-429d-bc5d-1623baafc97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:51.170521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1b81d-f517-429d-bc5d-1623baafc97c None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:51.170802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1b81d-f517-429d-bc5d-1623baafc97c None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:51.171074 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1b81d-f517-429d-bc5d-1623baafc97c None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:51.171880 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1b81d-f517-429d-bc5d-1623baafc97c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:51.172186 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1b81d-f517-429d-bc5d-1623baafc97c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:51.173760 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1b81d-f517-429d-bc5d-1623baafc97c None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:51.191341 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 417/822] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:51.192729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1b81d-f517-429d-bc5d-1623baafc97c None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:51.292269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2f2ca-40c6-4a72-b4c8-5f3f043ac742 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:51.309302 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:51.317568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:51.321849 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1b81d-f517-429d-bc5d-1623baafc97c None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:51.329813 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d18fdc-431d-4a99-8f6c-becc905fd0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:51.330432 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d18fdc-431d-4a99-8f6c-becc905fd0d9 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:51.330716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d18fdc-431d-4a99-8f6c-becc905fd0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:51.330991 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d18fdc-431d-4a99-8f6c-becc905fd0d9 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:51.333502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d18fdc-431d-4a99-8f6c-becc905fd0d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:51.333502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d18fdc-431d-4a99-8f6c-becc905fd0d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:51.334557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d18fdc-431d-4a99-8f6c-becc905fd0d9 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:51.350135 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 406/823] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:51.352071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d18fdc-431d-4a99-8f6c-becc905fd0d9 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:51.382032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e7f2f-21b9-4293-8bf5-b619c1be33f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:51.382917 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e7f2f-21b9-4293-8bf5-b619c1be33f6 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:51.383310 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e7f2f-21b9-4293-8bf5-b619c1be33f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:51.384068 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e7f2f-21b9-4293-8bf5-b619c1be33f6 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:51.385159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e7f2f-21b9-4293-8bf5-b619c1be33f6 None admin] RBAC: Adding query filter params (name=network) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:51.385577 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e7f2f-21b9-4293-8bf5-b619c1be33f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:51.387078 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e7f2f-21b9-4293-8bf5-b619c1be33f6 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:51.393022 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 418/824] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Sep 14 19:34:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:51.394040 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e7f2f-21b9-4293-8bf5-b619c1be33f6 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:51.464450 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d18fdc-431d-4a99-8f6c-becc905fd0d9 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:51.501044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad0600-7423-4be5-bab6-9c319c0a0a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:51.501996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad0600-7423-4be5-bab6-9c319c0a0a06 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:51.502460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad0600-7423-4be5-bab6-9c319c0a0a06 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:51.502905 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad0600-7423-4be5-bab6-9c319c0a0a06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:51.510273 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad0600-7423-4be5-bab6-9c319c0a0a06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:51.511985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad0600-7423-4be5-bab6-9c319c0a0a06 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:51.519523 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e7f2f-21b9-4293-8bf5-b619c1be33f6 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:51.524494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-3aad0600-7423-4be5-bab6-9c319c0a0a06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:51.524494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:51.524494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:51.524494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:51.524494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:51.524494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:51.524494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:51.524494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:51.524494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:51.524494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:51.524494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:51.524494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:51.524494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:51.524494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:51.524494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:51.525400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:51.525400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:51.525400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:51.525400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:51.525400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:51.525400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:51.525400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:51.525400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:51.525400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:51.525400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:51.525400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:51.525400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:51.525400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:51.525400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:51.525400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:51.525400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:51.525400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:51.526268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:51.526268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:51.526268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:51.526268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:51.526268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:51.526268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:51.526268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:51.526268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:51.528670 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 407/825] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:51.529906 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad0600-7423-4be5-bab6-9c319c0a0a06 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:51.565841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbc431-f62d-45e2-b027-d24e51b9e418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:51.566947 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbc431-f62d-45e2-b027-d24e51b9e418 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:51.567519 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbc431-f62d-45e2-b027-d24e51b9e418 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:51.568043 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbc431-f62d-45e2-b027-d24e51b9e418 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:51.577325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbc431-f62d-45e2-b027-d24e51b9e418 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:51.579261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbc431-f62d-45e2-b027-d24e51b9e418 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:51.592251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:51.594567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-a7dbc431-f62d-45e2-b027-d24e51b9e418 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:51.594567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:51.594567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:51.594567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:51.594567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:51.594567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:51.594567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:51.594567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:51.594567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:51.594567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:51.594567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:51.594567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:51.594567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:51.594567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:51.594567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:51.595692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:51.595692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:51.595692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:51.595692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:51.595692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:51.595692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:51.595692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:51.595692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:51.595692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:51.595692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:51.595692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:51.595692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:51.595692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:51.595692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:51.595692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:51.595692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:51.595692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:51.596818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:51.596818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:51.596818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:51.596818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:51.596818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:51.596818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:51.596818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:51.596818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:51.603314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 419/826] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:51.603314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbc431-f62d-45e2-b027-d24e51b9e418 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:51.619344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:51.673166 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad0600-7423-4be5-bab6-9c319c0a0a06 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:51.712873 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c8f38-a971-42e3-af94-cacc4c1b2a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:51.713854 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c8f38-a971-42e3-af94-cacc4c1b2a62 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:51.714529 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c8f38-a971-42e3-af94-cacc4c1b2a62 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:51.715022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c8f38-a971-42e3-af94-cacc4c1b2a62 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:51.715952 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c8f38-a971-42e3-af94-cacc4c1b2a62 None admin] RBAC: Adding query filter params (type=network) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:51.716495 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c8f38-a971-42e3-af94-cacc4c1b2a62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:51.718058 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbc431-f62d-45e2-b027-d24e51b9e418 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:51.718175 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c8f38-a971-42e3-af94-cacc4c1b2a62 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:51.724619 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 408/827] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Sep 14 19:34:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:51.725873 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c8f38-a971-42e3-af94-cacc4c1b2a62 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:51.755585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ab06d-6f72-43a8-bae6-13bc14615e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:51.756271 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ab06d-6f72-43a8-bae6-13bc14615e39 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:51.756550 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ab06d-6f72-43a8-bae6-13bc14615e39 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:51.756823 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ab06d-6f72-43a8-bae6-13bc14615e39 None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:51.757506 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ab06d-6f72-43a8-bae6-13bc14615e39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:51.757831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ab06d-6f72-43a8-bae6-13bc14615e39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:51.759229 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ab06d-6f72-43a8-bae6-13bc14615e39 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:51.775657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 420/828] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:51.776502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ab06d-6f72-43a8-bae6-13bc14615e39 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:51.849722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c8f38-a971-42e3-af94-cacc4c1b2a62 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:51.858600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:51.863411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:51.894020 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ab06d-6f72-43a8-bae6-13bc14615e39 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:51.894231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d755f39-19d1-4f88-a720-d8b4aa2c5661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:51.894640 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d755f39-19d1-4f88-a720-d8b4aa2c5661 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:51.895080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d755f39-19d1-4f88-a720-d8b4aa2c5661 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:51.895419 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d755f39-19d1-4f88-a720-d8b4aa2c5661 None admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:51.896130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d755f39-19d1-4f88-a720-d8b4aa2c5661 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:51.896432 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d755f39-19d1-4f88-a720-d8b4aa2c5661 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:51.898063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d755f39-19d1-4f88-a720-d8b4aa2c5661 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:51.915593 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 409/829] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:51.915593 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d755f39-19d1-4f88-a720-d8b4aa2c5661 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:51.947207 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2435a-c9fc-43d0-84c1-0f807966a5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:51.948196 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2435a-c9fc-43d0-84c1-0f807966a5e2 None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:51.949249 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2435a-c9fc-43d0-84c1-0f807966a5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:51.949531 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2435a-c9fc-43d0-84c1-0f807966a5e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:51.950241 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2435a-c9fc-43d0-84c1-0f807966a5e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:51.951732 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2435a-c9fc-43d0-84c1-0f807966a5e2 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:52.033635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d755f39-19d1-4f88-a720-d8b4aa2c5661 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:52.042686 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 421/830] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:34:51 2022] POST /identity/v3/endpoints => generated 337 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:34:52.044241 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2435a-c9fc-43d0-84c1-0f807966a5e2 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:52.106636 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b40276-8ae9-4ce6-aecf-9914579919d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:52.107854 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b40276-8ae9-4ce6-aecf-9914579919d6 None admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:52.108881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b40276-8ae9-4ce6-aecf-9914579919d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:52.109386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b40276-8ae9-4ce6-aecf-9914579919d6 None admin] PATH_INFO: `/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/ee56bf9af257486e94e6ff1b33086f23/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:52.112610 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b40276-8ae9-4ce6-aecf-9914579919d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e3e0c278ce94ce3a132496923eef365, user_id=ee56bf9af257486e94e6ff1b33086f23, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:52.116344 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b40276-8ae9-4ce6-aecf-9914579919d6 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:52.175909 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2435a-c9fc-43d0-84c1-0f807966a5e2 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:52.190874 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 410/831] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:34:51 2022] PUT /identity/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/ee56bf9af257486e94e6ff1b33086f23/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:34:52.193832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb72b86-3fbb-4db7-b5ba-57db9bfbe4a9 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:52.194699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb72b86-3fbb-4db7-b5ba-57db9bfbe4a9 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:52.195191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb72b86-3fbb-4db7-b5ba-57db9bfbe4a9 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:52.197939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 411/832] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:52.203994 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79084e6a-39f6-459a-8d42-946ec0d833a5 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:52.204216 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79084e6a-39f6-459a-8d42-946ec0d833a5 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:52.204500 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79084e6a-39f6-459a-8d42-946ec0d833a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:52.215488 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:52.223911 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550195d-413e-473a-b972-04a8e30d15a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:52.224978 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550195d-413e-473a-b972-04a8e30d15a2 None admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:52.225515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550195d-413e-473a-b972-04a8e30d15a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:52.226142 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550195d-413e-473a-b972-04a8e30d15a2 None admin] PATH_INFO: `/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/15fbda6263b44352b3ac560372bef725/roles/b2e8ea485659485f92e729741880d447` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:52.226990 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-79084e6a-39f6-459a-8d42-946ec0d833a5 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:52.228289 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-79084e6a-39f6-459a-8d42-946ec0d833a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:52.249904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550195d-413e-473a-b972-04a8e30d15a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e3e0c278ce94ce3a132496923eef365, user_id=15fbda6263b44352b3ac560372bef725, role_id=b2e8ea485659485f92e729741880d447)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:52.250105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:52.252720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550195d-413e-473a-b972-04a8e30d15a2 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:52.316665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 412/833] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:34:52.343628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 422/834] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:34:52 2022] PUT /identity/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/15fbda6263b44352b3ac560372bef725/roles/b2e8ea485659485f92e729741880d447 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:34:52.610820 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79084e6a-39f6-459a-8d42-946ec0d833a5 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:52.713919 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79084e6a-39f6-459a-8d42-946ec0d833a5 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:52.749771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb1880-5eb1-4298-8efb-817b184928fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:52.750742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb1880-5eb1-4298-8efb-817b184928fa None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:52.751195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb1880-5eb1-4298-8efb-817b184928fa None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:52.751685 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb1880-5eb1-4298-8efb-817b184928fa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:52.752445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb1880-5eb1-4298-8efb-817b184928fa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:52.753994 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb1880-5eb1-4298-8efb-817b184928fa None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:52.763980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-44bb1880-5eb1-4298-8efb-817b184928fa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 19:34:52.763980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:52.763980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:34:52.763980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:34:52.763980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:34:52.763980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:34:52.763980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:34:52.763980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:34:52.763980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 19:34:52.763980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:52.763980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:34:52.763980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:52.763980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:52.763980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:52.763980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:52.763980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:52.764938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:52.764938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:52.764938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:52.764938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:52.764938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:52.764938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:52.764938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:52.764938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:34:52.764938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:34:52.764938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:34:52.764938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:34:52.764938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:52.764938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:52.764938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:52.764938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:52.764938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:52.764938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:52.765816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:52.765816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:52.765816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:52.765816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:52.765816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:52.765816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:52.765816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:52.765816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:52.765816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:52.765816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:52.765816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:34:52.765816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:34:52.765816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 19:34:52.765816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:52.768200 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 413/835] 10.222.0.15 () {56 vars in 1132 bytes} [Wed Sep 14 19:34:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:52.774385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550195d-413e-473a-b972-04a8e30d15a2 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:52.883973 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550195d-413e-473a-b972-04a8e30d15a2 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:52.907628 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52228df8-5042-4e67-914d-0fe2a9811d8a None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:52.907909 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52228df8-5042-4e67-914d-0fe2a9811d8a None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:52.908184 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52228df8-5042-4e67-914d-0fe2a9811d8a None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:52.909620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 414/836] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:52.914781 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bc13a-132a-436e-ac84-36b412c14cb3 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:52.915069 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bc13a-132a-436e-ac84-36b412c14cb3 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:52.915347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bc13a-132a-436e-ac84-36b412c14cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:52.920884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efb386-f9de-4e2b-b82d-6a53df753d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:52.921704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efb386-f9de-4e2b-b82d-6a53df753d0c None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:52.922127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efb386-f9de-4e2b-b82d-6a53df753d0c None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:52.922544 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efb386-f9de-4e2b-b82d-6a53df753d0c None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:52.923313 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efb386-f9de-4e2b-b82d-6a53df753d0c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:52.923842 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efb386-f9de-4e2b-b82d-6a53df753d0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:52.925201 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efb386-f9de-4e2b-b82d-6a53df753d0c None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:52.935070 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 423/837] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Sep 14 19:34:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:52.936732 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efb386-f9de-4e2b-b82d-6a53df753d0c None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:52.940459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-f64bc13a-132a-436e-ac84-36b412c14cb3 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:52.942212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f64bc13a-132a-436e-ac84-36b412c14cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:52.954322 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:53.011962 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:53.016923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 415/838] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 19:34:53.046820 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efb386-f9de-4e2b-b82d-6a53df753d0c None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:53.082462 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc023c78-b751-421a-ae2b-3dfa45c73465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:53.083659 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc023c78-b751-421a-ae2b-3dfa45c73465 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:53.084033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc023c78-b751-421a-ae2b-3dfa45c73465 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:53.084231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc023c78-b751-421a-ae2b-3dfa45c73465 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:53.085040 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc023c78-b751-421a-ae2b-3dfa45c73465 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:53.085352 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc023c78-b751-421a-ae2b-3dfa45c73465 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:53.086716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc023c78-b751-421a-ae2b-3dfa45c73465 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:53.091811 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 424/839] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Sep 14 19:34:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:53.298206 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bc13a-132a-436e-ac84-36b412c14cb3 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:53.407990 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bc13a-132a-436e-ac84-36b412c14cb3 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:53.444496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a113a-5bb1-4422-9fd9-bf7ba1b61337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:53.445517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a113a-5bb1-4422-9fd9-bf7ba1b61337 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:53.446012 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a113a-5bb1-4422-9fd9-bf7ba1b61337 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:53.446487 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a113a-5bb1-4422-9fd9-bf7ba1b61337 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:53.447282 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a113a-5bb1-4422-9fd9-bf7ba1b61337 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:53.448984 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a113a-5bb1-4422-9fd9-bf7ba1b61337 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:53.458864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-eb4a113a-5bb1-4422-9fd9-bf7ba1b61337 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 19:34:53.458864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:53.458864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:34:53.458864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:34:53.458864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:34:53.458864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:34:53.458864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:34:53.458864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:34:53.458864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 19:34:53.458864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:53.458864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:34:53.458864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:53.458864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:53.458864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:53.458864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:53.458864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:53.458864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:53.459893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:53.459893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:53.459893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:53.459893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:53.459893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:53.459893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:53.459893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:34:53.459893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:34:53.459893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:34:53.459893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:34:53.459893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:53.459893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:53.459893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:53.459893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:53.459893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:53.459893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:53.460732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:53.460732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:53.460732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:53.460732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:53.460732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:53.460732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:53.460732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:53.460732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:53.460732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:53.460732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:53.460732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:34:53.460732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:34:53.460732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 19:34:53.460732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:53.463421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 416/840] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:34:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:53.468994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc023c78-b751-421a-ae2b-3dfa45c73465 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:53.575478 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc023c78-b751-421a-ae2b-3dfa45c73465 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:53.585842 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:53.611716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b103ad1-0bd2-49c8-a85e-7c3c0c207d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:53.612391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b103ad1-0bd2-49c8-a85e-7c3c0c207d45 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:53.612673 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b103ad1-0bd2-49c8-a85e-7c3c0c207d45 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:53.612942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b103ad1-0bd2-49c8-a85e-7c3c0c207d45 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:53.613572 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b103ad1-0bd2-49c8-a85e-7c3c0c207d45 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:53.613934 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b103ad1-0bd2-49c8-a85e-7c3c0c207d45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:53.616018 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b103ad1-0bd2-49c8-a85e-7c3c0c207d45 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:53.621289 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 425/841] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:34:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:53.628620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a113a-5bb1-4422-9fd9-bf7ba1b61337 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:53.642317 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:53.736571 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a113a-5bb1-4422-9fd9-bf7ba1b61337 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:53.773288 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7096e85-1f87-4525-ab0e-b5bd45fc450b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:53.774230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7096e85-1f87-4525-ab0e-b5bd45fc450b None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:53.774740 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7096e85-1f87-4525-ab0e-b5bd45fc450b None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:53.775217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7096e85-1f87-4525-ab0e-b5bd45fc450b None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:53.776085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7096e85-1f87-4525-ab0e-b5bd45fc450b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:53.776613 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7096e85-1f87-4525-ab0e-b5bd45fc450b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:53.778225 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7096e85-1f87-4525-ab0e-b5bd45fc450b None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:53.783713 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 417/842] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:34:53 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:54.561334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9977c-6c5e-4f41-bc4d-0e6b2b37ff8f None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:54.561849 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9977c-6c5e-4f41-bc4d-0e6b2b37ff8f None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:54.561849 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9977c-6c5e-4f41-bc4d-0e6b2b37ff8f None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:54.563515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 426/843] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:54.569174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a6940-c0e9-4bde-b641-a49bfac417a6 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:54.569605 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a6940-c0e9-4bde-b641-a49bfac417a6 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:54.569785 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a6940-c0e9-4bde-b641-a49bfac417a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:54.589063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-e44a6940-c0e9-4bde-b641-a49bfac417a6 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:54.590233 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e44a6940-c0e9-4bde-b641-a49bfac417a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:54.609413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ff6fa-5c78-4c14-b080-31d79b04a982 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:54.609701 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ff6fa-5c78-4c14-b080-31d79b04a982 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:54.609957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ff6fa-5c78-4c14-b080-31d79b04a982 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:54.611490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 427/844] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:54.617358 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb940f0b-4ebd-40a2-ab2f-f90c11e28788 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:54.617633 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb940f0b-4ebd-40a2-ab2f-f90c11e28788 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:54.617905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb940f0b-4ebd-40a2-ab2f-f90c11e28788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:54.636350 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-bb940f0b-4ebd-40a2-ab2f-f90c11e28788 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:54.637460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-bb940f0b-4ebd-40a2-ab2f-f90c11e28788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:54.671120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 418/845] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:34:54.711982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 428/846] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 19:34:54.955710 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a6940-c0e9-4bde-b641-a49bfac417a6 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:54.959843 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:54.988929 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb940f0b-4ebd-40a2-ab2f-f90c11e28788 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:55.070604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a6940-c0e9-4bde-b641-a49bfac417a6 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:55.100576 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb940f0b-4ebd-40a2-ab2f-f90c11e28788 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:55.102480 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:55.110436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1331f32-7dab-4d6e-ad14-e8ff805bfae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:55.111073 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1331f32-7dab-4d6e-ad14-e8ff805bfae1 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:55.111564 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1331f32-7dab-4d6e-ad14-e8ff805bfae1 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:55.112012 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1331f32-7dab-4d6e-ad14-e8ff805bfae1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:55.124689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1331f32-7dab-4d6e-ad14-e8ff805bfae1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:55.129840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-b1331f32-7dab-4d6e-ad14-e8ff805bfae1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:34:55.129840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:55.129840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:55.129840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:55.129840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:55.129840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:55.129840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:55.129840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:55.129840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:55.129840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:55.129840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:55.129840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:55.129840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:55.129840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:55.129840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:55.129840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:55.131296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:55.131296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:55.131296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:55.131296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:55.131296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:55.131296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:55.131296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:55.131296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:55.131296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:55.131296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:55.131296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:55.131296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:55.131296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:55.131296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:55.131296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:55.131296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:55.132361 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:55.132361 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:55.132361 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:55.132361 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:55.132361 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:55.132361 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:55.132361 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:55.132361 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:55.132361 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:55.132361 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:55.132361 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:34:55.132361 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:55.134592 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 419/847] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:34:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:55.140207 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1331f32-7dab-4d6e-ad14-e8ff805bfae1 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:55.146741 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84939007-f3ba-4cff-97ee-94ad4c0c8021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:55.147494 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84939007-f3ba-4cff-97ee-94ad4c0c8021 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:55.147802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84939007-f3ba-4cff-97ee-94ad4c0c8021 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:55.148077 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84939007-f3ba-4cff-97ee-94ad4c0c8021 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:55.162052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84939007-f3ba-4cff-97ee-94ad4c0c8021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:34:55.168538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-84939007-f3ba-4cff-97ee-94ad4c0c8021 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:55.168538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:55.168538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:55.168538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:55.168538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:55.168538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:55.168538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:55.168538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:55.168538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:55.168538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:55.168538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:55.168538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:55.168538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:34:55.168538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:34:55.168538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:34:55.168538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:34:55.169446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:34:55.169446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:34:55.169446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:34:55.169446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:34:55.169446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:55.169446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:55.169446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:55.169446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:55.169446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:55.169446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:55.169446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:55.169446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:55.169446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:55.169446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:55.169446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:55.169446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:55.170276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:55.170276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:55.170276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:55.170276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:55.170276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:34:55.170276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:34:55.170276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:34:55.170276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:34:55.170276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:34:55.170276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:34:55.170276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:34:55.170276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:55.170276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 429/848] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:34:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:55.175313 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84939007-f3ba-4cff-97ee-94ad4c0c8021 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:55.220327 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:55.264004 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1331f32-7dab-4d6e-ad14-e8ff805bfae1 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:55.279078 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84939007-f3ba-4cff-97ee-94ad4c0c8021 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:55.307773 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4992a-88c5-4899-84dd-8557bd867418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:55.308879 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4992a-88c5-4899-84dd-8557bd867418 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:55.309496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4992a-88c5-4899-84dd-8557bd867418 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:55.309989 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4992a-88c5-4899-84dd-8557bd867418 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:55.310878 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4992a-88c5-4899-84dd-8557bd867418 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:55.311390 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4992a-88c5-4899-84dd-8557bd867418 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:55.313159 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4992a-88c5-4899-84dd-8557bd867418 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:55.317281 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d530476-1c55-44d5-b787-937c3d50ea29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:55.318206 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d530476-1c55-44d5-b787-937c3d50ea29 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:55.318630 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d530476-1c55-44d5-b787-937c3d50ea29 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:55.319039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d530476-1c55-44d5-b787-937c3d50ea29 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:55.319899 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d530476-1c55-44d5-b787-937c3d50ea29 None admin] RBAC: Adding query filter params (name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:55.320393 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d530476-1c55-44d5-b787-937c3d50ea29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:55.322212 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d530476-1c55-44d5-b787-937c3d50ea29 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:55.324072 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 420/849] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:34:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:55.330864 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 430/850] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Sep 14 19:34:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:55.336620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4992a-88c5-4899-84dd-8557bd867418 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:55.336965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d530476-1c55-44d5-b787-937c3d50ea29 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:55.362736 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:55.453988 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4992a-88c5-4899-84dd-8557bd867418 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:55.460651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d530476-1c55-44d5-b787-937c3d50ea29 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:55.480973 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:55.490711 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca94506-0945-4842-a089-46b40feaf2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:55.491672 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca94506-0945-4842-a089-46b40feaf2b7 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:55.492166 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca94506-0945-4842-a089-46b40feaf2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:55.492503 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca94506-0945-4842-a089-46b40feaf2b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:55.497160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63b9cb-6cb9-4cc0-bfd2-b6be7f44e9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:55.497797 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63b9cb-6cb9-4cc0-bfd2-b6be7f44e9d8 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:55.502751 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63b9cb-6cb9-4cc0-bfd2-b6be7f44e9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:55.502751 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63b9cb-6cb9-4cc0-bfd2-b6be7f44e9d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:55.503060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca94506-0945-4842-a089-46b40feaf2b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:55.504504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca94506-0945-4842-a089-46b40feaf2b7 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:55.509971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63b9cb-6cb9-4cc0-bfd2-b6be7f44e9d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:55.511405 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63b9cb-6cb9-4cc0-bfd2-b6be7f44e9d8 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:55.520074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-7ca94506-0945-4842-a089-46b40feaf2b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:55.520074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:55.520074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:55.520074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:55.520074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:55.520074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:55.520074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:55.520074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:55.520074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:55.520074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:55.520074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:55.520074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:55.520074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:55.520074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:55.520074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:55.520074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:55.521052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:55.521052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:55.521052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:55.521052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:55.521052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:55.521052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:55.521052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:55.521052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:55.521052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:55.521052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:55.521052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:55.521052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:55.521052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:55.521052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:55.521052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:55.521052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:55.521052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:55.521945 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:55.521945 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:55.521945 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:55.521945 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 421/851] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:55.522593 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c519a-3e06-4af7-b17b-01dc34da4d57 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:55.522948 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c519a-3e06-4af7-b17b-01dc34da4d57 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:55.523164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c519a-3e06-4af7-b17b-01dc34da4d57 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:55.524699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 422/852] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:55.526560 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c519a-3e06-4af7-b17b-01dc34da4d57 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:55.531739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-8f63b9cb-6cb9-4cc0-bfd2-b6be7f44e9d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:55.531739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:55.531739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:55.531739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:55.531739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:55.531739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:55.531739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:55.531739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:55.531739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:55.531739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:55.531739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:55.531739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:55.531739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:55.531739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:55.531739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:55.531739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:55.532910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:55.532910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:55.532910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:55.532910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:55.532910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:55.532910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:55.532910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:55.532910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:55.532910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:55.532910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:55.532910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:55.532910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:55.532910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:55.532910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:55.532910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:55.532910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:55.532910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:55.534004 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:55.534004 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:55.534004 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:55.535384 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 431/853] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:55.537780 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cb7b1-3432-4a6a-b991-23227195040c None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:55.538227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cb7b1-3432-4a6a-b991-23227195040c None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:55.538626 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cb7b1-3432-4a6a-b991-23227195040c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:55.563026 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-166cb7b1-3432-4a6a-b991-23227195040c None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:55.566011 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-166cb7b1-3432-4a6a-b991-23227195040c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:55.634063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c519a-3e06-4af7-b17b-01dc34da4d57 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:55.641293 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 432/854] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:34:55.644712 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cb7b1-3432-4a6a-b991-23227195040c None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:55.656900 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:55.673199 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442df533-01c0-472a-a078-6f48c382c592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:55.674247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442df533-01c0-472a-a078-6f48c382c592 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:55.674247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442df533-01c0-472a-a078-6f48c382c592 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:55.674546 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442df533-01c0-472a-a078-6f48c382c592 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:55.675260 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442df533-01c0-472a-a078-6f48c382c592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:55.675675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442df533-01c0-472a-a078-6f48c382c592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:55.677154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442df533-01c0-472a-a078-6f48c382c592 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:55.691203 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 423/855] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:55.700851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442df533-01c0-472a-a078-6f48c382c592 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:55.758016 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:55.772788 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cb7b1-3432-4a6a-b991-23227195040c None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:55.815196 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdea85d-6d93-49a6-9f4a-81a4cddcec7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:55.816129 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdea85d-6d93-49a6-9f4a-81a4cddcec7e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:55.816681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdea85d-6d93-49a6-9f4a-81a4cddcec7e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:55.817093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdea85d-6d93-49a6-9f4a-81a4cddcec7e None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:55.818649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdea85d-6d93-49a6-9f4a-81a4cddcec7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:55.819394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdea85d-6d93-49a6-9f4a-81a4cddcec7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:55.821095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdea85d-6d93-49a6-9f4a-81a4cddcec7e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:55.837055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 433/856] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:55.844303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdea85d-6d93-49a6-9f4a-81a4cddcec7e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:55.851989 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442df533-01c0-472a-a078-6f48c382c592 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:55.888152 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b3d7e-7236-4547-9068-348bb89bc04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:55.888837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b3d7e-7236-4547-9068-348bb89bc04d None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:55.889113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b3d7e-7236-4547-9068-348bb89bc04d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:55.889380 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b3d7e-7236-4547-9068-348bb89bc04d None admin] PATH_INFO: `/v3/users/swift` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:55.897244 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b3d7e-7236-4547-9068-348bb89bc04d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:55.898826 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b3d7e-7236-4547-9068-348bb89bc04d None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:55.912479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-776b3d7e-7236-4547-9068-348bb89bc04d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 19:34:55.912479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:55.912479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:55.912479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:55.912479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:55.912479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:55.912479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:55.912479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:55.912479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:55.912479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:55.912479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:55.912479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:55.912479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:55.912479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:55.912479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:55.912479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:55.913816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:55.913816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:55.913816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:55.913816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:55.913816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:55.913816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:55.913816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:55.913816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:55.913816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:55.913816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:55.913816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:55.913816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:55.913816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:55.913816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:55.913816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:55.913816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:55.913816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:55.913816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:55.914763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:55.914763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:55.914763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:55.914763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:55.914763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:55.914763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:55.914763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:55.914763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:55.914763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 19:34:55.914763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:55.918889 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 424/857] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:34:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:55.919972 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b3d7e-7236-4547-9068-348bb89bc04d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:55.936463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:55.974892 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdea85d-6d93-49a6-9f4a-81a4cddcec7e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:56.012564 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df1108-08b6-4c5e-9c95-b644e2e60daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:56.013127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df1108-08b6-4c5e-9c95-b644e2e60daf None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:56.013412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df1108-08b6-4c5e-9c95-b644e2e60daf None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:56.013677 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df1108-08b6-4c5e-9c95-b644e2e60daf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:56.022378 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df1108-08b6-4c5e-9c95-b644e2e60daf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:56.023853 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df1108-08b6-4c5e-9c95-b644e2e60daf None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:56.033899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:56.035922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-22df1108-08b6-4c5e-9c95-b644e2e60daf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 19:34:56.035922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:56.035922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:56.035922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:56.035922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:56.035922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:56.035922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:56.035922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:56.035922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:56.035922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:56.035922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:56.035922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:56.035922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:34:56.035922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:34:56.035922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:34:56.035922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:34:56.037422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:56.037422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:56.037422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:34:56.037422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:56.037422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:34:56.037422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:34:56.037422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:56.037422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:56.037422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:56.037422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:56.037422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:56.037422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:56.037422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:56.037422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:56.037422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:56.037422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:56.037422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:56.037422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:56.038547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:56.038547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:56.038547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:34:56.038547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:34:56.038547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:34:56.038547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:34:56.038547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:34:56.038547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:34:56.038547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 19:34:56.038547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:56.039154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b3d7e-7236-4547-9068-348bb89bc04d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:56.042164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 434/858] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Sep 14 19:34:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:56.046622 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df1108-08b6-4c5e-9c95-b644e2e60daf None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:56.072762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d9f6a-fd25-472b-a0de-fc148a67cb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:56.073370 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d9f6a-fd25-472b-a0de-fc148a67cb2c None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:56.073644 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d9f6a-fd25-472b-a0de-fc148a67cb2c None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:56.073921 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d9f6a-fd25-472b-a0de-fc148a67cb2c None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:56.074642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d9f6a-fd25-472b-a0de-fc148a67cb2c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:56.074954 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d9f6a-fd25-472b-a0de-fc148a67cb2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:56.076394 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d9f6a-fd25-472b-a0de-fc148a67cb2c None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:56.093840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 425/859] 10.222.0.15 () {56 vars in 1135 bytes} [Wed Sep 14 19:34:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:56.095041 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100619c-b0dd-4c76-8f71-d5bce72ea991 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:56.095319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100619c-b0dd-4c76-8f71-d5bce72ea991 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:56.095616 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100619c-b0dd-4c76-8f71-d5bce72ea991 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:56.099864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 426/860] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:56.099864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100619c-b0dd-4c76-8f71-d5bce72ea991 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:56.142756 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df1108-08b6-4c5e-9c95-b644e2e60daf None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:56.168836 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:56.177609 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880df06-02dc-4a8e-80f5-c6bd8cfb7086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:56.178427 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880df06-02dc-4a8e-80f5-c6bd8cfb7086 None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:56.181407 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880df06-02dc-4a8e-80f5-c6bd8cfb7086 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:56.181407 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880df06-02dc-4a8e-80f5-c6bd8cfb7086 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:56.181407 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880df06-02dc-4a8e-80f5-c6bd8cfb7086 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:56.181407 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880df06-02dc-4a8e-80f5-c6bd8cfb7086 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:56.199686 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100619c-b0dd-4c76-8f71-d5bce72ea991 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:56.232967 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa414831-3b32-4570-9c79-e379717e41d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:56.233565 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa414831-3b32-4570-9c79-e379717e41d8 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:56.233843 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa414831-3b32-4570-9c79-e379717e41d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:56.234114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa414831-3b32-4570-9c79-e379717e41d8 None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:56.234831 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa414831-3b32-4570-9c79-e379717e41d8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:56.235135 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa414831-3b32-4570-9c79-e379717e41d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:56.236567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa414831-3b32-4570-9c79-e379717e41d8 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:56.253104 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 427/861] 10.222.0.15 () {56 vars in 1149 bytes} [Wed Sep 14 19:34:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:56.253969 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa414831-3b32-4570-9c79-e379717e41d8 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:56.268973 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:56.285681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 435/862] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Sep 14 19:34:56 2022] POST /identity/v3/services => generated 269 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:34:56.287007 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0886e-9ed9-4dd7-ad76-7d7d0e837991 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:56.287292 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0886e-9ed9-4dd7-ad76-7d7d0e837991 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:56.287588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0886e-9ed9-4dd7-ad76-7d7d0e837991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:56.310163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-68b0886e-9ed9-4dd7-ad76-7d7d0e837991 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:56.311723 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-68b0886e-9ed9-4dd7-ad76-7d7d0e837991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:56.367607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa414831-3b32-4570-9c79-e379717e41d8 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:56.403760 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 436/863] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:56 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:34:56.404643 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0886e-9ed9-4dd7-ad76-7d7d0e837991 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:56.430090 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0926b-849f-4a2f-8576-ec47395fa934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:56.431109 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0926b-849f-4a2f-8576-ec47395fa934 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:56.431578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0926b-849f-4a2f-8576-ec47395fa934 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:56.432209 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0926b-849f-4a2f-8576-ec47395fa934 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:56.524085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0926b-849f-4a2f-8576-ec47395fa934 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:56.525531 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0926b-849f-4a2f-8576-ec47395fa934 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:56.525860 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0886e-9ed9-4dd7-ad76-7d7d0e837991 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:56.541505 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:56.542962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:56.566302 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54993c3e-b19c-4b58-8cc8-7b996b15e90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:56.567007 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54993c3e-b19c-4b58-8cc8-7b996b15e90d None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:56.567372 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54993c3e-b19c-4b58-8cc8-7b996b15e90d None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:56.567792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54993c3e-b19c-4b58-8cc8-7b996b15e90d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:56.653498 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54993c3e-b19c-4b58-8cc8-7b996b15e90d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:56.654594 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 428/864] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:34:56 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 19:34:56.659815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54993c3e-b19c-4b58-8cc8-7b996b15e90d None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:56.660845 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0926b-849f-4a2f-8576-ec47395fa934 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:56.772121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 437/865] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:34:56 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 19:34:56.773069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54993c3e-b19c-4b58-8cc8-7b996b15e90d None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:56.773686 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0926b-849f-4a2f-8576-ec47395fa934 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:56.792173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:56.793187 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:56.813671 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd3672-c767-49ab-bbf3-e1c07424a486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:56.814311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd3672-c767-49ab-bbf3-e1c07424a486 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:56.814587 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd3672-c767-49ab-bbf3-e1c07424a486 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:56.814860 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd3672-c767-49ab-bbf3-e1c07424a486 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:56.826907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd3672-c767-49ab-bbf3-e1c07424a486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:56.828959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd3672-c767-49ab-bbf3-e1c07424a486 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:56.845875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-86dd3672-c767-49ab-bbf3-e1c07424a486 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:56.845875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:56.845875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:56.845875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:56.845875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:56.845875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:56.845875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:56.845875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:56.845875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:56.845875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:56.845875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:56.845875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:56.845875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:56.845875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:56.845875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:56.845875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:56.846828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:56.846828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:56.846828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:56.846828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:56.846828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:56.846828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:56.846828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:56.846828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:56.846828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:56.846828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:56.846828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:56.846828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:56.846828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:56.846828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:56.846828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:56.846828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:56.846828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:56.847751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:56.847751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:56.847751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:56.850219 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 429/866] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:56.851175 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd3672-c767-49ab-bbf3-e1c07424a486 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:56.892502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54993c3e-b19c-4b58-8cc8-7b996b15e90d None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:56.930380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44189c0a-fd9e-4f62-bfdc-61402c83c993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:56.931507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44189c0a-fd9e-4f62-bfdc-61402c83c993 None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:56.931507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44189c0a-fd9e-4f62-bfdc-61402c83c993 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:56.931507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44189c0a-fd9e-4f62-bfdc-61402c83c993 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:56.932205 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44189c0a-fd9e-4f62-bfdc-61402c83c993 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:56.933571 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44189c0a-fd9e-4f62-bfdc-61402c83c993 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:56.960824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd3672-c767-49ab-bbf3-e1c07424a486 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:56.992910 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6b040-9a69-485d-bb2d-cbd5214d148e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:56.993581 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6b040-9a69-485d-bb2d-cbd5214d148e None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:56.993856 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6b040-9a69-485d-bb2d-cbd5214d148e None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:56.994125 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6b040-9a69-485d-bb2d-cbd5214d148e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:57.004524 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6b040-9a69-485d-bb2d-cbd5214d148e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:57.006487 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6b040-9a69-485d-bb2d-cbd5214d148e None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:57.020292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-fab6b040-9a69-485d-bb2d-cbd5214d148e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:57.020292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:57.020292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:57.020292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:57.020292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:57.020292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:57.020292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:57.020292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:57.020292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:57.020292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:57.020292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:57.020292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:57.020292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:34:57.020292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:34:57.020292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:34:57.020292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:34:57.022127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:57.022127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:57.022127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:57.022127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:57.022127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:57.022127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:57.022127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:57.022127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:57.022127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:57.022127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:57.022127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:57.022127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:57.022127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:57.022127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:57.022127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:57.022127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:57.022127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:34:57.023466 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:34:57.023466 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:34:57.023466 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:57.023466 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 430/867] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:57.023466 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6b040-9a69-485d-bb2d-cbd5214d148e None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:57.045370 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:57.047328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 438/868] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Sep 14 19:34:56 2022] POST /identity/v3/services => generated 251 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:34:57.048537 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44189c0a-fd9e-4f62-bfdc-61402c83c993 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:57.146253 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:57.179126 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6b040-9a69-485d-bb2d-cbd5214d148e None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:57.196077 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44189c0a-fd9e-4f62-bfdc-61402c83c993 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:57.222712 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978045a-5923-46d9-bc3a-c2bfaf741fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:57.223756 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978045a-5923-46d9-bc3a-c2bfaf741fe0 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:57.224035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978045a-5923-46d9-bc3a-c2bfaf741fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:57.224825 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978045a-5923-46d9-bc3a-c2bfaf741fe0 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:57.226306 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978045a-5923-46d9-bc3a-c2bfaf741fe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:57.226771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978045a-5923-46d9-bc3a-c2bfaf741fe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:57.228255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978045a-5923-46d9-bc3a-c2bfaf741fe0 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:57.241294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 431/869] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:57.244487 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfabd13-6c00-456e-93c2-32bc4be3800e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:57.245140 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfabd13-6c00-456e-93c2-32bc4be3800e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:57.245421 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfabd13-6c00-456e-93c2-32bc4be3800e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:57.245696 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfabd13-6c00-456e-93c2-32bc4be3800e None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:57.247150 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978045a-5923-46d9-bc3a-c2bfaf741fe0 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:57.247326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfabd13-6c00-456e-93c2-32bc4be3800e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:57.247536 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfabd13-6c00-456e-93c2-32bc4be3800e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:57.249114 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfabd13-6c00-456e-93c2-32bc4be3800e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:57.268338 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 439/870] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:57.269476 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfabd13-6c00-456e-93c2-32bc4be3800e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:57.373083 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978045a-5923-46d9-bc3a-c2bfaf741fe0 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:57.392048 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:57.408178 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfabd13-6c00-456e-93c2-32bc4be3800e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:57.414946 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2518c-cefe-4c0b-9f67-0d538afa7959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:57.417002 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2518c-cefe-4c0b-9f67-0d538afa7959 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:57.417002 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2518c-cefe-4c0b-9f67-0d538afa7959 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:57.417002 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2518c-cefe-4c0b-9f67-0d538afa7959 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:57.424014 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2518c-cefe-4c0b-9f67-0d538afa7959 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:57.425735 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2518c-cefe-4c0b-9f67-0d538afa7959 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:57.439917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-b7a2518c-cefe-4c0b-9f67-0d538afa7959 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:57.439917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:57.439917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:57.439917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:57.439917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:57.439917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:57.439917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:57.439917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:57.439917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:57.439917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:57.439917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:57.439917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:57.439917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:57.439917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:57.439917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:57.440872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:57.440872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:57.440872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:57.440872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:57.440872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:57.440872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:57.440872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:57.440872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:57.440872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:57.440872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:57.440872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:57.440872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:57.440872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:57.440872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:57.440872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:57.440872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:57.440872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:57.441740 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:57.441740 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:57.441740 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:57.441740 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:57.441740 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:57.441740 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:57.441740 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:57.441740 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:57.442956 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:57.445543 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 432/871] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:57.451158 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2518c-cefe-4c0b-9f67-0d538afa7959 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:57.453026 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38ed51-8785-44b6-8cfd-1bbd047e7dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:57.453665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38ed51-8785-44b6-8cfd-1bbd047e7dfb None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:57.453937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38ed51-8785-44b6-8cfd-1bbd047e7dfb None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:57.455201 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38ed51-8785-44b6-8cfd-1bbd047e7dfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:57.461302 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38ed51-8785-44b6-8cfd-1bbd047e7dfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:57.462852 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38ed51-8785-44b6-8cfd-1bbd047e7dfb None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:57.475283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-0f38ed51-8785-44b6-8cfd-1bbd047e7dfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:57.475283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:57.475283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:57.475283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:57.475283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:57.475283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:57.475283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:57.475283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:57.475283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:57.475283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:57.475283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:57.475283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:57.475283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:34:57.475283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:34:57.475283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:34:57.476315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:34:57.476315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:57.476315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:57.476315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:57.476315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:57.476315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:57.476315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:57.476315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:57.476315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:57.476315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:57.476315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:57.476315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:57.476315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:57.476315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:57.476315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:57.476315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:57.476315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:57.477215 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:34:57.477215 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:34:57.477215 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:34:57.477215 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:34:57.477215 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:34:57.477215 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:34:57.477215 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:34:57.477215 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:57.481169 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 440/872] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:34:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:57.482246 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38ed51-8785-44b6-8cfd-1bbd047e7dfb None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:57.564324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2518c-cefe-4c0b-9f67-0d538afa7959 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:57.595436 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38ed51-8785-44b6-8cfd-1bbd047e7dfb None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:57.603353 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42636360-8d6f-418b-8a89-2d2e2d4b8db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:57.604193 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42636360-8d6f-418b-8a89-2d2e2d4b8db8 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:57.604725 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42636360-8d6f-418b-8a89-2d2e2d4b8db8 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:57.605070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42636360-8d6f-418b-8a89-2d2e2d4b8db8 None admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:57.605865 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42636360-8d6f-418b-8a89-2d2e2d4b8db8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:57.606286 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42636360-8d6f-418b-8a89-2d2e2d4b8db8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:57.607989 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42636360-8d6f-418b-8a89-2d2e2d4b8db8 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:57.617273 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:57.627299 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 433/873] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:57.630458 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42636360-8d6f-418b-8a89-2d2e2d4b8db8 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:57.640761 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e019f16-1654-454b-b6d7-70bf743338f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:57.641396 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e019f16-1654-454b-b6d7-70bf743338f0 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:57.641671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e019f16-1654-454b-b6d7-70bf743338f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:57.641942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e019f16-1654-454b-b6d7-70bf743338f0 None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:57.642637 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e019f16-1654-454b-b6d7-70bf743338f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:57.642942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e019f16-1654-454b-b6d7-70bf743338f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:57.645028 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e019f16-1654-454b-b6d7-70bf743338f0 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:57.661062 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 441/874] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:34:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:57.668634 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e019f16-1654-454b-b6d7-70bf743338f0 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:57.733085 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:57.750017 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42636360-8d6f-418b-8a89-2d2e2d4b8db8 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:57.787261 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17086be9-aff1-4464-93a8-472d29e21c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:57.788285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17086be9-aff1-4464-93a8-472d29e21c81 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:57.788760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17086be9-aff1-4464-93a8-472d29e21c81 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:57.789248 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17086be9-aff1-4464-93a8-472d29e21c81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:57.790163 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17086be9-aff1-4464-93a8-472d29e21c81 None admin] RBAC: Adding query filter params (role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=ee56bf9af257486e94e6ff1b33086f23) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:57.790664 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17086be9-aff1-4464-93a8-472d29e21c81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:57.792438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17086be9-aff1-4464-93a8-472d29e21c81 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:57.798729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e019f16-1654-454b-b6d7-70bf743338f0 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:57.798996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 434/875] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:34:57 2022] GET /identity/v3/role_assignments?user.id=ee56bf9af257486e94e6ff1b33086f23&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:34:57.847045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1035750-651c-4f1f-aa2a-4dd9b4b28d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:57.848100 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1035750-651c-4f1f-aa2a-4dd9b4b28d1f None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:57.848584 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1035750-651c-4f1f-aa2a-4dd9b4b28d1f None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:57.849084 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1035750-651c-4f1f-aa2a-4dd9b4b28d1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:57.851083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1035750-651c-4f1f-aa2a-4dd9b4b28d1f None admin] RBAC: Adding query filter params (role.id=b2e8ea485659485f92e729741880d447, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=15fbda6263b44352b3ac560372bef725) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:57.851726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1035750-651c-4f1f-aa2a-4dd9b4b28d1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:57.853485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1035750-651c-4f1f-aa2a-4dd9b4b28d1f None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:57.860750 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 442/876] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:34:57 2022] GET /identity/v3/role_assignments?user.id=15fbda6263b44352b3ac560372bef725&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=b2e8ea485659485f92e729741880d447 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:58.610701 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9370fb2-204e-41e8-919b-9c9b17812bed None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:58.611092 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9370fb2-204e-41e8-919b-9c9b17812bed None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:58.611269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9370fb2-204e-41e8-919b-9c9b17812bed None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:58.612839 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 435/877] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:34:58.618557 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9e33f-dd60-4902-8bd5-041529cbc87d None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:58.619022 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9e33f-dd60-4902-8bd5-041529cbc87d None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:58.619108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9e33f-dd60-4902-8bd5-041529cbc87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:58.638398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-c9b9e33f-dd60-4902-8bd5-041529cbc87d None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:58.639517 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c9b9e33f-dd60-4902-8bd5-041529cbc87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:58.711813 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 443/878] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:58 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:34:58.992367 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9370fb2-204e-41e8-919b-9c9b17812bed None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:59.056982 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:59.098974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9370fb2-204e-41e8-919b-9c9b17812bed None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:59.135260 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34533369-5a96-4805-9e71-0730b3071264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:59.135922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34533369-5a96-4805-9e71-0730b3071264 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:59.136199 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34533369-5a96-4805-9e71-0730b3071264 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:59.136473 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34533369-5a96-4805-9e71-0730b3071264 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:59.137056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34533369-5a96-4805-9e71-0730b3071264 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:59.138419 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34533369-5a96-4805-9e71-0730b3071264 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:59.148428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-34533369-5a96-4805-9e71-0730b3071264 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 19:34:59.148428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:59.148428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:34:59.148428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:34:59.148428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:34:59.148428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:34:59.148428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:34:59.148428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:34:59.148428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 19:34:59.148428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:59.148428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:34:59.148428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:59.148428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:59.148428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:59.148428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:59.148428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:59.149355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:59.149355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:59.149355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:59.149355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:59.149355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:59.149355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:59.149355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:59.149355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:34:59.149355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:34:59.149355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:34:59.149355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:34:59.149355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:59.149355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:59.149355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:59.149355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:59.149355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:59.149355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:59.150258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:59.150258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:59.150258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:59.150258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:59.150258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:59.150258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:59.150258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:59.150258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:59.150258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:59.150258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:59.150258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:34:59.150258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:34:59.150258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 19:34:59.150258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:34:59.150258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 436/879] 10.222.0.15 () {56 vars in 1132 bytes} [Wed Sep 14 19:34:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:34:59.155981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9e33f-dd60-4902-8bd5-041529cbc87d None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:59.201402 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:59.267386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9e33f-dd60-4902-8bd5-041529cbc87d None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:59.303602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa80ee8-3d79-4da4-99b6-748526523480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:59.304230 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa80ee8-3d79-4da4-99b6-748526523480 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:59.304512 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa80ee8-3d79-4da4-99b6-748526523480 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:59.304788 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa80ee8-3d79-4da4-99b6-748526523480 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:59.305421 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa80ee8-3d79-4da4-99b6-748526523480 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:59.305730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa80ee8-3d79-4da4-99b6-748526523480 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:59.307099 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa80ee8-3d79-4da4-99b6-748526523480 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:59.312363 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 444/880] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Sep 14 19:34:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:59.317664 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34533369-5a96-4805-9e71-0730b3071264 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:59.352617 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac450e-21a7-4454-a537-013256802886 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:59.352942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac450e-21a7-4454-a537-013256802886 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:59.353163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac450e-21a7-4454-a537-013256802886 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:59.354737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 445/881] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:34:59.359567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ab9f7-81c2-4037-9b72-fc8b7748ba64 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:59.359864 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ab9f7-81c2-4037-9b72-fc8b7748ba64 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:59.360134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ab9f7-81c2-4037-9b72-fc8b7748ba64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:59.387004 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-ab7ab9f7-81c2-4037-9b72-fc8b7748ba64 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:34:59.388227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ab7ab9f7-81c2-4037-9b72-fc8b7748ba64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:34:59.449482 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34533369-5a96-4805-9e71-0730b3071264 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:59.471637 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 446/882] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:34:59 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 19:34:59.479866 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:59.487692 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97154e71-9542-43af-af0b-c99eabce08f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:59.488313 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97154e71-9542-43af-af0b-c99eabce08f4 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:59.488589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97154e71-9542-43af-af0b-c99eabce08f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:59.488860 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97154e71-9542-43af-af0b-c99eabce08f4 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:59.489491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97154e71-9542-43af-af0b-c99eabce08f4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:59.489792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97154e71-9542-43af-af0b-c99eabce08f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:59.491274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97154e71-9542-43af-af0b-c99eabce08f4 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:59.496504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 437/883] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Sep 14 19:34:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:59.502166 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ab9f7-81c2-4037-9b72-fc8b7748ba64 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:59.543234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:59.623316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ab9f7-81c2-4037-9b72-fc8b7748ba64 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:59.659230 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf42351-8a39-461a-989d-569d5894c3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:59.659884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf42351-8a39-461a-989d-569d5894c3e3 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:59.660162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf42351-8a39-461a-989d-569d5894c3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:59.660435 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf42351-8a39-461a-989d-569d5894c3e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:59.661133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf42351-8a39-461a-989d-569d5894c3e3 None admin] RBAC: Adding query filter params (interface=public, service_id=f48c519ba06240ebab8e462a83d25ca7, region_id=RegionOne) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:34:59.661437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf42351-8a39-461a-989d-569d5894c3e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:59.663296 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf42351-8a39-461a-989d-569d5894c3e3 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:59.671064 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 447/884] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Sep 14 19:34:59 2022] GET /identity/v3/endpoints?service_id=f48c519ba06240ebab8e462a83d25ca7&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:34:59.676737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97154e71-9542-43af-af0b-c99eabce08f4 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:59.756473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf42351-8a39-461a-989d-569d5894c3e3 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:34:59.786680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97154e71-9542-43af-af0b-c99eabce08f4 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:59.829338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af099a23-28a0-435d-8195-618ba6c287a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:59.829880 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af099a23-28a0-435d-8195-618ba6c287a9 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:59.830151 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af099a23-28a0-435d-8195-618ba6c287a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:59.830463 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af099a23-28a0-435d-8195-618ba6c287a9 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:59.831159 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af099a23-28a0-435d-8195-618ba6c287a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:59.832559 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af099a23-28a0-435d-8195-618ba6c287a9 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:59.844460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 438/885] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Sep 14 19:34:59 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:34:59.880141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:34:59.884802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf42351-8a39-461a-989d-569d5894c3e3 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:34:59.924705 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd031f-fa64-4450-ba6a-0ebbc1c20aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:34:59.925356 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd031f-fa64-4450-ba6a-0ebbc1c20aa6 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:34:59.925634 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd031f-fa64-4450-ba6a-0ebbc1c20aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:34:59.925899 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd031f-fa64-4450-ba6a-0ebbc1c20aa6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:34:59.926489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd031f-fa64-4450-ba6a-0ebbc1c20aa6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:34:59.928137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd031f-fa64-4450-ba6a-0ebbc1c20aa6 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:34:59.938069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-cffd031f-fa64-4450-ba6a-0ebbc1c20aa6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 19:34:59.938069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:59.938069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:34:59.938069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:34:59.938069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:34:59.938069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:34:59.938069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:34:59.938069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:34:59.938069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 19:34:59.938069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:59.938069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:34:59.938069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:59.938069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:34:59.938069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:34:59.938069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:34:59.938069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:34:59.938069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:34:59.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:34:59.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:34:59.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:34:59.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:34:59.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:34:59.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:34:59.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:34:59.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:34:59.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:34:59.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:34:59.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:34:59.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:34:59.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:34:59.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:34:59.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:34:59.940398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:34:59.942382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:34:59.942382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:34:59.942382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:34:59.942382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:34:59.942382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:34:59.942382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:34:59.942382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:34:59.942382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:34:59.942382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:34:59.942382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:34:59.942382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:34:59.942382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:34:59.942382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 19:34:59.942382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:34:59.942382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 448/886] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:34:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:34:59.948687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af099a23-28a0-435d-8195-618ba6c287a9 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:00.019025 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:00.073054 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af099a23-28a0-435d-8195-618ba6c287a9 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:00.114768 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360248ce-7760-4a18-8785-8a4f20661ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:00.115811 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360248ce-7760-4a18-8785-8a4f20661ee8 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:00.116086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360248ce-7760-4a18-8785-8a4f20661ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:00.116361 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360248ce-7760-4a18-8785-8a4f20661ee8 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:00.117001 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360248ce-7760-4a18-8785-8a4f20661ee8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:00.117302 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360248ce-7760-4a18-8785-8a4f20661ee8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:00.118780 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360248ce-7760-4a18-8785-8a4f20661ee8 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:00.124488 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 439/887] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:34:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:00.130179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd031f-fa64-4450-ba6a-0ebbc1c20aa6 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:00.171590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b98349-b260-489e-b2ba-2361b68a0f8a None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:00.171590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b98349-b260-489e-b2ba-2361b68a0f8a None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:00.171590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b98349-b260-489e-b2ba-2361b68a0f8a None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:00.171937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 440/888] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:35:00.176904 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2eb4e-f820-4b43-a102-e4d80318a447 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:00.177183 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2eb4e-f820-4b43-a102-e4d80318a447 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:00.177456 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2eb4e-f820-4b43-a102-e4d80318a447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:00.203121 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-aec2eb4e-f820-4b43-a102-e4d80318a447 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:00.205155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-aec2eb4e-f820-4b43-a102-e4d80318a447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:00.237778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd031f-fa64-4450-ba6a-0ebbc1c20aa6 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:00.273048 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0312694-22df-40f6-842a-cc370c924e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:00.273656 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0312694-22df-40f6-842a-cc370c924e82 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:00.273934 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0312694-22df-40f6-842a-cc370c924e82 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:00.274207 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0312694-22df-40f6-842a-cc370c924e82 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:00.274860 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0312694-22df-40f6-842a-cc370c924e82 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:00.275161 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0312694-22df-40f6-842a-cc370c924e82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:00.275471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 441/889] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 19:35:00.276556 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0312694-22df-40f6-842a-cc370c924e82 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:00.281690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 449/890] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:35:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:00.284869 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c0dc2-4d5c-4b3f-8ad2-a35c629a7222 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:00.285146 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c0dc2-4d5c-4b3f-8ad2-a35c629a7222 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:00.285414 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c0dc2-4d5c-4b3f-8ad2-a35c629a7222 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:00.288015 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0312694-22df-40f6-842a-cc370c924e82 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:00.288347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 442/891] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:00.292408 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88c081-7ccc-492a-8364-2e4faf95786b None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:00.292754 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88c081-7ccc-492a-8364-2e4faf95786b None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:00.293131 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88c081-7ccc-492a-8364-2e4faf95786b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:00.314357 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-6d88c081-7ccc-492a-8364-2e4faf95786b None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:00.315571 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-6d88c081-7ccc-492a-8364-2e4faf95786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:00.325197 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:00.375708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:00.415502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0312694-22df-40f6-842a-cc370c924e82 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:00.424245 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 443/892] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 19:35:00.451193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70456ce3-ed73-4893-9a33-618d1d282e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:00.451839 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70456ce3-ed73-4893-9a33-618d1d282e6e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:00.452116 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70456ce3-ed73-4893-9a33-618d1d282e6e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:00.452389 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70456ce3-ed73-4893-9a33-618d1d282e6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:00.453088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70456ce3-ed73-4893-9a33-618d1d282e6e None admin] RBAC: Adding query filter params (interface=public, service_id=bd5dfac41c1d45fba96b05e19c083c32, region_id=RegionOne) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:00.453397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70456ce3-ed73-4893-9a33-618d1d282e6e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:00.454803 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70456ce3-ed73-4893-9a33-618d1d282e6e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:00.460939 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 450/893] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Sep 14 19:35:00 2022] GET /identity/v3/endpoints?service_id=bd5dfac41c1d45fba96b05e19c083c32&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:00.466552 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88c081-7ccc-492a-8364-2e4faf95786b None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:00.544444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70456ce3-ed73-4893-9a33-618d1d282e6e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:00.582770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88c081-7ccc-492a-8364-2e4faf95786b None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:00.632568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699882c-29ee-4140-b589-b2678581306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:00.633785 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699882c-29ee-4140-b589-b2678581306d None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:00.634665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699882c-29ee-4140-b589-b2678581306d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:00.635179 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699882c-29ee-4140-b589-b2678581306d None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:00.636034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699882c-29ee-4140-b589-b2678581306d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:00.638163 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699882c-29ee-4140-b589-b2678581306d None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:00.641163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:00.648656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 444/894] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Sep 14 19:35:00 2022] GET /identity/v3/services => generated 1268 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:35:00.657523 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70456ce3-ed73-4893-9a33-618d1d282e6e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:00.697979 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b160c19-eba1-42b6-8e3e-3fd406aacf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:00.698625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b160c19-eba1-42b6-8e3e-3fd406aacf82 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:00.698901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b160c19-eba1-42b6-8e3e-3fd406aacf82 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:00.699169 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b160c19-eba1-42b6-8e3e-3fd406aacf82 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:00.699790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b160c19-eba1-42b6-8e3e-3fd406aacf82 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:00.701158 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b160c19-eba1-42b6-8e3e-3fd406aacf82 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:00.706279 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699882c-29ee-4140-b589-b2678581306d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:00.711108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-0b160c19-eba1-42b6-8e3e-3fd406aacf82 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 19:35:00.711108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:00.711108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:35:00.711108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:35:00.711108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:35:00.711108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:35:00.711108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:35:00.711108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:00.711108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 19:35:00.711108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:00.711108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:35:00.711108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:00.711108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:00.711108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:00.711108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:00.711108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:00.711108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:00.712267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:00.712267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:00.712267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:00.712267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:00.712267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:00.712267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:00.712267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:35:00.712267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:35:00.712267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:35:00.712267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:35:00.712267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:00.712267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:00.712267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:00.712267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:00.712267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:00.712267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:00.713090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:00.713090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:00.713090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:00.713090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:00.713090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:00.713090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:00.713090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:00.713090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:00.713090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:00.713090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:00.713090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:35:00.713090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:00.713090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 19:35:00.713090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:00.713090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 451/895] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Sep 14 19:35:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:35:00.718611 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b160c19-eba1-42b6-8e3e-3fd406aacf82 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:00.761644 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:00.830105 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b160c19-eba1-42b6-8e3e-3fd406aacf82 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:00.831913 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699882c-29ee-4140-b589-b2678581306d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:00.881606 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a12fe-7589-4803-b1f4-8fb9da37154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:00.882221 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a12fe-7589-4803-b1f4-8fb9da37154a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:00.882496 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a12fe-7589-4803-b1f4-8fb9da37154a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:00.882832 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a12fe-7589-4803-b1f4-8fb9da37154a None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:00.883397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a12fe-7589-4803-b1f4-8fb9da37154a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:00.883732 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a12fe-7589-4803-b1f4-8fb9da37154a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:00.884256 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d68b0b-4b81-4273-a9a6-6b0c34880790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:00.884898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d68b0b-4b81-4273-a9a6-6b0c34880790 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:00.885089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a12fe-7589-4803-b1f4-8fb9da37154a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:00.885182 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d68b0b-4b81-4273-a9a6-6b0c34880790 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:00.885438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d68b0b-4b81-4273-a9a6-6b0c34880790 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:00.891676 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 452/896] 10.222.0.15 () {56 vars in 1122 bytes} [Wed Sep 14 19:35:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:00.897490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d68b0b-4b81-4273-a9a6-6b0c34880790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:35:00.898799 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a12fe-7589-4803-b1f4-8fb9da37154a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:00.902759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-84d68b0b-4b81-4273-a9a6-6b0c34880790 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 19:35:00.902759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:00.902759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:00.902759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:00.902759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:00.902759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:00.902759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:00.902759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:00.902759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:00.902759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:00.902759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:00.902759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:00.902759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:35:00.902759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:35:00.902759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:35:00.902759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:35:00.903722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:35:00.903722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:35:00.903722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:35:00.903722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:35:00.903722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:00.903722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:00.903722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:00.903722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:00.903722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:00.903722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:00.903722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:00.903722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:00.903722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:00.903722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:00.903722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:00.903722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:00.904568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:00.904568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:00.904568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:00.904568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:00.904568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:35:00.904568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:35:00.904568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:35:00.904568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:35:00.904568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:35:00.904568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:35:00.904568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 19:35:00.904568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:00.910414 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 445/897] 10.222.0.15 () {56 vars in 1120 bytes} [Wed Sep 14 19:35:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:35:00.911603 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d68b0b-4b81-4273-a9a6-6b0c34880790 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:00.923683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:01.013122 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a12fe-7589-4803-b1f4-8fb9da37154a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:01.050830 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d68b0b-4b81-4273-a9a6-6b0c34880790 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:01.052314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14260d15-e6e5-4ae9-b56f-fff3638b402a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:01.053138 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:01.053973 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14260d15-e6e5-4ae9-b56f-fff3638b402a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:01.054123 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14260d15-e6e5-4ae9-b56f-fff3638b402a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:01.054299 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14260d15-e6e5-4ae9-b56f-fff3638b402a None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:01.056261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14260d15-e6e5-4ae9-b56f-fff3638b402a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:01.056261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14260d15-e6e5-4ae9-b56f-fff3638b402a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:01.057318 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14260d15-e6e5-4ae9-b56f-fff3638b402a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:01.067334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 453/898] 10.222.0.15 () {56 vars in 1122 bytes} [Wed Sep 14 19:35:00 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:01.095381 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3f9b3-635b-46e0-b123-345b15022e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:01.096310 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3f9b3-635b-46e0-b123-345b15022e66 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:01.096741 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3f9b3-635b-46e0-b123-345b15022e66 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:01.097163 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3f9b3-635b-46e0-b123-345b15022e66 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:01.098084 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3f9b3-635b-46e0-b123-345b15022e66 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:01.098539 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3f9b3-635b-46e0-b123-345b15022e66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:01.100281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3f9b3-635b-46e0-b123-345b15022e66 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:01.110794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 446/899] 10.222.0.15 () {56 vars in 1115 bytes} [Wed Sep 14 19:35:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:01.117118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14260d15-e6e5-4ae9-b56f-fff3638b402a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:01.229014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:01.249828 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14260d15-e6e5-4ae9-b56f-fff3638b402a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:01.298119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545431a2-98d0-4fdd-bad4-ffcc3e7559d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:01.300595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545431a2-98d0-4fdd-bad4-ffcc3e7559d5 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:01.300894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545431a2-98d0-4fdd-bad4-ffcc3e7559d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:01.301211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545431a2-98d0-4fdd-bad4-ffcc3e7559d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:01.315909 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545431a2-98d0-4fdd-bad4-ffcc3e7559d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:01.318556 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545431a2-98d0-4fdd-bad4-ffcc3e7559d5 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:01.337450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-545431a2-98d0-4fdd-bad4-ffcc3e7559d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:01.337450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:01.337450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:01.337450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:01.337450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:01.337450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:01.337450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:01.337450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:01.337450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:01.337450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:01.337450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:01.337450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:01.337450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:35:01.337450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:35:01.337450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:35:01.337450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:35:01.338450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:01.338450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:01.338450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:01.338450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:01.338450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:01.338450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:01.338450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:01.338450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:01.338450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:01.338450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:01.338450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:01.338450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:01.338450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:01.338450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:01.338450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:01.338450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:01.338450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:35:01.339325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:35:01.339325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:01.339325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:01.340157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 454/900] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:01.348311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3f9b3-635b-46e0-b123-345b15022e66 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:01.507017 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3f9b3-635b-46e0-b123-345b15022e66 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:01.555821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b490fd-a7eb-42dc-a3e9-875b8343ccaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:01.557242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b490fd-a7eb-42dc-a3e9-875b8343ccaf None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:01.557726 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b490fd-a7eb-42dc-a3e9-875b8343ccaf None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:01.558285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b490fd-a7eb-42dc-a3e9-875b8343ccaf None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:01.559533 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b490fd-a7eb-42dc-a3e9-875b8343ccaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:01.560302 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b490fd-a7eb-42dc-a3e9-875b8343ccaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:01.562730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b490fd-a7eb-42dc-a3e9-875b8343ccaf None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:01.581204 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 447/901] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:01.587940 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545431a2-98d0-4fdd-bad4-ffcc3e7559d5 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:01.730965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545431a2-98d0-4fdd-bad4-ffcc3e7559d5 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:01.777036 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda2676-42cc-4bd3-bbc0-69f615aab229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:01.781867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda2676-42cc-4bd3-bbc0-69f615aab229 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:01.781867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda2676-42cc-4bd3-bbc0-69f615aab229 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:01.781867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda2676-42cc-4bd3-bbc0-69f615aab229 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:01.786979 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda2676-42cc-4bd3-bbc0-69f615aab229 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:01.789072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda2676-42cc-4bd3-bbc0-69f615aab229 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:01.795725 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:01.810460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-3cda2676-42cc-4bd3-bbc0-69f615aab229 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 19:35:01.810460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:01.810460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:01.810460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:01.810460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:01.810460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:01.810460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:01.810460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:01.810460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:01.810460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:01.810460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:01.810460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:01.810460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:35:01.810460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:35:01.810460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:35:01.810460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:35:01.813540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:01.813540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:01.813540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:35:01.813540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:35:01.813540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:35:01.813540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:35:01.813540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:01.813540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:01.813540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:01.813540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:01.813540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:01.813540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:01.813540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:01.813540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:01.813540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:01.813540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:01.813540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:01.813540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:01.814594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:01.814594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:01.814594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:35:01.814594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:35:01.814594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:35:01.814594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:35:01.814594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:35:01.814594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:35:01.814594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 19:35:01.814594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:01.814594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 455/902] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Sep 14 19:35:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:01.817068 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b490fd-a7eb-42dc-a3e9-875b8343ccaf None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:01.861375 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:01.982853 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b490fd-a7eb-42dc-a3e9-875b8343ccaf None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:02.033163 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926fd217-f8af-4794-a621-49fc19c7b6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:02.033712 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fd217-f8af-4794-a621-49fc19c7b6cf None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:02.033994 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fd217-f8af-4794-a621-49fc19c7b6cf None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:02.034282 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fd217-f8af-4794-a621-49fc19c7b6cf None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:02.035340 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fd217-f8af-4794-a621-49fc19c7b6cf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:02.035687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fd217-f8af-4794-a621-49fc19c7b6cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:02.040437 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fd217-f8af-4794-a621-49fc19c7b6cf None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:02.070506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 448/903] 10.222.0.15 () {56 vars in 1149 bytes} [Wed Sep 14 19:35:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:02.071396 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda2676-42cc-4bd3-bbc0-69f615aab229 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:02.200076 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda2676-42cc-4bd3-bbc0-69f615aab229 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:02.234434 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76871da-35e1-4278-83d7-0a948474f629 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:02.234434 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76871da-35e1-4278-83d7-0a948474f629 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:02.234434 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76871da-35e1-4278-83d7-0a948474f629 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:02.237592 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 449/904] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:02.245427 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764f176-8a4b-4688-9811-364a78afc5fb None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:02.245427 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764f176-8a4b-4688-9811-364a78afc5fb None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:02.245832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764f176-8a4b-4688-9811-364a78afc5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:02.250124 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdb5e5-512b-4dd8-b3bd-65deaa28bc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:02.250957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdb5e5-512b-4dd8-b3bd-65deaa28bc66 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:02.251400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdb5e5-512b-4dd8-b3bd-65deaa28bc66 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:02.251847 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdb5e5-512b-4dd8-b3bd-65deaa28bc66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:02.268989 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-0764f176-8a4b-4688-9811-364a78afc5fb None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:02.270599 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0764f176-8a4b-4688-9811-364a78afc5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:02.318998 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:02.326019 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdb5e5-512b-4dd8-b3bd-65deaa28bc66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:02.327732 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdb5e5-512b-4dd8-b3bd-65deaa28bc66 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:02.371697 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 450/905] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 19:35:02.444926 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 456/906] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:35:02 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 19:35:02.452678 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764f176-8a4b-4688-9811-364a78afc5fb None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:02.468777 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:02.566137 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764f176-8a4b-4688-9811-364a78afc5fb None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:02.605478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20491a42-6922-4fb8-935f-5cb1c059a97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:02.606415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20491a42-6922-4fb8-935f-5cb1c059a97a None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:02.606879 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20491a42-6922-4fb8-935f-5cb1c059a97a None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:02.607359 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20491a42-6922-4fb8-935f-5cb1c059a97a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:02.618238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20491a42-6922-4fb8-935f-5cb1c059a97a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:02.619911 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20491a42-6922-4fb8-935f-5cb1c059a97a None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:02.634935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-20491a42-6922-4fb8-935f-5cb1c059a97a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:02.634935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:02.634935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:02.634935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:02.634935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:02.634935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:02.634935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:02.634935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:02.634935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:02.634935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:02.634935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:02.634935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:02.634935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:35:02.634935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:35:02.634935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:35:02.634935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:35:02.635929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:02.635929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:02.635929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:02.635929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:02.635929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:02.635929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:02.635929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:02.635929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:02.635929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:02.635929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:02.635929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:02.635929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:02.635929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:02.635929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:02.635929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:02.635929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:02.635929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:35:02.636821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:35:02.636821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:02.636821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:02.638609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 451/907] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:02.644462 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdb5e5-512b-4dd8-b3bd-65deaa28bc66 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:02.666459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20491a42-6922-4fb8-935f-5cb1c059a97a None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:02.730158 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:02.769136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdb5e5-512b-4dd8-b3bd-65deaa28bc66 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:02.769667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20491a42-6922-4fb8-935f-5cb1c059a97a None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:02.784327 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:02.810130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa7ec2-9748-4f82-888a-1542499336e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:02.810751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa7ec2-9748-4f82-888a-1542499336e2 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:02.811029 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa7ec2-9748-4f82-888a-1542499336e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:02.811304 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa7ec2-9748-4f82-888a-1542499336e2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:02.811921 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa7ec2-9748-4f82-888a-1542499336e2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:02.813284 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa7ec2-9748-4f82-888a-1542499336e2 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:02.819181 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894f132-aea6-4dde-818a-8afeffd86682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:02.820082 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894f132-aea6-4dde-818a-8afeffd86682 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:02.820547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894f132-aea6-4dde-818a-8afeffd86682 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:02.821043 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894f132-aea6-4dde-818a-8afeffd86682 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:02.821854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894f132-aea6-4dde-818a-8afeffd86682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:02.822328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894f132-aea6-4dde-818a-8afeffd86682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:02.825130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-28fa7ec2-9748-4f82-888a-1542499336e2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 19:35:02.825130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:02.825130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:35:02.825130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:35:02.825130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:35:02.825130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:35:02.825130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:35:02.825130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:02.825130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 19:35:02.825130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:02.825130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:35:02.825130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:02.825130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:02.825130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:02.825130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:02.825130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:02.826047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:02.826047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:02.826047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:02.826047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:02.826047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:02.826047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:02.826047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:02.826047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:35:02.826047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:35:02.826047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:35:02.826047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:35:02.826047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:02.826047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:02.826047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:02.826047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:02.826047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:02.826047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:02.826970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:02.826970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:02.826970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:02.826970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:02.826970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:02.826970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:02.826970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:02.826970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:02.826970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:02.826970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:02.826970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:35:02.826970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:02.826970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 19:35:02.826970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:02.827830 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894f132-aea6-4dde-818a-8afeffd86682 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:02.828000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 452/908] 10.222.0.15 () {56 vars in 1132 bytes} [Wed Sep 14 19:35:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:35:02.830455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa7ec2-9748-4f82-888a-1542499336e2 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:02.844831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 457/909] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:02.846124 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894f132-aea6-4dde-818a-8afeffd86682 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:02.972015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa7ec2-9748-4f82-888a-1542499336e2 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:02.986737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894f132-aea6-4dde-818a-8afeffd86682 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:03.006754 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:03.018789 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0d7c0-aa6a-4ecc-aabb-56a69dd4c694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:03.019970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0d7c0-aa6a-4ecc-aabb-56a69dd4c694 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:03.020789 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0d7c0-aa6a-4ecc-aabb-56a69dd4c694 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:03.021496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0d7c0-aa6a-4ecc-aabb-56a69dd4c694 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:03.023299 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0d7c0-aa6a-4ecc-aabb-56a69dd4c694 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:03.023844 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0d7c0-aa6a-4ecc-aabb-56a69dd4c694 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:03.026039 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0d7c0-aa6a-4ecc-aabb-56a69dd4c694 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:03.029067 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c37a3-5cb5-45cd-8e62-37b75e97a048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:03.029849 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c37a3-5cb5-45cd-8e62-37b75e97a048 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:03.030200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c37a3-5cb5-45cd-8e62-37b75e97a048 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:03.030548 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c37a3-5cb5-45cd-8e62-37b75e97a048 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:03.036797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 453/910] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Sep 14 19:35:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:03.039321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0d7c0-aa6a-4ecc-aabb-56a69dd4c694 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:03.043978 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c37a3-5cb5-45cd-8e62-37b75e97a048 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:03.045495 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c37a3-5cb5-45cd-8e62-37b75e97a048 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:03.065570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-762c37a3-5cb5-45cd-8e62-37b75e97a048 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:35:03.065570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:03.065570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:03.065570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:03.065570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:03.065570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:03.065570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:03.065570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:03.065570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:03.065570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:03.065570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:03.065570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:03.065570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:35:03.065570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:35:03.065570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:35:03.066549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:35:03.066549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:03.066549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:03.066549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:03.066549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:03.066549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:03.066549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:03.066549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:03.066549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:03.066549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:03.066549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:03.066549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:03.066549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:03.066549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:03.066549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:03.066549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:03.066549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:03.067461 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:35:03.067461 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:35:03.067461 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:35:03.067461 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:35:03.067461 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:35:03.067461 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:35:03.067461 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:35:03.067461 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:03.070564 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 458/911] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:35:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:35:03.076604 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c37a3-5cb5-45cd-8e62-37b75e97a048 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:03.098401 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:03.160400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0d7c0-aa6a-4ecc-aabb-56a69dd4c694 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:03.199916 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc16d5-a1b6-48d3-8806-d9a08eea0d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:03.200713 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc16d5-a1b6-48d3-8806-d9a08eea0d2a None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:03.201097 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc16d5-a1b6-48d3-8806-d9a08eea0d2a None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:03.201690 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc16d5-a1b6-48d3-8806-d9a08eea0d2a None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:03.202252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc16d5-a1b6-48d3-8806-d9a08eea0d2a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:03.202966 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc16d5-a1b6-48d3-8806-d9a08eea0d2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:03.205387 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc16d5-a1b6-48d3-8806-d9a08eea0d2a None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:03.220114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 454/912] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Sep 14 19:35:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:03.221394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c37a3-5cb5-45cd-8e62-37b75e97a048 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:03.221691 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc16d5-a1b6-48d3-8806-d9a08eea0d2a None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:03.271076 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba043c-03a7-4e88-b31e-2b4cbfe8f581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:03.272177 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba043c-03a7-4e88-b31e-2b4cbfe8f581 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:03.272470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba043c-03a7-4e88-b31e-2b4cbfe8f581 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:03.272767 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba043c-03a7-4e88-b31e-2b4cbfe8f581 None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:03.273511 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba043c-03a7-4e88-b31e-2b4cbfe8f581 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:03.273820 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba043c-03a7-4e88-b31e-2b4cbfe8f581 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:03.275252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba043c-03a7-4e88-b31e-2b4cbfe8f581 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:03.289589 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 459/913] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:35:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:03.290922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e071ea3-5501-4d04-a880-4801c500afd7 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:03.291206 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e071ea3-5501-4d04-a880-4801c500afd7 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:03.291480 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e071ea3-5501-4d04-a880-4801c500afd7 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:03.292698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 460/914] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:03.295767 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e071ea3-5501-4d04-a880-4801c500afd7 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:03.298681 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:03.353545 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc16d5-a1b6-48d3-8806-d9a08eea0d2a None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:03.387709 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:03.393374 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66f949-bdac-448a-bf72-d603bac864d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:03.394047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66f949-bdac-448a-bf72-d603bac864d4 None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:03.394343 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66f949-bdac-448a-bf72-d603bac864d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:03.394627 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66f949-bdac-448a-bf72-d603bac864d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:03.395279 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66f949-bdac-448a-bf72-d603bac864d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:03.396724 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66f949-bdac-448a-bf72-d603bac864d4 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:03.411425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e071ea3-5501-4d04-a880-4801c500afd7 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:03.448117 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0982b7-1e93-494f-9b58-bc9c347e394a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:03.448729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0982b7-1e93-494f-9b58-bc9c347e394a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:03.449012 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0982b7-1e93-494f-9b58-bc9c347e394a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:03.449293 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0982b7-1e93-494f-9b58-bc9c347e394a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:03.450017 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0982b7-1e93-494f-9b58-bc9c347e394a None admin] RBAC: Adding query filter params (role.id=bbffc2c569f64cd89c9598d29c9aa6fc, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=15fbda6263b44352b3ac560372bef725) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:03.450332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0982b7-1e93-494f-9b58-bc9c347e394a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:03.451836 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0982b7-1e93-494f-9b58-bc9c347e394a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:03.457020 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 461/915] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:35:03 2022] GET /identity/v3/role_assignments?user.id=15fbda6263b44352b3ac560372bef725&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=bbffc2c569f64cd89c9598d29c9aa6fc => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:03.458407 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058e717-8d54-4320-9a3e-3477aa8f58a6 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:03.458695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058e717-8d54-4320-9a3e-3477aa8f58a6 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:03.458971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058e717-8d54-4320-9a3e-3477aa8f58a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:03.478921 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-e058e717-8d54-4320-9a3e-3477aa8f58a6 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:03.480218 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-e058e717-8d54-4320-9a3e-3477aa8f58a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:03.487751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 455/916] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:35:03 2022] POST /identity/v3/endpoints => generated 347 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:35:03.487751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3154b2-dca3-48fa-91f1-af7cdfb0625d None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:03.487751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3154b2-dca3-48fa-91f1-af7cdfb0625d None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:03.487751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3154b2-dca3-48fa-91f1-af7cdfb0625d None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:03.487751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 456/917] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:03.494517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b33cf8-69eb-4d6e-877c-e6efa0cab6e7 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:03.494517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b33cf8-69eb-4d6e-877c-e6efa0cab6e7 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:03.494517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b33cf8-69eb-4d6e-877c-e6efa0cab6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:03.518806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-d6b33cf8-69eb-4d6e-877c-e6efa0cab6e7 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:03.520386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d6b33cf8-69eb-4d6e-877c-e6efa0cab6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:03.607760 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 462/918] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:03.638628 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 457/919] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:03.876144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058e717-8d54-4320-9a3e-3477aa8f58a6 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:03.909727 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b33cf8-69eb-4d6e-877c-e6efa0cab6e7 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:03.955394 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:03.967113 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:04.006563 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058e717-8d54-4320-9a3e-3477aa8f58a6 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:04.025290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b33cf8-69eb-4d6e-877c-e6efa0cab6e7 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:04.050618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d798729-2b55-404d-ae67-699b7641e340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:04.052055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d798729-2b55-404d-ae67-699b7641e340 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:04.052646 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d798729-2b55-404d-ae67-699b7641e340 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:04.054206 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d798729-2b55-404d-ae67-699b7641e340 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:04.055347 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d798729-2b55-404d-ae67-699b7641e340 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:04.057377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d798729-2b55-404d-ae67-699b7641e340 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:04.063779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d6ffd-681d-4ec7-b434-de2c7366ba11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:04.064491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d6ffd-681d-4ec7-b434-de2c7366ba11 None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:04.064831 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d6ffd-681d-4ec7-b434-de2c7366ba11 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:04.065167 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d6ffd-681d-4ec7-b434-de2c7366ba11 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:04.065964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d6ffd-681d-4ec7-b434-de2c7366ba11 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:04.067385 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d6ffd-681d-4ec7-b434-de2c7366ba11 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:04.069400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-9d798729-2b55-404d-ae67-699b7641e340 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 19:35:04.069400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:04.069400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:35:04.069400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:35:04.069400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:35:04.069400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:35:04.069400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:35:04.069400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:04.069400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 19:35:04.069400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:04.069400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:35:04.069400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:04.069400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:04.069400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:04.069400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:04.069400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:04.069400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:04.070359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:04.070359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:04.070359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:04.070359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:04.070359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:04.070359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:04.070359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:35:04.070359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:35:04.070359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:35:04.070359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:35:04.070359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:04.070359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:04.070359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:04.070359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:04.070359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:04.070359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:04.071200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:04.071200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:04.071200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:04.071200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:04.071200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:04.071200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:04.071200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:04.071200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:04.071200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:04.071200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:04.071200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:35:04.071200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:04.071200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 19:35:04.071200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:04.074722 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 463/920] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:35:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:04.078436 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d798729-2b55-404d-ae67-699b7641e340 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:04.151730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 458/921] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Sep 14 19:35:03 2022] POST /identity/v3/services => generated 241 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:35:04.201022 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d798729-2b55-404d-ae67-699b7641e340 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:04.236032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:04.250194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373102d3-bdd4-483a-9f9a-a96718e701e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:04.251192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373102d3-bdd4-483a-9f9a-a96718e701e2 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:04.251664 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373102d3-bdd4-483a-9f9a-a96718e701e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:04.252170 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373102d3-bdd4-483a-9f9a-a96718e701e2 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:04.253019 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373102d3-bdd4-483a-9f9a-a96718e701e2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:04.253568 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373102d3-bdd4-483a-9f9a-a96718e701e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:04.255198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373102d3-bdd4-483a-9f9a-a96718e701e2 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:04.262316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 464/922] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:35:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:04.268029 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d6ffd-681d-4ec7-b434-de2c7366ba11 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:04.391655 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d6ffd-681d-4ec7-b434-de2c7366ba11 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:04.393811 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:04.431998 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18b048-6e35-422b-ace2-4fe71ab2eaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:04.432653 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18b048-6e35-422b-ace2-4fe71ab2eaa2 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:04.433191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18b048-6e35-422b-ace2-4fe71ab2eaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:04.433464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18b048-6e35-422b-ace2-4fe71ab2eaa2 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:04.434196 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18b048-6e35-422b-ace2-4fe71ab2eaa2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:04.434501 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18b048-6e35-422b-ace2-4fe71ab2eaa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:04.435892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18b048-6e35-422b-ace2-4fe71ab2eaa2 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:04.441673 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 459/923] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Sep 14 19:35:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:04.448867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373102d3-bdd4-483a-9f9a-a96718e701e2 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:04.558800 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373102d3-bdd4-483a-9f9a-a96718e701e2 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:04.593978 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b0624-8798-4b70-bf4f-d991b6b94a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:04.594595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b0624-8798-4b70-bf4f-d991b6b94a50 None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:04.594867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b0624-8798-4b70-bf4f-d991b6b94a50 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:04.595134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b0624-8798-4b70-bf4f-d991b6b94a50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:04.595838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b0624-8798-4b70-bf4f-d991b6b94a50 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:04.597193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b0624-8798-4b70-bf4f-d991b6b94a50 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:04.705284 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 465/924] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:35:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:35:05.690254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df5338-62de-4b63-b45b-7df207bd2772 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:05.690770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df5338-62de-4b63-b45b-7df207bd2772 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:05.690770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df5338-62de-4b63-b45b-7df207bd2772 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:05.692452 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 460/925] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:05.699034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fa596-d280-477c-a986-9ce50e68bc0b None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:05.699582 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fa596-d280-477c-a986-9ce50e68bc0b None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:05.699662 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fa596-d280-477c-a986-9ce50e68bc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:05.719283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-690fa596-d280-477c-a986-9ce50e68bc0b None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:05.720553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-690fa596-d280-477c-a986-9ce50e68bc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:05.765623 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:05.803722 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 466/926] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:05.839924 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ace15c-b7e9-40b9-9cb7-7a812d5a8519 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:05.840227 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ace15c-b7e9-40b9-9cb7-7a812d5a8519 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:05.840469 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ace15c-b7e9-40b9-9cb7-7a812d5a8519 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:05.842072 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 461/927] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:05.847274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4984b-a6ba-4089-8001-01210f639a61 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:05.847764 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4984b-a6ba-4089-8001-01210f639a61 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:05.848192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4984b-a6ba-4089-8001-01210f639a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:05.867957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-11b4984b-a6ba-4089-8001-01210f639a61 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:05.869397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-11b4984b-a6ba-4089-8001-01210f639a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:05.946503 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 467/928] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:06.084409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ace15c-b7e9-40b9-9cb7-7a812d5a8519 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:06.195697 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ace15c-b7e9-40b9-9cb7-7a812d5a8519 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:06.217975 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4984b-a6ba-4089-8001-01210f639a61 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:06.232240 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037eee3a-b8b1-4207-a831-ef3e95fd5032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:06.232878 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eee3a-b8b1-4207-a831-ef3e95fd5032 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:06.233153 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eee3a-b8b1-4207-a831-ef3e95fd5032 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:06.233422 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eee3a-b8b1-4207-a831-ef3e95fd5032 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:06.244574 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037eee3a-b8b1-4207-a831-ef3e95fd5032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:35:06.249881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-037eee3a-b8b1-4207-a831-ef3e95fd5032 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 19:35:06.249881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:06.249881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:06.249881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:06.249881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:06.249881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:06.249881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:06.249881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:06.249881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:06.249881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:06.249881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:06.249881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:06.249881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:35:06.249881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:35:06.249881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:35:06.249881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:35:06.250809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:35:06.250809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:35:06.250809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:35:06.250809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:35:06.250809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:06.250809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:06.250809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:06.250809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:06.250809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:06.250809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:06.250809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:06.250809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:06.250809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:06.250809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:06.250809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:06.250809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:06.251698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:06.251698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:06.251698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:06.251698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:06.251698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:35:06.251698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:35:06.251698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:35:06.251698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:35:06.251698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:35:06.251698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:35:06.251698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 19:35:06.251698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:06.251698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 462/929] 10.222.0.15 () {56 vars in 1120 bytes} [Wed Sep 14 19:35:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:06.258063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037eee3a-b8b1-4207-a831-ef3e95fd5032 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:06.295530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:06.339693 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4984b-a6ba-4089-8001-01210f639a61 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:06.341769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:06.395293 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2785681-19c0-48f2-82eb-b2255ee9e841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:06.396109 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2785681-19c0-48f2-82eb-b2255ee9e841 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:06.396484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2785681-19c0-48f2-82eb-b2255ee9e841 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:06.396866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2785681-19c0-48f2-82eb-b2255ee9e841 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:06.398064 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037eee3a-b8b1-4207-a831-ef3e95fd5032 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:06.398252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2785681-19c0-48f2-82eb-b2255ee9e841 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:06.399732 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2785681-19c0-48f2-82eb-b2255ee9e841 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:06.409452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-b2785681-19c0-48f2-82eb-b2255ee9e841 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 19:35:06.409452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:06.409452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:35:06.409452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:35:06.409452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:35:06.409452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:35:06.409452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:35:06.409452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:06.409452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 19:35:06.409452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:06.409452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:35:06.409452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:06.409452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:06.409452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:06.409452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:06.409452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:06.409452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:06.410708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:06.410708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:06.410708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:06.410708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:06.410708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:06.410708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:06.410708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:35:06.410708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:35:06.410708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:35:06.410708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:35:06.410708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:06.410708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:06.410708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:06.410708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:06.410708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:06.410708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:06.411778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:06.411778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:06.411778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:06.411778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:06.411778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:06.411778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:06.411778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:06.411778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:06.411778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:06.411778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:06.411778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:35:06.411778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:06.411778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 19:35:06.411778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:06.418622 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 468/930] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:35:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:06.419800 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2785681-19c0-48f2-82eb-b2255ee9e841 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:06.451264 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c161f2-69d4-4d6b-b18f-267eb811da4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:06.452510 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c161f2-69d4-4d6b-b18f-267eb811da4a None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:06.453390 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c161f2-69d4-4d6b-b18f-267eb811da4a None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:06.453903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c161f2-69d4-4d6b-b18f-267eb811da4a None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:06.455012 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c161f2-69d4-4d6b-b18f-267eb811da4a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:06.455765 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c161f2-69d4-4d6b-b18f-267eb811da4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:06.458068 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c161f2-69d4-4d6b-b18f-267eb811da4a None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:06.470567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 463/931] 10.222.0.15 () {56 vars in 1115 bytes} [Wed Sep 14 19:35:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:06.472392 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e6746-3945-4460-b15d-30ee81e1e99b None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:06.473380 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e6746-3945-4460-b15d-30ee81e1e99b None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:06.473867 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e6746-3945-4460-b15d-30ee81e1e99b None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:06.476828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 464/932] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:06.478105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e6746-3945-4460-b15d-30ee81e1e99b None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:06.531668 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2785681-19c0-48f2-82eb-b2255ee9e841 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:06.566621 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3eaee9-eaca-4b53-bd28-dbb160893afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:06.567491 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3eaee9-eaca-4b53-bd28-dbb160893afc None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:06.567967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3eaee9-eaca-4b53-bd28-dbb160893afc None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:06.568391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3eaee9-eaca-4b53-bd28-dbb160893afc None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:06.569214 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3eaee9-eaca-4b53-bd28-dbb160893afc None admin] RBAC: Adding query filter params (name=compute) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:06.569745 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3eaee9-eaca-4b53-bd28-dbb160893afc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:06.571273 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3eaee9-eaca-4b53-bd28-dbb160893afc None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:06.576376 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 469/933] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Sep 14 19:35:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:06.577770 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0b6e6-507a-4057-82c0-94d6a4ce3453 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:06.578217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0b6e6-507a-4057-82c0-94d6a4ce3453 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:06.578631 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0b6e6-507a-4057-82c0-94d6a4ce3453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:06.581127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:06.594690 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e6746-3945-4460-b15d-30ee81e1e99b None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:06.599774 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-34c0b6e6-507a-4057-82c0-94d6a4ce3453 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:06.601405 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-34c0b6e6-507a-4057-82c0-94d6a4ce3453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:06.628251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:06.634783 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a87350-b929-49dd-925a-d52d8eacb7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:06.635431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a87350-b929-49dd-925a-d52d8eacb7ec None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:06.635751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a87350-b929-49dd-925a-d52d8eacb7ec None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:06.636047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a87350-b929-49dd-925a-d52d8eacb7ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:06.646806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a87350-b929-49dd-925a-d52d8eacb7ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:06.648851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a87350-b929-49dd-925a-d52d8eacb7ec None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:06.663971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-84a87350-b929-49dd-925a-d52d8eacb7ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:06.663971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:06.663971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:06.663971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:06.663971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:06.663971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:06.663971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:06.663971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:06.663971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:06.663971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:06.663971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:06.663971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:06.663971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:35:06.663971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:35:06.663971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:35:06.663971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:35:06.664943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:06.664943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:06.664943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:06.664943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:06.664943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:06.664943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:06.664943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:06.664943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:06.664943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:06.664943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:06.664943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:06.664943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:06.664943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:06.664943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:06.664943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:06.664943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:06.664943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:35:06.665899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:35:06.665899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:06.665899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:06.665899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 465/934] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:06.666650 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a87350-b929-49dd-925a-d52d8eacb7ec None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:06.691423 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 470/935] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:06.691423 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0b6e6-507a-4057-82c0-94d6a4ce3453 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:06.808051 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a87350-b929-49dd-925a-d52d8eacb7ec None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:06.814662 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0b6e6-507a-4057-82c0-94d6a4ce3453 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:06.848172 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e75f1-42e2-4f0a-a1eb-99a318a76e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:06.848891 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e75f1-42e2-4f0a-a1eb-99a318a76e41 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:06.849236 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e75f1-42e2-4f0a-a1eb-99a318a76e41 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:06.849578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e75f1-42e2-4f0a-a1eb-99a318a76e41 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:06.850376 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e75f1-42e2-4f0a-a1eb-99a318a76e41 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:06.850681 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e75f1-42e2-4f0a-a1eb-99a318a76e41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:06.852274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e75f1-42e2-4f0a-a1eb-99a318a76e41 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:06.858977 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cde108-f8a1-4f16-8c70-989c27e8d955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:06.859852 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cde108-f8a1-4f16-8c70-989c27e8d955 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:06.860282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cde108-f8a1-4f16-8c70-989c27e8d955 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:06.860681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cde108-f8a1-4f16-8c70-989c27e8d955 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:06.861463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cde108-f8a1-4f16-8c70-989c27e8d955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:06.861895 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cde108-f8a1-4f16-8c70-989c27e8d955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:06.863430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cde108-f8a1-4f16-8c70-989c27e8d955 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:06.864017 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 466/936] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Sep 14 19:35:06 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:06.877847 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 471/937] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:06.884084 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e75f1-42e2-4f0a-a1eb-99a318a76e41 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:06.889348 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:06.925609 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dc760-cec3-4137-8365-d9779dc7769c None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:06.925941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dc760-cec3-4137-8365-d9779dc7769c None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:06.926166 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dc760-cec3-4137-8365-d9779dc7769c None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:06.927865 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 472/938] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:06.934410 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f89a6-dab0-4f92-aca9-117e87c91077 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:06.934718 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f89a6-dab0-4f92-aca9-117e87c91077 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:06.934958 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f89a6-dab0-4f92-aca9-117e87c91077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:06.954495 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-cd3f89a6-dab0-4f92-aca9-117e87c91077 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:06.955766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-cd3f89a6-dab0-4f92-aca9-117e87c91077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:06.976844 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:07.006300 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e75f1-42e2-4f0a-a1eb-99a318a76e41 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:07.042029 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 473/939] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 19:35:07.044919 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f89a6-dab0-4f92-aca9-117e87c91077 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:07.047256 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd779ed-6ef3-4fed-aa56-bc378db7764d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:07.047931 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd779ed-6ef3-4fed-aa56-bc378db7764d None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:07.048212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd779ed-6ef3-4fed-aa56-bc378db7764d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:07.048485 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd779ed-6ef3-4fed-aa56-bc378db7764d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:07.062002 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd779ed-6ef3-4fed-aa56-bc378db7764d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:07.063717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd779ed-6ef3-4fed-aa56-bc378db7764d None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:07.075505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-dcd779ed-6ef3-4fed-aa56-bc378db7764d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 19:35:07.075505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:07.075505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:07.075505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:07.075505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:07.075505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:07.075505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:07.075505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:07.075505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:07.075505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:07.075505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:07.075505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:07.075505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:35:07.075505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:35:07.075505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:35:07.075505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:35:07.076589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:07.076589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:07.076589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:35:07.076589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:35:07.076589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:35:07.076589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:35:07.076589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:07.076589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:07.076589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:07.076589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:07.076589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:07.076589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:07.076589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:07.076589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:07.076589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:07.076589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:07.076589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:07.076589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:07.077507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:07.077507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:07.077507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:35:07.077507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:35:07.077507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:35:07.077507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:35:07.077507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:35:07.077507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:35:07.077507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 19:35:07.077507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:07.081572 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 467/940] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Sep 14 19:35:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:07.082419 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd779ed-6ef3-4fed-aa56-bc378db7764d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:07.158909 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:07.174675 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f89a6-dab0-4f92-aca9-117e87c91077 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:07.208182 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd779ed-6ef3-4fed-aa56-bc378db7764d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:07.214417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350837c-5047-4e29-aa4a-23a1884ae05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:07.215316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350837c-5047-4e29-aa4a-23a1884ae05d None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:07.215792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350837c-5047-4e29-aa4a-23a1884ae05d None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:07.216230 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350837c-5047-4e29-aa4a-23a1884ae05d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:07.216971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350837c-5047-4e29-aa4a-23a1884ae05d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:07.218697 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350837c-5047-4e29-aa4a-23a1884ae05d None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:07.228955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-e350837c-5047-4e29-aa4a-23a1884ae05d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 19:35:07.228955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:07.228955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:35:07.228955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:35:07.228955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:35:07.228955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:35:07.228955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:35:07.228955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:07.228955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 19:35:07.228955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:07.228955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:35:07.228955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:07.228955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:07.228955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:07.228955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:07.228955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:07.228955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:07.230063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:07.230063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:07.230063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:07.230063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:07.230063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:07.230063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:07.230063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:35:07.230063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:35:07.230063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:35:07.230063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:35:07.230063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:07.230063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:07.230063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:07.230063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:07.230063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:07.230063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:07.230913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:07.230913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:07.230913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:07.230913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:07.230913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:07.230913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:07.230913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:07.230913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:07.230913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:07.230913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:07.230913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:35:07.230913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:07.230913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 19:35:07.230913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:07.233241 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 474/941] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Sep 14 19:35:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:07.244602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350837c-5047-4e29-aa4a-23a1884ae05d None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:07.250529 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682f2c1-4a1c-45b5-9c4b-9013cc3c48a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:07.251256 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682f2c1-4a1c-45b5-9c4b-9013cc3c48a0 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:07.251614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682f2c1-4a1c-45b5-9c4b-9013cc3c48a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:07.251955 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682f2c1-4a1c-45b5-9c4b-9013cc3c48a0 None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:07.252752 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682f2c1-4a1c-45b5-9c4b-9013cc3c48a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:07.253123 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682f2c1-4a1c-45b5-9c4b-9013cc3c48a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:07.255140 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682f2c1-4a1c-45b5-9c4b-9013cc3c48a0 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:07.263697 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:07.279861 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 468/942] 10.222.0.15 () {56 vars in 1149 bytes} [Wed Sep 14 19:35:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:07.287813 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682f2c1-4a1c-45b5-9c4b-9013cc3c48a0 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:07.361015 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350837c-5047-4e29-aa4a-23a1884ae05d None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:07.399181 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ad873-23cc-4eaf-918e-f3bbe705439b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:07.399836 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ad873-23cc-4eaf-918e-f3bbe705439b None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:07.400117 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ad873-23cc-4eaf-918e-f3bbe705439b None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:07.400399 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ad873-23cc-4eaf-918e-f3bbe705439b None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:07.401012 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ad873-23cc-4eaf-918e-f3bbe705439b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:07.401313 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ad873-23cc-4eaf-918e-f3bbe705439b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:07.402760 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ad873-23cc-4eaf-918e-f3bbe705439b None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:07.405635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682f2c1-4a1c-45b5-9c4b-9013cc3c48a0 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:07.408149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 475/943] 10.222.0.15 () {56 vars in 1122 bytes} [Wed Sep 14 19:35:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:07.408747 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ad873-23cc-4eaf-918e-f3bbe705439b None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:07.436308 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:07.453626 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfd31b-134c-4b16-a442-8eb1262d9746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:07.454650 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfd31b-134c-4b16-a442-8eb1262d9746 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:07.454937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfd31b-134c-4b16-a442-8eb1262d9746 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:07.455214 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfd31b-134c-4b16-a442-8eb1262d9746 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:07.466868 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfd31b-134c-4b16-a442-8eb1262d9746 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:07.468522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfd31b-134c-4b16-a442-8eb1262d9746 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:07.483266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-dfdfd31b-134c-4b16-a442-8eb1262d9746 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:07.483266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:07.483266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:07.483266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:07.483266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:07.483266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:07.483266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:07.483266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:07.483266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:07.483266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:07.483266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:07.483266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:07.483266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:35:07.483266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:35:07.483266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:35:07.483266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:35:07.484491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:07.484491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:07.484491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:07.484491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:07.484491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:07.484491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:07.484491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:07.484491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:07.484491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:07.484491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:07.484491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:07.484491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:07.484491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:07.484491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:07.484491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:07.484491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:07.484491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:35:07.485587 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:35:07.485587 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:07.485587 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:07.488981 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 469/944] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:35:07.489820 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfd31b-134c-4b16-a442-8eb1262d9746 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:07.496137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:07.519454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ad873-23cc-4eaf-918e-f3bbe705439b None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:07.554946 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41da97-4246-4468-96c5-b1b37358a174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:07.555581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41da97-4246-4468-96c5-b1b37358a174 None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:07.555873 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41da97-4246-4468-96c5-b1b37358a174 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:07.556149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41da97-4246-4468-96c5-b1b37358a174 None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:07.556790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41da97-4246-4468-96c5-b1b37358a174 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:07.558252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41da97-4246-4468-96c5-b1b37358a174 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:07.560876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: WARNING keystone.server.flask.common [None req-1a41da97-4246-4468-96c5-b1b37358a174 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 14 19:35:07.597318 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfd31b-134c-4b16-a442-8eb1262d9746 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:07.610722 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.sql.core [None req-1a41da97-4246-4468-96c5-b1b37358a174 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 19:35:07.610722 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 14 19:35:07.610722 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [parameters: {'id': 'f8c4923c3c4c4ee0a5156bf0f612c35d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 14 19:35:07.610722 dv-cinder-839768-8-smb devstack@keystone.service[93545]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93545) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 19:35:07.618386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-1a41da97-4246-4468-96c5-b1b37358a174 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f8c4923c3c4c4ee0a5156bf0f612c35d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f8c4923c3c4c4ee0a5156bf0f612c35d. Sep 14 19:35:07.618386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:07.618386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 19:35:07.618386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 19:35:07.618386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 19:35:07.618386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 19:35:07.618386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 19:35:07.618386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 19:35:07.618386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 19:35:07.618386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application conn.query(q) Sep 14 19:35:07.618386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 19:35:07.618386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 19:35:07.618386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 19:35:07.619226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application result.read() Sep 14 19:35:07.619226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 19:35:07.619226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 19:35:07.619226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 19:35:07.619226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 19:35:07.619226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 19:35:07.619226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 19:35:07.619226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 19:35:07.619226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 19:35:07.619226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 19:35:07.619226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:07.619226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 14 19:35:07.619226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:07.619226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:07.619226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 14 19:35:07.619226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 14 19:35:07.619226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 14 19:35:07.619226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 14 19:35:07.620222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 19:35:07.620222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application next(self.gen) Sep 14 19:35:07.620222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 14 19:35:07.620222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application yield resource Sep 14 19:35:07.620222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 19:35:07.620222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application next(self.gen) Sep 14 19:35:07.620222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 14 19:35:07.620222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self.session.rollback() Sep 14 19:35:07.620222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 19:35:07.620222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self.force_reraise() Sep 14 19:35:07.620222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 19:35:07.620222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise self.value Sep 14 19:35:07.620222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 14 19:35:07.620222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 14 19:35:07.620222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 14 19:35:07.620222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application session.commit() Sep 14 19:35:07.620222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 14 19:35:07.621160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 14 19:35:07.621160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 14 19:35:07.621160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._prepare_impl() Sep 14 19:35:07.621160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 14 19:35:07.621160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self.session.flush() Sep 14 19:35:07.621160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 19:35:07.621160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._flush(objects) Sep 14 19:35:07.621160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 19:35:07.621160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 14 19:35:07.621160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 19:35:07.621160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application compat.raise_( Sep 14 19:35:07.621160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 19:35:07.621160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception Sep 14 19:35:07.621160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 19:35:07.621160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application flush_context.execute() Sep 14 19:35:07.621160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 19:35:07.621160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rec.execute(self) Sep 14 19:35:07.622059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 19:35:07.622059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 14 19:35:07.622059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 19:35:07.622059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 14 19:35:07.622059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 14 19:35:07.622059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 14 19:35:07.622059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 19:35:07.622059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 19:35:07.622059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 19:35:07.622059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 14 19:35:07.622059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 19:35:07.622059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 14 19:35:07.622059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 19:35:07.622059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 14 19:35:07.622059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 19:35:07.622856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 19:35:07.622856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 19:35:07.622856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception Sep 14 19:35:07.622856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 19:35:07.622856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 19:35:07.622856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 19:35:07.622856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 19:35:07.622856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 19:35:07.622856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 19:35:07.622856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 19:35:07.622856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application conn.query(q) Sep 14 19:35:07.622856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 19:35:07.622856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 19:35:07.622856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 19:35:07.622856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application result.read() Sep 14 19:35:07.622856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 19:35:07.622856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 19:35:07.623769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 19:35:07.623769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 19:35:07.623769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 19:35:07.623769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 19:35:07.623769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 19:35:07.623769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 19:35:07.623769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 19:35:07.623769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 14 19:35:07.623769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [parameters: {'id': 'f8c4923c3c4c4ee0a5156bf0f612c35d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 14 19:35:07.623769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 19:35:07.623769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:07.623769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:35:07.623769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:07.623769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:07.623769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 14 19:35:07.624558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 14 19:35:07.624558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 14 19:35:07.624558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 14 19:35:07.624558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 14 19:35:07.624558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:07.624558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:35:07.624558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:07.624558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:07.624558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:07.624558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:07.624558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:07.624558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:07.624558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:07.624558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:07.624558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:07.624558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:07.624558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:07.625484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:07.625484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 14 19:35:07.625484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 14 19:35:07.625484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:07.625484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:07.625484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 14 19:35:07.625484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 14 19:35:07.625484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f8c4923c3c4c4ee0a5156bf0f612c35d. Sep 14 19:35:07.625484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:07.625484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 476/945] 10.222.0.15 () {60 vars in 1140 bytes} [Wed Sep 14 19:35:07 2022] POST /identity/v3/projects => generated 262 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:07.625484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41da97-4246-4468-96c5-b1b37358a174 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:07.642558 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b60bc-0fd5-41a0-8f42-cb5e050515d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:07.643168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b60bc-0fd5-41a0-8f42-cb5e050515d6 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:07.643473 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b60bc-0fd5-41a0-8f42-cb5e050515d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:07.643774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b60bc-0fd5-41a0-8f42-cb5e050515d6 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:07.644404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b60bc-0fd5-41a0-8f42-cb5e050515d6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:07.644703 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b60bc-0fd5-41a0-8f42-cb5e050515d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:07.646058 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b60bc-0fd5-41a0-8f42-cb5e050515d6 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:07.656038 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 470/946] 10.222.0.15 () {56 vars in 1122 bytes} [Wed Sep 14 19:35:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:07.656038 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b60bc-0fd5-41a0-8f42-cb5e050515d6 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:07.696574 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:07.738853 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41da97-4246-4468-96c5-b1b37358a174 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:07.760078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b60bc-0fd5-41a0-8f42-cb5e050515d6 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:07.775407 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cfbe9-d81a-47d9-90dd-5a2bd7842798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:07.776211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cfbe9-d81a-47d9-90dd-5a2bd7842798 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:07.776498 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cfbe9-d81a-47d9-90dd-5a2bd7842798 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:07.776772 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cfbe9-d81a-47d9-90dd-5a2bd7842798 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:07.777415 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5cfbe9-d81a-47d9-90dd-5a2bd7842798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:07.777721 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5cfbe9-d81a-47d9-90dd-5a2bd7842798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:07.779289 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5cfbe9-d81a-47d9-90dd-5a2bd7842798 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:07.782444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:07.799613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 477/947] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:07.799613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cfbe9-d81a-47d9-90dd-5a2bd7842798 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:07.800822 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cd8fd-679b-4843-96c2-f6041e11db3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:07.801463 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cd8fd-679b-4843-96c2-f6041e11db3d None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:07.801742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cd8fd-679b-4843-96c2-f6041e11db3d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:07.802015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cd8fd-679b-4843-96c2-f6041e11db3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:07.810014 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158cd8fd-679b-4843-96c2-f6041e11db3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:07.811481 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158cd8fd-679b-4843-96c2-f6041e11db3d None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:07.823899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-158cd8fd-679b-4843-96c2-f6041e11db3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:35:07.823899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:07.823899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:07.823899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:07.823899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:07.823899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:07.823899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:07.823899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:07.823899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:07.823899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:07.823899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:07.823899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:07.823899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:35:07.823899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:35:07.823899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:35:07.827075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:35:07.827075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:07.827075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:07.827075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:07.827075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:07.827075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:07.827075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:07.827075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:07.827075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:07.827075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:07.827075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:07.827075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:07.827075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:07.827075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:07.827075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:07.827075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:07.827075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:07.828115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:35:07.828115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:35:07.828115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:35:07.828115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:35:07.828115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:35:07.828115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:35:07.828115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:35:07.828115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:07.828115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 471/948] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:35:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:07.828115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cd8fd-679b-4843-96c2-f6041e11db3d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:07.914849 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cfbe9-d81a-47d9-90dd-5a2bd7842798 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:07.938482 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:07.943466 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cd8fd-679b-4843-96c2-f6041e11db3d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:07.956045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29212602-20a4-4fff-8d7b-06dbda7cf08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:07.956667 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29212602-20a4-4fff-8d7b-06dbda7cf08e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:07.956946 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29212602-20a4-4fff-8d7b-06dbda7cf08e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:07.957256 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29212602-20a4-4fff-8d7b-06dbda7cf08e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:07.957961 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29212602-20a4-4fff-8d7b-06dbda7cf08e None admin] RBAC: Adding query filter params (interface=public, service_id=62905b7bf041419397bc0a3e0fe5f3d8, region_id=RegionOne) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:07.962238 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29212602-20a4-4fff-8d7b-06dbda7cf08e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:07.962238 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29212602-20a4-4fff-8d7b-06dbda7cf08e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:07.965265 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 478/949] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Sep 14 19:35:07 2022] GET /identity/v3/endpoints?service_id=62905b7bf041419397bc0a3e0fe5f3d8&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:07.966062 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29212602-20a4-4fff-8d7b-06dbda7cf08e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:07.985327 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d745aa2-9f4a-447b-b82d-084348e8a5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:07.986301 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d745aa2-9f4a-447b-b82d-084348e8a5be None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:07.986799 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d745aa2-9f4a-447b-b82d-084348e8a5be None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:07.987240 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d745aa2-9f4a-447b-b82d-084348e8a5be None admin] PATH_INFO: `/v3/projects/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:07.995237 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d745aa2-9f4a-447b-b82d-084348e8a5be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:07.997174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d745aa2-9f4a-447b-b82d-084348e8a5be None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:08.011224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-3d745aa2-9f4a-447b-b82d-084348e8a5be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:35:08.011224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:08.011224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:08.011224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:08.011224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:08.011224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:08.011224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:08.011224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:08.011224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:08.011224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:08.011224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:08.011224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:08.011224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:35:08.011224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:35:08.011224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:35:08.012252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:35:08.012252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:08.012252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:08.012252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:08.012252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:08.012252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:08.012252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:08.012252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:08.012252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:08.012252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:08.012252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:08.012252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:08.012252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:08.012252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:08.012252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:08.012252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:08.012252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:08.018103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:35:08.018103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:35:08.018103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:35:08.018103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:35:08.018103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:35:08.018103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:35:08.018103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:35:08.018103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:08.018103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 472/950] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:35:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:08.018103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d745aa2-9f4a-447b-b82d-084348e8a5be None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:08.033408 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:08.077615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29212602-20a4-4fff-8d7b-06dbda7cf08e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:08.116727 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d745aa2-9f4a-447b-b82d-084348e8a5be None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:08.116945 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea611bd-90b9-44c8-b990-cd6e6d9de5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:08.117528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea611bd-90b9-44c8-b990-cd6e6d9de5b1 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:08.117808 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea611bd-90b9-44c8-b990-cd6e6d9de5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:08.118242 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea611bd-90b9-44c8-b990-cd6e6d9de5b1 None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:08.119693 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea611bd-90b9-44c8-b990-cd6e6d9de5b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:08.120020 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea611bd-90b9-44c8-b990-cd6e6d9de5b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:08.121446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea611bd-90b9-44c8-b990-cd6e6d9de5b1 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:08.139328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 479/951] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Sep 14 19:35:07 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:08.140195 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea611bd-90b9-44c8-b990-cd6e6d9de5b1 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:08.162295 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f2840-18f7-4402-8448-c2798bf41156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:08.163700 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f2840-18f7-4402-8448-c2798bf41156 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:08.163989 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f2840-18f7-4402-8448-c2798bf41156 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:08.164261 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f2840-18f7-4402-8448-c2798bf41156 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:08.164949 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f2840-18f7-4402-8448-c2798bf41156 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:08.166803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f2840-18f7-4402-8448-c2798bf41156 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:08.180109 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 473/952] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Sep 14 19:35:08 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:35:08.274064 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea611bd-90b9-44c8-b990-cd6e6d9de5b1 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:08.296907 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:08.317717 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7594d1-52cf-4aa3-917d-78e92eaa44c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:08.318836 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7594d1-52cf-4aa3-917d-78e92eaa44c4 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:08.320160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7594d1-52cf-4aa3-917d-78e92eaa44c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:08.320674 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7594d1-52cf-4aa3-917d-78e92eaa44c4 None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:08.321609 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7594d1-52cf-4aa3-917d-78e92eaa44c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:08.322129 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7594d1-52cf-4aa3-917d-78e92eaa44c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:08.323944 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7594d1-52cf-4aa3-917d-78e92eaa44c4 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:08.337794 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 480/953] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:35:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:08.345480 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f2840-18f7-4402-8448-c2798bf41156 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:08.374832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:08.457699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f2840-18f7-4402-8448-c2798bf41156 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:08.494431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8118a-6a7a-429e-a962-b148348928f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:08.495114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8118a-6a7a-429e-a962-b148348928f7 None admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:08.495395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8118a-6a7a-429e-a962-b148348928f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:08.495703 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8118a-6a7a-429e-a962-b148348928f7 None admin] PATH_INFO: `/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/15fbda6263b44352b3ac560372bef725/roles/bbffc2c569f64cd89c9598d29c9aa6fc` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:08.497901 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8118a-6a7a-429e-a962-b148348928f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e3e0c278ce94ce3a132496923eef365, user_id=15fbda6263b44352b3ac560372bef725, role_id=bbffc2c569f64cd89c9598d29c9aa6fc)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:08.499409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8118a-6a7a-429e-a962-b148348928f7 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:08.589742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 474/954] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:35:08 2022] PUT /identity/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/15fbda6263b44352b3ac560372bef725/roles/bbffc2c569f64cd89c9598d29c9aa6fc => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:35:09.175645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f1ed0-73c2-454a-adb4-56f745525c41 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:09.176165 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f1ed0-73c2-454a-adb4-56f745525c41 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:09.176165 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f1ed0-73c2-454a-adb4-56f745525c41 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:09.177821 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 481/955] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:09.183437 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cf683-631f-465d-bd9c-b4a50c01381c None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:09.183861 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cf683-631f-465d-bd9c-b4a50c01381c None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:09.184024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cf683-631f-465d-bd9c-b4a50c01381c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:09.204493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-c90cf683-631f-465d-bd9c-b4a50c01381c None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:09.205684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-c90cf683-631f-465d-bd9c-b4a50c01381c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:09.277567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 475/956] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:09.558753 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f1ed0-73c2-454a-adb4-56f745525c41 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:09.665730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f1ed0-73c2-454a-adb4-56f745525c41 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:09.700393 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387594fd-c71e-43dd-b6b6-2ea9926b2233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:09.701004 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387594fd-c71e-43dd-b6b6-2ea9926b2233 None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:09.701285 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387594fd-c71e-43dd-b6b6-2ea9926b2233 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:09.701579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387594fd-c71e-43dd-b6b6-2ea9926b2233 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:09.702238 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387594fd-c71e-43dd-b6b6-2ea9926b2233 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:09.703625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387594fd-c71e-43dd-b6b6-2ea9926b2233 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:09.779880 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 482/957] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Sep 14 19:35:09 2022] POST /identity/v3/services => generated 242 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:35:10.455462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10013585-1c6b-4392-90e2-55eee1eee72b None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:10.455999 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10013585-1c6b-4392-90e2-55eee1eee72b None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:10.456109 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10013585-1c6b-4392-90e2-55eee1eee72b None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:10.457641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 476/958] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:10.463255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42888fa-afc4-4d1e-af6e-68399abe4a2c None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:10.463705 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42888fa-afc4-4d1e-af6e-68399abe4a2c None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:10.463902 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42888fa-afc4-4d1e-af6e-68399abe4a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:10.483940 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-a42888fa-afc4-4d1e-af6e-68399abe4a2c None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:10.485485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a42888fa-afc4-4d1e-af6e-68399abe4a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:10.515959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf22175-1375-4d76-8215-605b091c52e4 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:10.516264 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf22175-1375-4d76-8215-605b091c52e4 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:10.516507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf22175-1375-4d76-8215-605b091c52e4 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:10.517952 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:10.518078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 477/959] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:10.524496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e110f20-b780-486b-856f-6ee095820bc3 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:10.524852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e110f20-b780-486b-856f-6ee095820bc3 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:10.525193 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e110f20-b780-486b-856f-6ee095820bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:10.545245 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-2e110f20-b780-486b-856f-6ee095820bc3 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:10.546547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-2e110f20-b780-486b-856f-6ee095820bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:10.558143 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:10.577112 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 483/960] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:10.635663 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 478/961] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 19:35:10.822192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e1906-9540-4b9b-bce3-9a32c2cd1ebd None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:10.822554 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e1906-9540-4b9b-bce3-9a32c2cd1ebd None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:10.822742 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e1906-9540-4b9b-bce3-9a32c2cd1ebd None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:10.824384 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 484/962] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:10.829665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f13d16-3f4c-4a88-b82a-e155ac4902a3 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:10.830186 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f13d16-3f4c-4a88-b82a-e155ac4902a3 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:10.830666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f13d16-3f4c-4a88-b82a-e155ac4902a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:10.849875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-48f13d16-3f4c-4a88-b82a-e155ac4902a3 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:10.851437 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-48f13d16-3f4c-4a88-b82a-e155ac4902a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:10.874503 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e1906-9540-4b9b-bce3-9a32c2cd1ebd None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:10.927635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 479/963] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 19:35:10.935098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f13d16-3f4c-4a88-b82a-e155ac4902a3 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:10.999357 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e1906-9540-4b9b-bce3-9a32c2cd1ebd None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:11.019959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:11.045636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19fd14-6ea8-41f1-885a-827816d5e61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:11.046589 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19fd14-6ea8-41f1-885a-827816d5e61c None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:11.046877 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19fd14-6ea8-41f1-885a-827816d5e61c None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:11.047153 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19fd14-6ea8-41f1-885a-827816d5e61c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:11.048102 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19fd14-6ea8-41f1-885a-827816d5e61c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:11.050022 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19fd14-6ea8-41f1-885a-827816d5e61c None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:11.058194 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f13d16-3f4c-4a88-b82a-e155ac4902a3 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:11.061785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-ef19fd14-6ea8-41f1-885a-827816d5e61c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 19:35:11.061785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:11.061785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:35:11.061785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:35:11.061785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:35:11.061785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:35:11.061785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:35:11.061785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:11.061785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 19:35:11.061785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:11.061785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:35:11.061785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:11.061785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:11.061785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:11.061785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:11.061785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:11.061785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:11.063088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:11.063088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:11.063088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:11.063088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:11.063088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:11.063088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:11.063088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:35:11.063088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:35:11.063088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:35:11.063088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:35:11.063088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:11.063088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:11.063088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:11.063088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:11.063088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:11.063088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:11.064179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:11.064179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:11.064179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:11.064179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:11.064179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:11.064179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:11.064179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:11.064179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:11.064179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:11.064179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:11.064179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:35:11.064179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:11.064179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 19:35:11.064179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:11.067588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 485/964] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Sep 14 19:35:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:11.068837 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19fd14-6ea8-41f1-885a-827816d5e61c None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:11.098295 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afd525-48a7-438b-9940-899d346340b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:11.099160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afd525-48a7-438b-9940-899d346340b3 None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:11.099647 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afd525-48a7-438b-9940-899d346340b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:11.100065 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afd525-48a7-438b-9940-899d346340b3 None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:11.101448 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afd525-48a7-438b-9940-899d346340b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:11.103145 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afd525-48a7-438b-9940-899d346340b3 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:11.104961 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:11.106077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: WARNING keystone.server.flask.common [None req-96afd525-48a7-438b-9940-899d346340b3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 14 19:35:11.156038 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.sql.core [None req-96afd525-48a7-438b-9940-899d346340b3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 19:35:11.156038 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 14 19:35:11.156038 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [parameters: {'user_id': 'aaa35ffed8dc4c82b83dedb456dd0942', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 14 19:35:11.156038 dv-cinder-839768-8-smb devstack@keystone.service[93544]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93544) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 19:35:11.173877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-96afd525-48a7-438b-9940-899d346340b3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 14 19:35:11.173877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:11.173877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 19:35:11.173877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 19:35:11.173877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 19:35:11.173877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 19:35:11.173877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 19:35:11.173877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 19:35:11.173877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 19:35:11.173877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application conn.query(q) Sep 14 19:35:11.173877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 19:35:11.173877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 19:35:11.173877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 19:35:11.173877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application result.read() Sep 14 19:35:11.173877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 19:35:11.175030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 19:35:11.175030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 19:35:11.175030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 19:35:11.175030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 19:35:11.175030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 19:35:11.175030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 19:35:11.175030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 19:35:11.175030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 19:35:11.175030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:11.175030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 14 19:35:11.175030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:11.175030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:11.175030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 14 19:35:11.175030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 14 19:35:11.175030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 14 19:35:11.175030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 14 19:35:11.175030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 19:35:11.175030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application next(self.gen) Sep 14 19:35:11.176235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 14 19:35:11.176235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application yield resource Sep 14 19:35:11.176235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 19:35:11.176235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application next(self.gen) Sep 14 19:35:11.176235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 14 19:35:11.176235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self.session.rollback() Sep 14 19:35:11.176235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 19:35:11.176235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self.force_reraise() Sep 14 19:35:11.176235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 19:35:11.176235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise self.value Sep 14 19:35:11.176235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 14 19:35:11.176235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 14 19:35:11.176235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 14 19:35:11.176235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application session.commit() Sep 14 19:35:11.176235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 14 19:35:11.176235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 14 19:35:11.176235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 14 19:35:11.177292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._prepare_impl() Sep 14 19:35:11.177292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 14 19:35:11.177292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self.session.flush() Sep 14 19:35:11.177292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 19:35:11.177292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._flush(objects) Sep 14 19:35:11.177292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 19:35:11.177292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 14 19:35:11.177292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 19:35:11.177292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application compat.raise_( Sep 14 19:35:11.177292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 19:35:11.177292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception Sep 14 19:35:11.177292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 19:35:11.177292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application flush_context.execute() Sep 14 19:35:11.177292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 19:35:11.177292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rec.execute(self) Sep 14 19:35:11.177292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 19:35:11.177292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 14 19:35:11.178231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 19:35:11.178231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 14 19:35:11.178231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 14 19:35:11.178231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 14 19:35:11.178231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 19:35:11.178231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 19:35:11.178231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 19:35:11.178231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 14 19:35:11.178231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 19:35:11.178231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 14 19:35:11.178231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 19:35:11.178231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 14 19:35:11.178231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 19:35:11.178231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 19:35:11.178231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 19:35:11.178231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception Sep 14 19:35:11.179174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 19:35:11.179174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 19:35:11.179174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 19:35:11.179174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 19:35:11.179174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 19:35:11.179174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 19:35:11.179174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 19:35:11.179174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application conn.query(q) Sep 14 19:35:11.179174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 19:35:11.179174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 19:35:11.179174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 19:35:11.179174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application result.read() Sep 14 19:35:11.179174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 19:35:11.179174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 19:35:11.179174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 19:35:11.179174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 19:35:11.180272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 19:35:11.180272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 19:35:11.180272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 19:35:11.180272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 19:35:11.180272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 19:35:11.180272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 14 19:35:11.180272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [parameters: {'user_id': 'aaa35ffed8dc4c82b83dedb456dd0942', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 14 19:35:11.180272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 19:35:11.180272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:11.180272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:35:11.180272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:11.180272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:11.180272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:11.180272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:11.180272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:11.182116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:11.182116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:11.182116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:11.182116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:11.182116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:11.182116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:11.182116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:11.182116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 14 19:35:11.182116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 14 19:35:11.182116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:11.182116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:11.182116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:35:11.182116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:35:11.182116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:35:11.182116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:35:11.182116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 14 19:35:11.182116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 14 19:35:11.184794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 14 19:35:11.184794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 14 19:35:11.184794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 14 19:35:11.184794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 14 19:35:11.184794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 14 19:35:11.184794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:11.184794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 480/965] 10.222.0.15 () {60 vars in 1131 bytes} [Wed Sep 14 19:35:10 2022] POST /identity/v3/users => generated 160 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:35:11.184794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afd525-48a7-438b-9940-899d346340b3 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:11.200386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19fd14-6ea8-41f1-885a-827816d5e61c None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:11.240114 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47397d0-d92e-4753-9877-72a334ade3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:11.240731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47397d0-d92e-4753-9877-72a334ade3f2 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:11.241011 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47397d0-d92e-4753-9877-72a334ade3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:11.241395 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47397d0-d92e-4753-9877-72a334ade3f2 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:11.242210 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47397d0-d92e-4753-9877-72a334ade3f2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:11.242516 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47397d0-d92e-4753-9877-72a334ade3f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:11.243897 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47397d0-d92e-4753-9877-72a334ade3f2 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:11.253722 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 486/966] 10.222.0.15 () {56 vars in 1122 bytes} [Wed Sep 14 19:35:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:11.253722 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47397d0-d92e-4753-9877-72a334ade3f2 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:11.304731 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afd525-48a7-438b-9940-899d346340b3 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:11.342733 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480bbee-cb27-4349-ac15-8d9f1121e91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:11.343362 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480bbee-cb27-4349-ac15-8d9f1121e91e None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:11.343667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480bbee-cb27-4349-ac15-8d9f1121e91e None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:11.343935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480bbee-cb27-4349-ac15-8d9f1121e91e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:11.345968 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:11.349728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:11.351976 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480bbee-cb27-4349-ac15-8d9f1121e91e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:11.353852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480bbee-cb27-4349-ac15-8d9f1121e91e None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:11.359146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47397d0-d92e-4753-9877-72a334ade3f2 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:11.365801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-1480bbee-cb27-4349-ac15-8d9f1121e91e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 19:35:11.365801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:11.365801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:11.365801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:11.365801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:11.365801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:11.365801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:11.365801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:11.365801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:11.365801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:11.365801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:11.365801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:11.365801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:35:11.365801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:35:11.365801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:35:11.365801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:35:11.367530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:11.367530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:11.367530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:35:11.367530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:35:11.367530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:35:11.367530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:35:11.367530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:11.367530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:11.367530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:11.367530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:11.367530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:11.367530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:11.367530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:11.367530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:11.367530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:11.367530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:11.367530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:11.367530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:11.369577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:11.369577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:11.369577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:35:11.369577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:35:11.369577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:35:11.369577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:35:11.369577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:35:11.369577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:35:11.369577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 19:35:11.369577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:11.369577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 481/967] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:35:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:11.369577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480bbee-cb27-4349-ac15-8d9f1121e91e None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:11.406090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc99fd3-1d8b-4ec1-b074-c923dd4cfaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:11.407383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc99fd3-1d8b-4ec1-b074-c923dd4cfaef None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:11.407913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc99fd3-1d8b-4ec1-b074-c923dd4cfaef None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:11.408367 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc99fd3-1d8b-4ec1-b074-c923dd4cfaef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:11.421374 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc99fd3-1d8b-4ec1-b074-c923dd4cfaef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:35:11.426227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-ddc99fd3-1d8b-4ec1-b074-c923dd4cfaef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 19:35:11.426227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:11.426227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:11.426227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:11.426227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:11.426227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:11.426227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:11.426227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:11.426227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:11.426227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:11.426227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:11.426227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:11.426227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:35:11.426227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:35:11.426227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:35:11.426227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:35:11.427180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:35:11.427180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:35:11.427180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:35:11.427180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:35:11.427180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:11.427180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:11.427180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:11.427180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:11.427180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:11.427180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:11.427180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:11.427180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:11.427180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:11.427180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:11.427180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:11.427180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:11.428065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:11.428065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:11.428065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:11.428065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:11.428065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:35:11.428065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:35:11.428065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:35:11.428065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:35:11.428065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:35:11.428065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:35:11.428065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 19:35:11.428065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:11.428065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 487/968] 10.222.0.15 () {56 vars in 1120 bytes} [Wed Sep 14 19:35:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:11.429447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc99fd3-1d8b-4ec1-b074-c923dd4cfaef None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:11.480390 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480bbee-cb27-4349-ac15-8d9f1121e91e None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:11.515505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dde3bb-4c00-457f-b5ec-810ccb5b6324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:11.516151 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dde3bb-4c00-457f-b5ec-810ccb5b6324 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:11.516428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dde3bb-4c00-457f-b5ec-810ccb5b6324 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:11.516701 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dde3bb-4c00-457f-b5ec-810ccb5b6324 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:11.517335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dde3bb-4c00-457f-b5ec-810ccb5b6324 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:11.517639 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dde3bb-4c00-457f-b5ec-810ccb5b6324 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:11.519007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dde3bb-4c00-457f-b5ec-810ccb5b6324 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:11.527579 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 482/969] 10.222.0.15 () {56 vars in 1122 bytes} [Wed Sep 14 19:35:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:11.528418 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dde3bb-4c00-457f-b5ec-810ccb5b6324 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:11.546949 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc99fd3-1d8b-4ec1-b074-c923dd4cfaef None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:11.583422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58847b48-d7cb-4541-8f76-003384228f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:11.584199 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58847b48-d7cb-4541-8f76-003384228f68 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:11.584481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58847b48-d7cb-4541-8f76-003384228f68 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:11.584755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58847b48-d7cb-4541-8f76-003384228f68 None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:11.585990 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58847b48-d7cb-4541-8f76-003384228f68 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:11.586297 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58847b48-d7cb-4541-8f76-003384228f68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:11.587876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58847b48-d7cb-4541-8f76-003384228f68 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:11.590391 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:11.624794 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 488/970] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Sep 14 19:35:11 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:11.625916 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58847b48-d7cb-4541-8f76-003384228f68 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:11.645240 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dde3bb-4c00-457f-b5ec-810ccb5b6324 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:11.648122 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:11.694192 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc7218-3c7d-40fa-b9ba-df45422f0aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:11.695893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc7218-3c7d-40fa-b9ba-df45422f0aa4 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:11.699458 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc7218-3c7d-40fa-b9ba-df45422f0aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:11.699966 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc7218-3c7d-40fa-b9ba-df45422f0aa4 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:11.700929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc7218-3c7d-40fa-b9ba-df45422f0aa4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:11.701395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc7218-3c7d-40fa-b9ba-df45422f0aa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:11.703932 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc7218-3c7d-40fa-b9ba-df45422f0aa4 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:11.719257 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 483/971] 10.222.0.15 () {56 vars in 1115 bytes} [Wed Sep 14 19:35:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:11.720822 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc7218-3c7d-40fa-b9ba-df45422f0aa4 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:11.756508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58847b48-d7cb-4541-8f76-003384228f68 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:11.795250 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09baea0-dbdb-40db-a978-69585b2b8994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:11.796019 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09baea0-dbdb-40db-a978-69585b2b8994 None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:11.796360 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09baea0-dbdb-40db-a978-69585b2b8994 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:11.796702 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09baea0-dbdb-40db-a978-69585b2b8994 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:11.797442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09baea0-dbdb-40db-a978-69585b2b8994 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:11.798887 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09baea0-dbdb-40db-a978-69585b2b8994 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:11.852315 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc7218-3c7d-40fa-b9ba-df45422f0aa4 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:11.873503 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:11.888351 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 489/972] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:35:11 2022] POST /identity/v3/endpoints => generated 349 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:35:11.899787 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e889a-3f66-4b32-8be7-33516c3789e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:11.900509 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e889a-3f66-4b32-8be7-33516c3789e6 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:11.900791 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e889a-3f66-4b32-8be7-33516c3789e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:11.901060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e889a-3f66-4b32-8be7-33516c3789e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:11.915594 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e889a-3f66-4b32-8be7-33516c3789e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:11.917208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e889a-3f66-4b32-8be7-33516c3789e6 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:11.935403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-e80e889a-3f66-4b32-8be7-33516c3789e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:11.935403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:11.935403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:11.935403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:11.935403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:11.935403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:11.935403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:11.935403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:11.935403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:11.935403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:11.935403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:11.935403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:11.935403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:35:11.935403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:35:11.935403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:35:11.935403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:35:11.936642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:11.936642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:11.936642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:11.936642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:11.936642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:11.936642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:11.936642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:11.936642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:11.936642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:11.936642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:11.936642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:11.936642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:11.936642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:11.936642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:11.936642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:11.936642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:11.936642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:35:11.937558 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:35:11.937558 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:11.937558 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:11.940387 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 484/973] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:35:11.947925 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09baea0-dbdb-40db-a978-69585b2b8994 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:12.039037 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:12.052037 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f437d4d-4f85-43d4-91de-5eb5a97bc0ea None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:12.052338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f437d4d-4f85-43d4-91de-5eb5a97bc0ea None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:12.052591 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f437d4d-4f85-43d4-91de-5eb5a97bc0ea None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:12.054551 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 485/974] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:35:12.060455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f0452-c9a5-4c44-ab42-8bb881847070 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:12.060762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f0452-c9a5-4c44-ab42-8bb881847070 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:12.061002 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f0452-c9a5-4c44-ab42-8bb881847070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:12.079809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09baea0-dbdb-40db-a978-69585b2b8994 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:12.081650 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-438f0452-c9a5-4c44-ab42-8bb881847070 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:12.083154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-438f0452-c9a5-4c44-ab42-8bb881847070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:12.122660 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2c699-743f-43a5-9e7c-4d02bd733cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:12.123579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2c699-743f-43a5-9e7c-4d02bd733cd7 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:12.124002 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2c699-743f-43a5-9e7c-4d02bd733cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:12.124416 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2c699-743f-43a5-9e7c-4d02bd733cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:12.125219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2c699-743f-43a5-9e7c-4d02bd733cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:12.125920 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2c699-743f-43a5-9e7c-4d02bd733cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:12.128603 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2c699-743f-43a5-9e7c-4d02bd733cd7 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:12.143633 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 490/975] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:12.149747 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2c699-743f-43a5-9e7c-4d02bd733cd7 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:12.161226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 486/976] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 19:35:12.250674 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2c699-743f-43a5-9e7c-4d02bd733cd7 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:12.277202 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:12.286101 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3205fa-01d3-4fb5-ba50-9ba77906f5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:12.287012 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3205fa-01d3-4fb5-ba50-9ba77906f5ab None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:12.287470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3205fa-01d3-4fb5-ba50-9ba77906f5ab None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:12.288076 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3205fa-01d3-4fb5-ba50-9ba77906f5ab None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:12.296712 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3205fa-01d3-4fb5-ba50-9ba77906f5ab None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:12.298420 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3205fa-01d3-4fb5-ba50-9ba77906f5ab None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:12.311636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-5e3205fa-01d3-4fb5-ba50-9ba77906f5ab None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 19:35:12.311636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:12.311636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:12.311636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:12.311636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:12.311636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:12.311636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:12.311636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:12.311636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:12.311636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:12.311636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:12.311636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:12.311636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:35:12.311636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:35:12.311636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:35:12.311636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:35:12.312580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:12.312580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:12.312580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:35:12.312580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:35:12.312580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:35:12.312580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:35:12.312580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:12.312580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:12.312580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:12.312580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:12.312580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:12.312580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:12.312580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:12.312580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:12.312580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:12.312580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:12.312580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:12.312580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:12.313538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:12.313538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:12.313538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:35:12.313538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:35:12.313538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:35:12.313538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:35:12.313538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:35:12.313538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:35:12.313538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 19:35:12.313538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:12.323132 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 491/977] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Sep 14 19:35:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:35:12.323292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f0452-c9a5-4c44-ab42-8bb881847070 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:12.434641 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3205fa-01d3-4fb5-ba50-9ba77906f5ab None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:12.434846 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:12.441282 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f0452-c9a5-4c44-ab42-8bb881847070 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:12.488516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ff9f2-b9cc-45d7-97f5-7ad048ede785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:12.489986 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ff9f2-b9cc-45d7-97f5-7ad048ede785 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:12.490474 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ff9f2-b9cc-45d7-97f5-7ad048ede785 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:12.490950 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ff9f2-b9cc-45d7-97f5-7ad048ede785 None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:12.491987 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ff9f2-b9cc-45d7-97f5-7ad048ede785 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:12.492583 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ff9f2-b9cc-45d7-97f5-7ad048ede785 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:12.494209 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ff9f2-b9cc-45d7-97f5-7ad048ede785 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:12.513977 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 487/978] 10.222.0.15 () {56 vars in 1149 bytes} [Wed Sep 14 19:35:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:12.519416 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ff9f2-b9cc-45d7-97f5-7ad048ede785 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:12.561990 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3205fa-01d3-4fb5-ba50-9ba77906f5ab None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:12.600312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec53be7-3b14-40d2-a39c-694feae89a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:12.601602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec53be7-3b14-40d2-a39c-694feae89a79 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:12.601877 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec53be7-3b14-40d2-a39c-694feae89a79 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:12.602141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec53be7-3b14-40d2-a39c-694feae89a79 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:12.602723 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec53be7-3b14-40d2-a39c-694feae89a79 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:12.604141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec53be7-3b14-40d2-a39c-694feae89a79 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:12.613858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-0ec53be7-3b14-40d2-a39c-694feae89a79 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 19:35:12.613858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:12.613858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:35:12.613858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:35:12.613858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:35:12.613858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:35:12.613858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:35:12.613858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:12.613858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 19:35:12.613858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:12.613858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:35:12.613858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:12.613858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:12.613858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:12.613858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:12.613858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:12.613858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:12.614993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:12.614993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:12.614993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:12.614993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:12.614993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:12.614993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:12.614993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:35:12.614993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:35:12.614993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:35:12.614993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:35:12.614993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:12.614993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:12.614993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:12.614993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:12.614993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:12.614993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:12.615878 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:12.615878 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:12.615878 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:12.615878 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:12.615878 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:12.615878 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:12.615878 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:12.615878 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:12.615878 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:12.615878 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:12.615878 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:35:12.615878 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:12.615878 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 19:35:12.615878 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:12.615878 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 492/979] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:35:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:12.621117 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec53be7-3b14-40d2-a39c-694feae89a79 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:12.645019 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ff9f2-b9cc-45d7-97f5-7ad048ede785 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:12.682953 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:12.687091 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0823f90-0285-4999-a040-935061190017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:12.687850 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0823f90-0285-4999-a040-935061190017 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:12.688197 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0823f90-0285-4999-a040-935061190017 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:12.688536 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0823f90-0285-4999-a040-935061190017 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:12.716178 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:12.756677 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec53be7-3b14-40d2-a39c-694feae89a79 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:12.783732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0823f90-0285-4999-a040-935061190017 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:12.785399 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0823f90-0285-4999-a040-935061190017 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:12.803064 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09eb3b-b733-4fc4-86da-860c87f20d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:12.804267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09eb3b-b733-4fc4-86da-860c87f20d8f None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:12.804988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09eb3b-b733-4fc4-86da-860c87f20d8f None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:12.805472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09eb3b-b733-4fc4-86da-860c87f20d8f None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:12.806359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09eb3b-b733-4fc4-86da-860c87f20d8f None admin] RBAC: Adding query filter params (name=compute) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:12.806857 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09eb3b-b733-4fc4-86da-860c87f20d8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:12.808657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09eb3b-b733-4fc4-86da-860c87f20d8f None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:12.814451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 493/980] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Sep 14 19:35:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:12.820864 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09eb3b-b733-4fc4-86da-860c87f20d8f None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:12.906228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 488/981] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:35:12 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 19:35:12.911920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0823f90-0285-4999-a040-935061190017 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:12.924869 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09eb3b-b733-4fc4-86da-860c87f20d8f None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:12.939196 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:12.960022 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e4bc5-a2d3-4a63-8153-c012f9851c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:12.961303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e4bc5-a2d3-4a63-8153-c012f9851c99 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:12.961588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e4bc5-a2d3-4a63-8153-c012f9851c99 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:12.961862 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e4bc5-a2d3-4a63-8153-c012f9851c99 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:12.962486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e4bc5-a2d3-4a63-8153-c012f9851c99 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:12.962796 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e4bc5-a2d3-4a63-8153-c012f9851c99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:12.964184 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e4bc5-a2d3-4a63-8153-c012f9851c99 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:12.969709 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 494/982] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Sep 14 19:35:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:12.972398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:12.975191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e4bc5-a2d3-4a63-8153-c012f9851c99 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:13.018329 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0823f90-0285-4999-a040-935061190017 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:13.053031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f2902-55be-4ce3-a99b-7dd6e03d367a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:13.053605 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f2902-55be-4ce3-a99b-7dd6e03d367a None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:13.054388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f2902-55be-4ce3-a99b-7dd6e03d367a None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:13.054794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f2902-55be-4ce3-a99b-7dd6e03d367a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:13.066470 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f2902-55be-4ce3-a99b-7dd6e03d367a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:13.067956 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f2902-55be-4ce3-a99b-7dd6e03d367a None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:13.081993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e4bc5-a2d3-4a63-8153-c012f9851c99 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:13.082642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-e08f2902-55be-4ce3-a99b-7dd6e03d367a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:13.082642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:13.082642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:13.082642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:13.082642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:13.082642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:13.082642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:13.082642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:13.082642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:13.082642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:13.082642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:13.082642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:13.082642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:35:13.082642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:35:13.082642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:35:13.082642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:35:13.083607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:13.083607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:13.083607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:13.083607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:13.083607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:13.083607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:13.083607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:13.083607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:13.083607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:13.083607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:13.083607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:13.083607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:13.083607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:13.083607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:13.083607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:13.083607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:13.083607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:35:13.084552 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:35:13.084552 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:13.084552 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:13.084552 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 489/983] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:35:13.089803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f2902-55be-4ce3-a99b-7dd6e03d367a None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:13.123595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8426a38-e9d9-48b8-a607-8ceae1cd5bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:13.124212 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8426a38-e9d9-48b8-a607-8ceae1cd5bb8 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:13.124485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8426a38-e9d9-48b8-a607-8ceae1cd5bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:13.124757 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8426a38-e9d9-48b8-a607-8ceae1cd5bb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:13.125740 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8426a38-e9d9-48b8-a607-8ceae1cd5bb8 None admin] RBAC: Adding query filter params (interface=public, service_id=d64ee320328f49d6a682312bc8c2701e, region_id=RegionOne) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:13.126870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8426a38-e9d9-48b8-a607-8ceae1cd5bb8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:13.128256 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8426a38-e9d9-48b8-a607-8ceae1cd5bb8 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:13.135577 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 495/984] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Sep 14 19:35:12 2022] GET /identity/v3/endpoints?service_id=d64ee320328f49d6a682312bc8c2701e&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:13.140376 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8426a38-e9d9-48b8-a607-8ceae1cd5bb8 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:13.188839 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:13.196509 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f2902-55be-4ce3-a99b-7dd6e03d367a None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:13.205799 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:13.230716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e248dab-1d3f-4815-b00c-3cbade285467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:13.231331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e248dab-1d3f-4815-b00c-3cbade285467 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:13.231635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e248dab-1d3f-4815-b00c-3cbade285467 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:13.231908 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e248dab-1d3f-4815-b00c-3cbade285467 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:13.232554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e248dab-1d3f-4815-b00c-3cbade285467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:13.232856 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e248dab-1d3f-4815-b00c-3cbade285467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:13.234223 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e248dab-1d3f-4815-b00c-3cbade285467 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:13.246652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 490/985] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:13.250003 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8426a38-e9d9-48b8-a607-8ceae1cd5bb8 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:13.252151 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e248dab-1d3f-4815-b00c-3cbade285467 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:13.286615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e8dfa-d35d-4f81-b9c8-78f6bd197f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:13.287228 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e8dfa-d35d-4f81-b9c8-78f6bd197f04 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:13.287507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e8dfa-d35d-4f81-b9c8-78f6bd197f04 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:13.287807 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e8dfa-d35d-4f81-b9c8-78f6bd197f04 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:13.288562 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e8dfa-d35d-4f81-b9c8-78f6bd197f04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:13.290161 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e8dfa-d35d-4f81-b9c8-78f6bd197f04 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:13.307660 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 496/986] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Sep 14 19:35:13 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:35:13.378339 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e248dab-1d3f-4815-b00c-3cbade285467 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:13.419166 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094e987-91dc-4754-b6ec-246c88f05393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:13.420103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094e987-91dc-4754-b6ec-246c88f05393 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:13.420523 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094e987-91dc-4754-b6ec-246c88f05393 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:13.420966 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094e987-91dc-4754-b6ec-246c88f05393 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:13.429171 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094e987-91dc-4754-b6ec-246c88f05393 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:13.430902 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094e987-91dc-4754-b6ec-246c88f05393 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:13.443514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-9094e987-91dc-4754-b6ec-246c88f05393 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:35:13.443514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:13.443514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:13.443514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:13.443514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:13.443514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:13.443514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:13.443514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:13.443514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:13.443514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:13.443514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:13.443514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:13.443514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:35:13.443514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:35:13.443514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:35:13.445224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:35:13.445224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:13.445224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:13.445224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:13.445224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:13.445224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:13.445224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:13.445224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:13.445224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:13.445224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:13.445224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:13.445224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:13.445224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:13.445224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:13.445224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:13.445224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:13.445224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:13.446311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:35:13.446311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:35:13.446311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:35:13.446311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:35:13.446311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:35:13.446311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:35:13.446311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:35:13.446311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:13.449089 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 491/987] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:35:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:35:13.454801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e8dfa-d35d-4f81-b9c8-78f6bd197f04 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:13.563109 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e8dfa-d35d-4f81-b9c8-78f6bd197f04 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:13.570740 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:13.597965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272018c0-8381-4c0e-81af-d50bb7cbccce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:13.598579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272018c0-8381-4c0e-81af-d50bb7cbccce None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:13.598855 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272018c0-8381-4c0e-81af-d50bb7cbccce None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:13.599125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272018c0-8381-4c0e-81af-d50bb7cbccce None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:13.599874 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272018c0-8381-4c0e-81af-d50bb7cbccce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:13.600188 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272018c0-8381-4c0e-81af-d50bb7cbccce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:13.601714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272018c0-8381-4c0e-81af-d50bb7cbccce None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:13.614216 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 497/988] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:35:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:13.620457 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094e987-91dc-4754-b6ec-246c88f05393 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:13.650937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:13.724145 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094e987-91dc-4754-b6ec-246c88f05393 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:13.759104 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6119d-a9ee-433a-9c6c-b1b4af95ea0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:13.759744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6119d-a9ee-433a-9c6c-b1b4af95ea0a None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:13.760022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6119d-a9ee-433a-9c6c-b1b4af95ea0a None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:13.760291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6119d-a9ee-433a-9c6c-b1b4af95ea0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:13.761013 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6119d-a9ee-433a-9c6c-b1b4af95ea0a None admin] RBAC: Adding query filter params (role.id=bbffc2c569f64cd89c9598d29c9aa6fc, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=15fbda6263b44352b3ac560372bef725) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:13.761319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6119d-a9ee-433a-9c6c-b1b4af95ea0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:13.762759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6119d-a9ee-433a-9c6c-b1b4af95ea0a None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:13.775591 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 492/989] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:35:13 2022] GET /identity/v3/role_assignments?user.id=15fbda6263b44352b3ac560372bef725&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=bbffc2c569f64cd89c9598d29c9aa6fc => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:14.125707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667494aa-61bd-48c6-bf1a-6b91c88565fe None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:14.126039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667494aa-61bd-48c6-bf1a-6b91c88565fe None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:14.126267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667494aa-61bd-48c6-bf1a-6b91c88565fe None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:14.127794 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 498/990] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:14.133584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ad4e1-383d-4deb-9a84-9e96689a9c2a None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:14.133970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ad4e1-383d-4deb-9a84-9e96689a9c2a None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:14.134254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ad4e1-383d-4deb-9a84-9e96689a9c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:14.152966 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-af0ad4e1-383d-4deb-9a84-9e96689a9c2a None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:14.154153 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-af0ad4e1-383d-4deb-9a84-9e96689a9c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:14.225115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 493/991] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:14.497867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667494aa-61bd-48c6-bf1a-6b91c88565fe None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:14.601146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667494aa-61bd-48c6-bf1a-6b91c88565fe None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:14.636302 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfefde-48aa-4ce3-acb7-6fa688e322aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:14.636941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfefde-48aa-4ce3-acb7-6fa688e322aa None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:14.637221 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfefde-48aa-4ce3-acb7-6fa688e322aa None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:14.637495 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfefde-48aa-4ce3-acb7-6fa688e322aa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:14.638074 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfefde-48aa-4ce3-acb7-6fa688e322aa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:14.639440 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfefde-48aa-4ce3-acb7-6fa688e322aa None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:14.648489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-b0dfefde-48aa-4ce3-acb7-6fa688e322aa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 19:35:14.648489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:14.648489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:35:14.648489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:35:14.648489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:35:14.648489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:35:14.648489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:35:14.648489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:14.648489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 19:35:14.648489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:14.648489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:35:14.648489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:14.648489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:14.648489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:14.648489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:14.648489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:14.648489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:14.649455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:14.649455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:14.649455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:14.649455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:14.649455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:14.649455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:14.649455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:35:14.649455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:35:14.649455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:35:14.649455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:35:14.649455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:14.649455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:14.649455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:14.649455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:14.649455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:14.649455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:14.650337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:14.650337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:14.650337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:14.650337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:14.650337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:14.650337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:14.650337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:14.650337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:14.650337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:14.650337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:14.650337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:35:14.650337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:14.650337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 19:35:14.650337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:14.651903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 499/992] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Sep 14 19:35:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:14.655494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ad4e1-383d-4deb-9a84-9e96689a9c2a None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:14.680474 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:14.759363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ad4e1-383d-4deb-9a84-9e96689a9c2a None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:14.792668 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fe8d9-489f-4aae-ae35-0432b6ff091d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:14.793278 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fe8d9-489f-4aae-ae35-0432b6ff091d None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:14.793558 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fe8d9-489f-4aae-ae35-0432b6ff091d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:14.793830 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fe8d9-489f-4aae-ae35-0432b6ff091d None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:14.794458 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161fe8d9-489f-4aae-ae35-0432b6ff091d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:14.794765 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161fe8d9-489f-4aae-ae35-0432b6ff091d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:14.796160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161fe8d9-489f-4aae-ae35-0432b6ff091d None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:14.801098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 494/993] 10.222.0.15 () {56 vars in 1122 bytes} [Wed Sep 14 19:35:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:14.807443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfefde-48aa-4ce3-acb7-6fa688e322aa None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:14.840129 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:14.911991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfefde-48aa-4ce3-acb7-6fa688e322aa None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:14.945915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba2660-3eb4-4ce7-9fab-3dcc81437957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:14.946521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba2660-3eb4-4ce7-9fab-3dcc81437957 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:14.946802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba2660-3eb4-4ce7-9fab-3dcc81437957 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:14.947073 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba2660-3eb4-4ce7-9fab-3dcc81437957 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:14.947731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba2660-3eb4-4ce7-9fab-3dcc81437957 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:14.948040 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba2660-3eb4-4ce7-9fab-3dcc81437957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:14.949399 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba2660-3eb4-4ce7-9fab-3dcc81437957 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:14.959177 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 500/994] 10.222.0.15 () {56 vars in 1122 bytes} [Wed Sep 14 19:35:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:14.960169 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fe8d9-489f-4aae-ae35-0432b6ff091d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:15.051138 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:15.066951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fe8d9-489f-4aae-ae35-0432b6ff091d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:15.102833 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cd0b9-fcc5-45dc-af94-7cc0d32710f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:15.103448 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cd0b9-fcc5-45dc-af94-7cc0d32710f4 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:15.103758 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cd0b9-fcc5-45dc-af94-7cc0d32710f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:15.104031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cd0b9-fcc5-45dc-af94-7cc0d32710f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:15.104770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cd0b9-fcc5-45dc-af94-7cc0d32710f4 None admin] RBAC: Adding query filter params (interface=admin, service_id=62905b7bf041419397bc0a3e0fe5f3d8, region_id=RegionOne) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:15.105081 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cd0b9-fcc5-45dc-af94-7cc0d32710f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:15.106443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cd0b9-fcc5-45dc-af94-7cc0d32710f4 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:15.116435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 495/995] 10.222.0.15 () {56 vars in 1249 bytes} [Wed Sep 14 19:35:14 2022] GET /identity/v3/endpoints?service_id=62905b7bf041419397bc0a3e0fe5f3d8&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:15.117656 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba2660-3eb4-4ce7-9fab-3dcc81437957 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:15.212494 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:15.219597 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba2660-3eb4-4ce7-9fab-3dcc81437957 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:15.252574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d227f9b-8f71-488a-80ce-2886436e07ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:15.253186 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d227f9b-8f71-488a-80ce-2886436e07ec None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:15.253466 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d227f9b-8f71-488a-80ce-2886436e07ec None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:15.253737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d227f9b-8f71-488a-80ce-2886436e07ec None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:15.254343 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d227f9b-8f71-488a-80ce-2886436e07ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:15.255734 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d227f9b-8f71-488a-80ce-2886436e07ec None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:15.271580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 501/996] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Sep 14 19:35:15 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:35:15.472932 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0c264-82d5-4a45-9d39-2891a6ff07b6 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:15.473256 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0c264-82d5-4a45-9d39-2891a6ff07b6 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:15.473473 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0c264-82d5-4a45-9d39-2891a6ff07b6 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:15.474948 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 496/997] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:15.480235 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ede0cb-0c97-432d-81d4-050cbcf93e56 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:15.480524 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ede0cb-0c97-432d-81d4-050cbcf93e56 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:15.480800 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ede0cb-0c97-432d-81d4-050cbcf93e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:15.499476 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-29ede0cb-0c97-432d-81d4-050cbcf93e56 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:15.500782 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-29ede0cb-0c97-432d-81d4-050cbcf93e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:15.570843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 502/998] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:15 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:15.843132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0c264-82d5-4a45-9d39-2891a6ff07b6 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:15.993792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0c264-82d5-4a45-9d39-2891a6ff07b6 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:16.029584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd5541-fb89-4ac8-8c78-64e2e8e59d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:16.030211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd5541-fb89-4ac8-8c78-64e2e8e59d84 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:16.030485 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd5541-fb89-4ac8-8c78-64e2e8e59d84 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:16.030750 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd5541-fb89-4ac8-8c78-64e2e8e59d84 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:16.031332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd5541-fb89-4ac8-8c78-64e2e8e59d84 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:16.032961 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd5541-fb89-4ac8-8c78-64e2e8e59d84 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:16.041744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-bcbd5541-fb89-4ac8-8c78-64e2e8e59d84 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 19:35:16.041744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:16.041744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:35:16.041744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:35:16.041744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:35:16.041744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:35:16.041744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:35:16.041744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:16.041744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 19:35:16.041744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:16.041744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:35:16.041744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:16.041744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:16.041744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:16.041744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:16.041744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:16.041744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:16.042934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:16.042934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:16.042934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:16.042934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:16.042934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:16.042934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:16.042934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:35:16.042934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:35:16.042934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:35:16.042934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:35:16.042934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:16.042934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:16.042934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:16.042934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:16.042934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:16.042934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:16.044460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:16.044460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:16.044460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:16.044460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:16.044460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:16.044460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:16.044460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:16.044460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:16.044460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:16.044460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:16.044460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:35:16.044460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:16.044460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 19:35:16.044460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:16.044460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 497/999] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:35:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:16.048759 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ede0cb-0c97-432d-81d4-050cbcf93e56 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:16.055706 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f855f2-62c8-47d3-8466-4218864cede1 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:16.055990 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f855f2-62c8-47d3-8466-4218864cede1 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:16.056260 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f855f2-62c8-47d3-8466-4218864cede1 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:16.057711 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 498/1000] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:35:16.062610 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93887dd-901e-4729-9422-98333b5d9658 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:16.062890 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93887dd-901e-4729-9422-98333b5d9658 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:16.063168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93887dd-901e-4729-9422-98333b5d9658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:16.082567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-b93887dd-901e-4729-9422-98333b5d9658 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:16.083824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b93887dd-901e-4729-9422-98333b5d9658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:16.094352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:16.141336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:16.152453 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 499/1001] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:16.153322 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ede0cb-0c97-432d-81d4-050cbcf93e56 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:16.189020 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e81f7-7875-4704-82b8-3e58acdfc1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:16.189632 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e81f7-7875-4704-82b8-3e58acdfc1c1 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:16.189904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e81f7-7875-4704-82b8-3e58acdfc1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:16.190173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e81f7-7875-4704-82b8-3e58acdfc1c1 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:16.190799 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e81f7-7875-4704-82b8-3e58acdfc1c1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:16.191096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e81f7-7875-4704-82b8-3e58acdfc1c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:16.192480 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e81f7-7875-4704-82b8-3e58acdfc1c1 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:16.197856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 503/1002] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Sep 14 19:35:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:16.203250 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93887dd-901e-4729-9422-98333b5d9658 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:16.301418 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93887dd-901e-4729-9422-98333b5d9658 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:16.346133 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38aed64-cb19-49b4-9710-b07c7937d619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:16.346661 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38aed64-cb19-49b4-9710-b07c7937d619 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:16.346934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38aed64-cb19-49b4-9710-b07c7937d619 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:16.347201 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38aed64-cb19-49b4-9710-b07c7937d619 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:16.347866 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38aed64-cb19-49b4-9710-b07c7937d619 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:16.348169 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38aed64-cb19-49b4-9710-b07c7937d619 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:16.349544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38aed64-cb19-49b4-9710-b07c7937d619 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:16.359508 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 500/1003] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Sep 14 19:35:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:16.360668 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e81f7-7875-4704-82b8-3e58acdfc1c1 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:16.426470 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38aed64-cb19-49b4-9710-b07c7937d619 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:16.437708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:16.474965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e81f7-7875-4704-82b8-3e58acdfc1c1 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:16.510786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d15e0-23ca-4cb4-904f-923b7dbf5486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:16.511395 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d15e0-23ca-4cb4-904f-923b7dbf5486 None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:16.511705 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d15e0-23ca-4cb4-904f-923b7dbf5486 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:16.511974 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d15e0-23ca-4cb4-904f-923b7dbf5486 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:16.512648 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d15e0-23ca-4cb4-904f-923b7dbf5486 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:16.513999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d15e0-23ca-4cb4-904f-923b7dbf5486 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:16.533492 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38aed64-cb19-49b4-9710-b07c7937d619 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:16.567597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdea675-0b59-485e-ab97-91448e10975b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:16.568228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdea675-0b59-485e-ab97-91448e10975b None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:16.568502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdea675-0b59-485e-ab97-91448e10975b None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:16.568769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdea675-0b59-485e-ab97-91448e10975b None admin] PATH_INFO: `/v3/services/image` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:16.569344 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdea675-0b59-485e-ab97-91448e10975b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:16.570810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdea675-0b59-485e-ab97-91448e10975b None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:16.579459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-5fdea675-0b59-485e-ab97-91448e10975b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 19:35:16.579459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:16.579459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:35:16.579459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:35:16.579459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:35:16.579459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:35:16.579459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:35:16.579459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:16.579459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 19:35:16.579459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:16.579459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:35:16.579459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:16.579459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:16.579459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:16.579459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:16.579459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:16.579459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:16.580641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:16.580641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:16.580641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:16.580641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:16.580641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:16.580641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:16.580641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:35:16.580641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:35:16.580641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:35:16.580641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:35:16.580641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:16.580641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:16.580641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:16.580641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:16.580641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:16.580641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:16.581665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:16.581665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:16.581665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:16.581665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:16.581665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:16.581665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:16.581665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:16.581665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:16.581665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:16.581665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:16.581665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:35:16.581665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:16.581665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 19:35:16.581665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:16.583834 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 501/1004] 10.222.0.15 () {56 vars in 1105 bytes} [Wed Sep 14 19:35:16 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:35:16.586448 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdea675-0b59-485e-ab97-91448e10975b None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:16.622030 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 504/1005] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:35:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:35:16.674865 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:16.718303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdea675-0b59-485e-ab97-91448e10975b None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:16.762598 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4ba3d-a1da-4f9f-be59-7be4af9fe265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:16.763228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4ba3d-a1da-4f9f-be59-7be4af9fe265 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:16.763505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4ba3d-a1da-4f9f-be59-7be4af9fe265 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:16.763805 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4ba3d-a1da-4f9f-be59-7be4af9fe265 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:16.764447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4ba3d-a1da-4f9f-be59-7be4af9fe265 None admin] RBAC: Adding query filter params (name=image) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:16.764751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4ba3d-a1da-4f9f-be59-7be4af9fe265 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:16.766155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4ba3d-a1da-4f9f-be59-7be4af9fe265 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:16.776951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 502/1006] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:16.778656 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d15e0-23ca-4cb4-904f-923b7dbf5486 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:16.790900 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:16.885442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d15e0-23ca-4cb4-904f-923b7dbf5486 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:16.923695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1c112-1c3f-4c61-a370-6fef1ccd6809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:16.924320 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1c112-1c3f-4c61-a370-6fef1ccd6809 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:16.924599 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1c112-1c3f-4c61-a370-6fef1ccd6809 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:16.924872 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1c112-1c3f-4c61-a370-6fef1ccd6809 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:16.925508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1c112-1c3f-4c61-a370-6fef1ccd6809 None admin] RBAC: Adding query filter params (type=image) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:16.925811 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1c112-1c3f-4c61-a370-6fef1ccd6809 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:16.927171 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1c112-1c3f-4c61-a370-6fef1ccd6809 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:16.932523 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 505/1007] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:16 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:17.509840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed85ce3-7db5-4f2f-8646-92028e08a37b None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:17.510386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed85ce3-7db5-4f2f-8646-92028e08a37b None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:17.510386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed85ce3-7db5-4f2f-8646-92028e08a37b None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:17.511992 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 503/1008] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:17.517200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b2878-9e7f-4265-8d7c-7c48cb0d20cb None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:17.517577 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b2878-9e7f-4265-8d7c-7c48cb0d20cb None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:17.517757 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b2878-9e7f-4265-8d7c-7c48cb0d20cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:17.536084 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-7a6b2878-9e7f-4265-8d7c-7c48cb0d20cb None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:17.537279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-7a6b2878-9e7f-4265-8d7c-7c48cb0d20cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:17.605661 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 506/1009] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:17 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:17.890624 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed85ce3-7db5-4f2f-8646-92028e08a37b None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:17.998432 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed85ce3-7db5-4f2f-8646-92028e08a37b None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:18.031955 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:18.037884 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645532a-69b7-4140-8775-dea5708885f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:18.040698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645532a-69b7-4140-8775-dea5708885f0 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:18.040698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645532a-69b7-4140-8775-dea5708885f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:18.040698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645532a-69b7-4140-8775-dea5708885f0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:18.040698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645532a-69b7-4140-8775-dea5708885f0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:18.041731 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645532a-69b7-4140-8775-dea5708885f0 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:18.051113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-c645532a-69b7-4140-8775-dea5708885f0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 19:35:18.051113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:18.051113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:35:18.051113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:35:18.051113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:35:18.051113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:35:18.051113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:35:18.051113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:18.051113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 19:35:18.051113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:18.051113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:35:18.051113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:18.051113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:18.051113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:18.051113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:18.051113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:18.051113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:18.052547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:18.052547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:18.052547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:18.052547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:18.052547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:18.052547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:18.052547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:35:18.052547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:35:18.052547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:35:18.052547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:35:18.052547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:18.052547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:18.052547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:18.052547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:18.052547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:18.052547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:18.054018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:18.054018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:18.054018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:18.054018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:18.054018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:18.054018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:18.054018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:18.054018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:18.054018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:18.054018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:18.054018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:35:18.054018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:18.054018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 19:35:18.054018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:18.061601 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 504/1010] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Sep 14 19:35:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:18.061875 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b2878-9e7f-4265-8d7c-7c48cb0d20cb None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:18.061875 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:18.174649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b2878-9e7f-4265-8d7c-7c48cb0d20cb None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:18.209027 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6a17e-8fa6-4cbb-847a-dff95fa601e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:18.209643 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6a17e-8fa6-4cbb-847a-dff95fa601e8 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:18.209924 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6a17e-8fa6-4cbb-847a-dff95fa601e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:18.210199 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6a17e-8fa6-4cbb-847a-dff95fa601e8 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:18.210939 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6a17e-8fa6-4cbb-847a-dff95fa601e8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:18.211667 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6a17e-8fa6-4cbb-847a-dff95fa601e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:18.213040 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6a17e-8fa6-4cbb-847a-dff95fa601e8 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:18.222512 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 507/1011] 10.222.0.15 () {56 vars in 1122 bytes} [Wed Sep 14 19:35:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:18.223796 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645532a-69b7-4140-8775-dea5708885f0 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:18.327694 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645532a-69b7-4140-8775-dea5708885f0 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:18.362940 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1087837-40aa-4f8a-b689-00b74ecd81b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:18.363536 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1087837-40aa-4f8a-b689-00b74ecd81b3 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:18.363836 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1087837-40aa-4f8a-b689-00b74ecd81b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:18.364103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1087837-40aa-4f8a-b689-00b74ecd81b3 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:18.364722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1087837-40aa-4f8a-b689-00b74ecd81b3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:18.365018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1087837-40aa-4f8a-b689-00b74ecd81b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:18.366368 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1087837-40aa-4f8a-b689-00b74ecd81b3 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:18.371805 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 505/1012] 10.222.0.15 () {56 vars in 1122 bytes} [Wed Sep 14 19:35:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:18.379625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6a17e-8fa6-4cbb-847a-dff95fa601e8 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:18.454983 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:18.491248 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6a17e-8fa6-4cbb-847a-dff95fa601e8 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:18.525044 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922da32-72d5-4705-b9cc-0ced177bbcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:18.525709 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922da32-72d5-4705-b9cc-0ced177bbcea None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:18.525951 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922da32-72d5-4705-b9cc-0ced177bbcea None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:18.526183 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922da32-72d5-4705-b9cc-0ced177bbcea None admin] PATH_INFO: `/v3/endpoints` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:18.526852 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922da32-72d5-4705-b9cc-0ced177bbcea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:18.528240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922da32-72d5-4705-b9cc-0ced177bbcea None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:18.615573 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 508/1013] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:35:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:35:18.902762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eab2c1-ab16-4574-8fa3-2ef7a59ce711 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:18.903295 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eab2c1-ab16-4574-8fa3-2ef7a59ce711 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:18.903295 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eab2c1-ab16-4574-8fa3-2ef7a59ce711 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:18.904762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 506/1014] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:18.910257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b3125-866e-4e33-88b9-6fece9fa08cd None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:18.910541 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b3125-866e-4e33-88b9-6fece9fa08cd None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:18.910814 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b3125-866e-4e33-88b9-6fece9fa08cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:18.930750 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-cf4b3125-866e-4e33-88b9-6fece9fa08cd None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:18.931988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-cf4b3125-866e-4e33-88b9-6fece9fa08cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:19.007000 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 509/1015] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:18 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:19.153271 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900efad-76bd-4bd7-a789-fab7acf11991 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:19.153463 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900efad-76bd-4bd7-a789-fab7acf11991 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:19.153736 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900efad-76bd-4bd7-a789-fab7acf11991 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:19.155219 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 507/1016] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:19.160581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25be118-dbcd-421d-8e6a-3840e30063b1 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:19.160872 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25be118-dbcd-421d-8e6a-3840e30063b1 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:19.161148 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25be118-dbcd-421d-8e6a-3840e30063b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:19.179177 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-a25be118-dbcd-421d-8e6a-3840e30063b1 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:19.181034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a25be118-dbcd-421d-8e6a-3840e30063b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:19.228429 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:19.248238 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 510/1017] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:19 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:19.277006 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900efad-76bd-4bd7-a789-fab7acf11991 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:19.338650 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:19.388291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900efad-76bd-4bd7-a789-fab7acf11991 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:19.423829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c7613-e577-4da5-a221-8f192d272542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:19.424378 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c7613-e577-4da5-a221-8f192d272542 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:19.424657 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c7613-e577-4da5-a221-8f192d272542 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:19.424927 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c7613-e577-4da5-a221-8f192d272542 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:19.435006 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c7613-e577-4da5-a221-8f192d272542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:35:19.439821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-8b6c7613-e577-4da5-a221-8f192d272542 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 19:35:19.439821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:19.439821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:19.439821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:19.439821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:19.439821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:19.439821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:19.439821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:19.439821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:19.439821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:19.439821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:19.439821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:19.439821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:35:19.439821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:35:19.439821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:35:19.439821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:35:19.440743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:35:19.440743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:35:19.440743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:35:19.440743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:35:19.440743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:19.440743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:19.440743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:19.440743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:19.440743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:19.440743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:19.440743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:19.440743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:19.440743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:19.440743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:19.440743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:19.440743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:19.441600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:19.441600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:19.441600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:19.441600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:19.441600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:35:19.441600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:35:19.441600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:35:19.441600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:35:19.441600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:35:19.441600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:35:19.441600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 19:35:19.441600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:19.443893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 508/1018] 10.222.0.15 () {56 vars in 1120 bytes} [Wed Sep 14 19:35:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:19.447285 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25be118-dbcd-421d-8e6a-3840e30063b1 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:19.516585 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c7613-e577-4da5-a221-8f192d272542 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:19.557276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25be118-dbcd-421d-8e6a-3840e30063b1 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:19.597706 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba07f8-bf85-4b93-91a7-3e2f3ab163e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:19.599067 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba07f8-bf85-4b93-91a7-3e2f3ab163e9 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:19.599640 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba07f8-bf85-4b93-91a7-3e2f3ab163e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:19.600091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba07f8-bf85-4b93-91a7-3e2f3ab163e9 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:19.600917 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba07f8-bf85-4b93-91a7-3e2f3ab163e9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:19.601384 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba07f8-bf85-4b93-91a7-3e2f3ab163e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:19.602928 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba07f8-bf85-4b93-91a7-3e2f3ab163e9 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:19.612546 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 511/1019] 10.222.0.15 () {56 vars in 1115 bytes} [Wed Sep 14 19:35:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:19.618176 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba07f8-bf85-4b93-91a7-3e2f3ab163e9 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:19.619614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c7613-e577-4da5-a221-8f192d272542 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:19.642211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:19.656262 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e26d1-161d-4687-a882-735857569f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:19.656870 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e26d1-161d-4687-a882-735857569f4d None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:19.657142 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e26d1-161d-4687-a882-735857569f4d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:19.657409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e26d1-161d-4687-a882-735857569f4d None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:19.658084 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e26d1-161d-4687-a882-735857569f4d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:19.659747 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e26d1-161d-4687-a882-735857569f4d None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:19.668392 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:19.721356 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba07f8-bf85-4b93-91a7-3e2f3ab163e9 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:19.734597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 509/1020] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Sep 14 19:35:19 2022] POST /identity/v3/services => generated 242 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:35:19.770674 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467816b-e73c-40a0-b814-07f395cb30a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:19.771330 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467816b-e73c-40a0-b814-07f395cb30a2 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:19.771635 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467816b-e73c-40a0-b814-07f395cb30a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:19.771908 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467816b-e73c-40a0-b814-07f395cb30a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:19.785214 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467816b-e73c-40a0-b814-07f395cb30a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:19.786675 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467816b-e73c-40a0-b814-07f395cb30a2 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:19.803746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-f467816b-e73c-40a0-b814-07f395cb30a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:19.803746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:19.803746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:19.803746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:19.803746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:19.803746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:19.803746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:19.803746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:19.803746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:19.803746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:19.803746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:19.803746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:19.803746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:35:19.803746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:35:19.803746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:35:19.803746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:35:19.804804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:19.804804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:19.804804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:19.804804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:19.804804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:19.804804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:19.804804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:19.804804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:19.804804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:19.804804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:19.804804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:19.804804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:19.804804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:19.804804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:19.804804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:19.804804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:19.804804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:35:19.810775 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:35:19.810775 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:19.810775 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:19.810775 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 512/1021] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:35:19.812933 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e26d1-161d-4687-a882-735857569f4d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:19.933737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e26d1-161d-4687-a882-735857569f4d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:19.970735 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6aace-500f-4f69-8f0c-867472862d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:19.971410 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6aace-500f-4f69-8f0c-867472862d7a None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:19.971668 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6aace-500f-4f69-8f0c-867472862d7a None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:19.971942 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6aace-500f-4f69-8f0c-867472862d7a None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:19.972591 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6aace-500f-4f69-8f0c-867472862d7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:19.972894 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6aace-500f-4f69-8f0c-867472862d7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:19.974259 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6aace-500f-4f69-8f0c-867472862d7a None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:19.991075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 510/1022] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:19.992883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467816b-e73c-40a0-b814-07f395cb30a2 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:20.087556 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:20.096268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467816b-e73c-40a0-b814-07f395cb30a2 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:20.129554 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27001be8-d8c1-4abe-95cd-68eaf3f901b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:20.130495 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27001be8-d8c1-4abe-95cd-68eaf3f901b0 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:20.130960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27001be8-d8c1-4abe-95cd-68eaf3f901b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:20.131406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27001be8-d8c1-4abe-95cd-68eaf3f901b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:20.139833 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27001be8-d8c1-4abe-95cd-68eaf3f901b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:20.141477 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27001be8-d8c1-4abe-95cd-68eaf3f901b0 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:20.152629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-27001be8-d8c1-4abe-95cd-68eaf3f901b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 19:35:20.152629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:20.152629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:20.152629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:20.152629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:20.152629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:20.152629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:20.152629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:20.152629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:20.152629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:20.152629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:20.152629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:20.152629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:35:20.152629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:35:20.152629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:35:20.152629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:35:20.153560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:20.153560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:20.153560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:35:20.153560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:35:20.153560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:35:20.153560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:35:20.153560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:20.153560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:20.153560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:20.153560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:20.153560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:20.153560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:20.153560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:20.153560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:20.153560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:20.153560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:20.153560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:20.153560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:20.154515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:20.154515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:20.154515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:35:20.154515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:35:20.154515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:35:20.154515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:35:20.154515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:35:20.154515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:35:20.154515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 19:35:20.154515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:20.156305 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 513/1023] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Sep 14 19:35:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:20.162186 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6aace-500f-4f69-8f0c-867472862d7a None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:20.205361 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:20.265347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6aace-500f-4f69-8f0c-867472862d7a None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:20.300144 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1eb85e-f878-4c7b-9c71-28b99ecd52d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:20.300750 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eb85e-f878-4c7b-9c71-28b99ecd52d3 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:20.301022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eb85e-f878-4c7b-9c71-28b99ecd52d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:20.301290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eb85e-f878-4c7b-9c71-28b99ecd52d3 None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:20.302007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1eb85e-f878-4c7b-9c71-28b99ecd52d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:20.302308 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1eb85e-f878-4c7b-9c71-28b99ecd52d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:20.303824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1eb85e-f878-4c7b-9c71-28b99ecd52d3 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:20.322445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 511/1024] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Sep 14 19:35:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:20.327849 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27001be8-d8c1-4abe-95cd-68eaf3f901b0 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:20.434243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27001be8-d8c1-4abe-95cd-68eaf3f901b0 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:20.469365 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8196f-8c84-44fa-8495-40fad0921f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:20.469988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8196f-8c84-44fa-8495-40fad0921f63 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:20.470269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8196f-8c84-44fa-8495-40fad0921f63 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:20.470547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8196f-8c84-44fa-8495-40fad0921f63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:20.493246 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:20.541154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8196f-8c84-44fa-8495-40fad0921f63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:20.542527 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8196f-8c84-44fa-8495-40fad0921f63 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:20.641948 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 514/1025] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:35:20 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 19:35:20.647700 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1eb85e-f878-4c7b-9c71-28b99ecd52d3 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:20.749118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:20.753878 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1eb85e-f878-4c7b-9c71-28b99ecd52d3 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:20.795128 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71703807-c5f2-4fb4-8283-6a2c41ca156e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:20.795857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71703807-c5f2-4fb4-8283-6a2c41ca156e None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:20.796136 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71703807-c5f2-4fb4-8283-6a2c41ca156e None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:20.796408 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71703807-c5f2-4fb4-8283-6a2c41ca156e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:20.810620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71703807-c5f2-4fb4-8283-6a2c41ca156e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:20.812119 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71703807-c5f2-4fb4-8283-6a2c41ca156e None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:20.829268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-71703807-c5f2-4fb4-8283-6a2c41ca156e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:20.829268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:20.829268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:20.829268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:20.829268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:20.829268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:20.829268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:20.829268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:20.829268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:20.829268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:20.829268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:20.829268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:20.829268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:35:20.829268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:35:20.829268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:35:20.829268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:35:20.833116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:20.833116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:20.833116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:20.833116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:20.833116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:20.833116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:20.833116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:20.833116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:20.833116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:20.833116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:20.833116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:20.833116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:20.833116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:20.833116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:20.833116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:20.833116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:20.833116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:35:20.834184 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:35:20.834184 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:20.834184 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:20.834184 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 512/1026] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:20.837766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8196f-8c84-44fa-8495-40fad0921f63 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:20.865621 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915c8c0-462d-49bb-bdfa-f9c9fa92a64f None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:20.865906 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915c8c0-462d-49bb-bdfa-f9c9fa92a64f None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:20.866184 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915c8c0-462d-49bb-bdfa-f9c9fa92a64f None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:20.868211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 513/1027] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:20.873012 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9af4bd-af02-475f-ab1c-846a1dba44cb None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:20.873294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9af4bd-af02-475f-ab1c-846a1dba44cb None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:20.873566 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9af4bd-af02-475f-ab1c-846a1dba44cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:20.892477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-dd9af4bd-af02-475f-ab1c-846a1dba44cb None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:20.893666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-dd9af4bd-af02-475f-ab1c-846a1dba44cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:20.897531 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:20.949638 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8196f-8c84-44fa-8495-40fad0921f63 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:20.963190 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 514/1028] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 19:35:20.985321 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806a25c-b2cc-41ef-81f3-e2c5746fd230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:20.985936 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806a25c-b2cc-41ef-81f3-e2c5746fd230 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:20.986208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806a25c-b2cc-41ef-81f3-e2c5746fd230 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:20.986479 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806a25c-b2cc-41ef-81f3-e2c5746fd230 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:20.987117 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806a25c-b2cc-41ef-81f3-e2c5746fd230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:20.987419 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806a25c-b2cc-41ef-81f3-e2c5746fd230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:20.988793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806a25c-b2cc-41ef-81f3-e2c5746fd230 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:21.001122 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 515/1029] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:21.006463 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9af4bd-af02-475f-ab1c-846a1dba44cb None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:21.089556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:21.108492 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9af4bd-af02-475f-ab1c-846a1dba44cb None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:21.142996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98566974-196e-4b30-b234-321401bcbd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:21.143654 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98566974-196e-4b30-b234-321401bcbd16 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:21.143931 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98566974-196e-4b30-b234-321401bcbd16 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:21.144197 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98566974-196e-4b30-b234-321401bcbd16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:21.151517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98566974-196e-4b30-b234-321401bcbd16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:21.152967 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98566974-196e-4b30-b234-321401bcbd16 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:21.164291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-98566974-196e-4b30-b234-321401bcbd16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:35:21.164291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:21.164291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:21.164291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:21.164291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:21.164291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:21.164291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:21.164291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:21.164291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:21.164291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:21.164291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:21.164291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:21.164291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:35:21.164291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:35:21.164291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:35:21.165283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:35:21.165283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:21.165283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:21.165283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:21.165283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:21.165283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:21.165283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:21.165283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:21.165283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:21.165283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:21.165283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:21.165283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:21.165283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:21.165283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:21.165283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:21.165283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:21.165283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:21.170886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:35:21.170886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:35:21.170886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:35:21.170886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:35:21.170886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:35:21.170886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:35:21.170886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:35:21.170886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:21.170886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 515/1030] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:35:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:21.171407 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806a25c-b2cc-41ef-81f3-e2c5746fd230 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:21.233272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98566974-196e-4b30-b234-321401bcbd16 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:21.277008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806a25c-b2cc-41ef-81f3-e2c5746fd230 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:21.292076 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:21.314541 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfc7ed-57ba-49ed-9314-17c97df1bc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:21.315446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfc7ed-57ba-49ed-9314-17c97df1bc9f None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:21.315936 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfc7ed-57ba-49ed-9314-17c97df1bc9f None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:21.316394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfc7ed-57ba-49ed-9314-17c97df1bc9f None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:21.317264 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfc7ed-57ba-49ed-9314-17c97df1bc9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:21.317949 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfc7ed-57ba-49ed-9314-17c97df1bc9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:21.319580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfc7ed-57ba-49ed-9314-17c97df1bc9f None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:21.334271 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 516/1031] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:35:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:21.340404 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfc7ed-57ba-49ed-9314-17c97df1bc9f None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:21.351822 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98566974-196e-4b30-b234-321401bcbd16 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:21.393649 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed63e94-cafa-4675-959d-b7bf95ca13a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:21.394282 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed63e94-cafa-4675-959d-b7bf95ca13a1 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:21.394560 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed63e94-cafa-4675-959d-b7bf95ca13a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:21.394831 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed63e94-cafa-4675-959d-b7bf95ca13a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:21.396073 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed63e94-cafa-4675-959d-b7bf95ca13a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:21.397792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed63e94-cafa-4675-959d-b7bf95ca13a1 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:21.403595 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 516/1032] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:21.405717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed63e94-cafa-4675-959d-b7bf95ca13a1 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:21.418227 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:21.450496 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfc7ed-57ba-49ed-9314-17c97df1bc9f None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:21.488921 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9951b-7755-4152-b13d-dbc0c1f577e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:21.489877 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9951b-7755-4152-b13d-dbc0c1f577e2 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:21.490200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9951b-7755-4152-b13d-dbc0c1f577e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:21.490487 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9951b-7755-4152-b13d-dbc0c1f577e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:21.491516 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9951b-7755-4152-b13d-dbc0c1f577e2 None admin] RBAC: Adding query filter params (role.id=bbffc2c569f64cd89c9598d29c9aa6fc, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=421f6cc846b342918a177d2794eb3db8) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:21.491867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9951b-7755-4152-b13d-dbc0c1f577e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:21.493876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9951b-7755-4152-b13d-dbc0c1f577e2 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:21.500086 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 517/1033] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:35:21 2022] GET /identity/v3/role_assignments?user.id=421f6cc846b342918a177d2794eb3db8&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=bbffc2c569f64cd89c9598d29c9aa6fc => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:21.518777 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed63e94-cafa-4675-959d-b7bf95ca13a1 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:21.560639 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2928e-1351-4c74-9fcc-a61fa78d3773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:21.561279 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2928e-1351-4c74-9fcc-a61fa78d3773 None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:21.561552 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2928e-1351-4c74-9fcc-a61fa78d3773 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:21.561821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2928e-1351-4c74-9fcc-a61fa78d3773 None admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:21.562496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2928e-1351-4c74-9fcc-a61fa78d3773 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:21.564018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2928e-1351-4c74-9fcc-a61fa78d3773 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:21.643658 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 517/1034] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Sep 14 19:35:21 2022] POST /identity/v3/projects => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:35:21.951031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd466b8-b86e-4471-bd40-0d313ef01cf4 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:21.951530 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd466b8-b86e-4471-bd40-0d313ef01cf4 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:21.951530 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd466b8-b86e-4471-bd40-0d313ef01cf4 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:21.953025 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 518/1035] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:21.958265 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e413f11-7c4d-4e43-93d4-49b92a03991b None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:21.958616 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e413f11-7c4d-4e43-93d4-49b92a03991b None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:21.958957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e413f11-7c4d-4e43-93d4-49b92a03991b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:21.978013 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-8e413f11-7c4d-4e43-93d4-49b92a03991b None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:21.979955 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-8e413f11-7c4d-4e43-93d4-49b92a03991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:22.040559 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:22.052183 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 518/1036] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:22.329753 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd466b8-b86e-4471-bd40-0d313ef01cf4 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:22.383326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:22.440937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd466b8-b86e-4471-bd40-0d313ef01cf4 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:22.476546 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6bb12-c16f-409b-af75-66a83899661e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:22.477379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6bb12-c16f-409b-af75-66a83899661e None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:22.477661 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6bb12-c16f-409b-af75-66a83899661e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:22.477933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6bb12-c16f-409b-af75-66a83899661e None admin] PATH_INFO: `/v3/services/image` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:22.478513 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6bb12-c16f-409b-af75-66a83899661e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:22.480049 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6bb12-c16f-409b-af75-66a83899661e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:22.488645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-a8f6bb12-c16f-409b-af75-66a83899661e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 19:35:22.488645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:22.488645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:35:22.488645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:35:22.488645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:35:22.488645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:35:22.488645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:35:22.488645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:22.488645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 19:35:22.488645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:22.488645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:35:22.488645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:22.488645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:22.488645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:22.488645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:22.488645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:22.488645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:22.489704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:22.489704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:22.489704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:22.489704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:22.489704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:22.489704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:22.489704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:35:22.489704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:35:22.489704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:35:22.489704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:35:22.489704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:22.489704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:22.489704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:22.489704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:22.489704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:22.489704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:22.490588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:22.490588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:22.490588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:22.490588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:22.490588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:22.490588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:22.490588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:22.490588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:22.490588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:22.490588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:22.490588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:35:22.490588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:22.490588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 19:35:22.490588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:22.492227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 519/1037] 10.222.0.15 () {56 vars in 1105 bytes} [Wed Sep 14 19:35:22 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:22.495929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e413f11-7c4d-4e43-93d4-49b92a03991b None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:22.598075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e413f11-7c4d-4e43-93d4-49b92a03991b None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:22.637609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7ff9f-644d-4504-b593-f366abebb4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:22.638222 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7ff9f-644d-4504-b593-f366abebb4f3 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:22.638498 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7ff9f-644d-4504-b593-f366abebb4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:22.638767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7ff9f-644d-4504-b593-f366abebb4f3 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:22.639394 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7ff9f-644d-4504-b593-f366abebb4f3 None admin] RBAC: Adding query filter params (name=image) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:22.639724 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7ff9f-644d-4504-b593-f366abebb4f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:22.641076 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7ff9f-644d-4504-b593-f366abebb4f3 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:22.650053 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 519/1038] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:22.652283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6bb12-c16f-409b-af75-66a83899661e None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:22.750465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:22.754146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6bb12-c16f-409b-af75-66a83899661e None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:22.787333 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15af5e7-bc4a-46a7-b5a2-382ba7880fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:22.787968 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15af5e7-bc4a-46a7-b5a2-382ba7880fad None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:22.788243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15af5e7-bc4a-46a7-b5a2-382ba7880fad None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:22.788507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15af5e7-bc4a-46a7-b5a2-382ba7880fad None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:22.789121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15af5e7-bc4a-46a7-b5a2-382ba7880fad None admin] RBAC: Adding query filter params (type=image) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:22.789492 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15af5e7-bc4a-46a7-b5a2-382ba7880fad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:22.790848 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15af5e7-bc4a-46a7-b5a2-382ba7880fad None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:22.795714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 520/1039] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:22.801485 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7ff9f-644d-4504-b593-f366abebb4f3 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:22.857599 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:22.901640 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7ff9f-644d-4504-b593-f366abebb4f3 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:22.936250 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a37f6b-f9bf-4266-8416-d5912bc2edf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:22.936856 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a37f6b-f9bf-4266-8416-d5912bc2edf0 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:22.937130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a37f6b-f9bf-4266-8416-d5912bc2edf0 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:22.937398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a37f6b-f9bf-4266-8416-d5912bc2edf0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:22.938086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a37f6b-f9bf-4266-8416-d5912bc2edf0 None admin] RBAC: Adding query filter params (interface=public, service_id=e7a58795f3104f50a6df4a5563fe32cc, region_id=RegionOne) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:22.938392 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a37f6b-f9bf-4266-8416-d5912bc2edf0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:22.939797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a37f6b-f9bf-4266-8416-d5912bc2edf0 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:22.944932 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 520/1040] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Sep 14 19:35:22 2022] GET /identity/v3/endpoints?service_id=e7a58795f3104f50a6df4a5563fe32cc&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:22.951128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15af5e7-bc4a-46a7-b5a2-382ba7880fad None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:23.051554 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15af5e7-bc4a-46a7-b5a2-382ba7880fad None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:23.084529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f580a5-dfac-4605-88cb-01a016982573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:23.085139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f580a5-dfac-4605-88cb-01a016982573 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:23.085415 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f580a5-dfac-4605-88cb-01a016982573 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:23.085681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f580a5-dfac-4605-88cb-01a016982573 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:23.086795 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f580a5-dfac-4605-88cb-01a016982573 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:23.088240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f580a5-dfac-4605-88cb-01a016982573 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:23.103614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 521/1041] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Sep 14 19:35:22 2022] GET /identity/v3/services => generated 1957 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:35:23.647491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19314d-ab8f-4891-9507-ea67ed9e7be2 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:23.648032 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19314d-ab8f-4891-9507-ea67ed9e7be2 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:23.648032 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19314d-ab8f-4891-9507-ea67ed9e7be2 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:23.650063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 521/1042] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:23.654990 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a217ae5-ec6f-43c7-b303-e3fed00d9b65 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:23.655277 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a217ae5-ec6f-43c7-b303-e3fed00d9b65 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:23.655573 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a217ae5-ec6f-43c7-b303-e3fed00d9b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:23.674270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-3a217ae5-ec6f-43c7-b303-e3fed00d9b65 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:23.675468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-3a217ae5-ec6f-43c7-b303-e3fed00d9b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:23.699385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:23.744259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 522/1043] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:23.884252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbb0c5-639f-4c9d-aa5d-60c5145ca3aa None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:23.884636 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbb0c5-639f-4c9d-aa5d-60c5145ca3aa None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:23.884893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbb0c5-639f-4c9d-aa5d-60c5145ca3aa None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:23.886386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 522/1044] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:23.891434 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd723b-64cf-4e2f-a6ef-b29ce560cbc4 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:23.891753 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd723b-64cf-4e2f-a6ef-b29ce560cbc4 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:23.892033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd723b-64cf-4e2f-a6ef-b29ce560cbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:23.910456 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-1ffd723b-64cf-4e2f-a6ef-b29ce560cbc4 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:23.911601 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-1ffd723b-64cf-4e2f-a6ef-b29ce560cbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:23.980455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 523/1045] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:24.021339 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbb0c5-639f-4c9d-aa5d-60c5145ca3aa None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:24.140107 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbb0c5-639f-4c9d-aa5d-60c5145ca3aa None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:24.157920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:24.175196 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19443c40-9ea9-484f-9c67-abe1738dab1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:24.175925 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19443c40-9ea9-484f-9c67-abe1738dab1b None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:24.176211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19443c40-9ea9-484f-9c67-abe1738dab1b None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:24.176483 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19443c40-9ea9-484f-9c67-abe1738dab1b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:24.186770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19443c40-9ea9-484f-9c67-abe1738dab1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:35:24.192070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-19443c40-9ea9-484f-9c67-abe1738dab1b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 19:35:24.192070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:24.192070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:24.192070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:24.192070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:24.192070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:24.192070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:24.192070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:24.192070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:24.192070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:24.192070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:24.192070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:24.192070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:35:24.192070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:35:24.192070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:35:24.192070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:35:24.193070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:35:24.193070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:35:24.193070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:35:24.193070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:35:24.193070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:24.193070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:24.193070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:24.193070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:24.193070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:24.193070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:24.193070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:24.193070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:24.193070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:24.193070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:24.193070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:24.193070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:24.193951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:24.193951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:24.193951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:24.193951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:24.193951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:35:24.193951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:35:24.193951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:35:24.193951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:35:24.193951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:35:24.193951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:35:24.193951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 19:35:24.193951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:24.196430 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 523/1046] 10.222.0.15 () {56 vars in 1120 bytes} [Wed Sep 14 19:35:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:24.199785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd723b-64cf-4e2f-a6ef-b29ce560cbc4 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:24.257375 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19443c40-9ea9-484f-9c67-abe1738dab1b None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:24.289813 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:24.302059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd723b-64cf-4e2f-a6ef-b29ce560cbc4 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:24.339651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc18107-b81c-4687-832f-7cfd4374e3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:24.340277 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc18107-b81c-4687-832f-7cfd4374e3a7 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:24.340559 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc18107-b81c-4687-832f-7cfd4374e3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:24.340837 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc18107-b81c-4687-832f-7cfd4374e3a7 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:24.341501 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc18107-b81c-4687-832f-7cfd4374e3a7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:24.341808 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc18107-b81c-4687-832f-7cfd4374e3a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:24.343174 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc18107-b81c-4687-832f-7cfd4374e3a7 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:24.356782 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 524/1047] 10.222.0.15 () {56 vars in 1115 bytes} [Wed Sep 14 19:35:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:24.358947 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc18107-b81c-4687-832f-7cfd4374e3a7 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:24.388049 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19443c40-9ea9-484f-9c67-abe1738dab1b None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:24.426869 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9299fa1-858c-4cbf-be1a-9c33f0f53001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:24.427426 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9299fa1-858c-4cbf-be1a-9c33f0f53001 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:24.427752 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9299fa1-858c-4cbf-be1a-9c33f0f53001 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:24.428028 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9299fa1-858c-4cbf-be1a-9c33f0f53001 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:24.429364 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9299fa1-858c-4cbf-be1a-9c33f0f53001 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:24.431109 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9299fa1-858c-4cbf-be1a-9c33f0f53001 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:24.435638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 524/1048] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:24.438251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9299fa1-858c-4cbf-be1a-9c33f0f53001 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:24.470734 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc18107-b81c-4687-832f-7cfd4374e3a7 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:24.488608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:24.506292 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8c971-5d0e-47df-9203-e52fe31a519c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:24.506920 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8c971-5d0e-47df-9203-e52fe31a519c None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:24.507192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8c971-5d0e-47df-9203-e52fe31a519c None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:24.507460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8c971-5d0e-47df-9203-e52fe31a519c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:24.517718 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8c971-5d0e-47df-9203-e52fe31a519c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:24.519143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8c971-5d0e-47df-9203-e52fe31a519c None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:24.534194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-eae8c971-5d0e-47df-9203-e52fe31a519c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:24.534194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:24.534194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:24.534194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:24.534194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:24.534194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:24.534194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:24.534194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:24.534194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:24.534194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:24.534194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:24.534194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:24.534194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:35:24.534194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:35:24.534194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:35:24.534194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:35:24.535146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:24.535146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:24.535146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:24.535146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:24.535146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:24.535146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:24.535146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:24.535146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:24.535146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:24.535146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:24.535146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:24.535146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:24.535146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:24.535146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:24.535146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:24.535146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:24.535146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:35:24.536077 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:35:24.536077 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:24.536077 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:24.536077 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 525/1049] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:35:24.541751 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8c971-5d0e-47df-9203-e52fe31a519c None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:24.544578 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:24.548488 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9299fa1-858c-4cbf-be1a-9c33f0f53001 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:24.583383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff27cf-1274-4ae3-a96c-abbd3512fb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:24.584028 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff27cf-1274-4ae3-a96c-abbd3512fb34 None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:24.584302 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff27cf-1274-4ae3-a96c-abbd3512fb34 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:24.584568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff27cf-1274-4ae3-a96c-abbd3512fb34 None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:24.585625 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff27cf-1274-4ae3-a96c-abbd3512fb34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:24.588049 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff27cf-1274-4ae3-a96c-abbd3512fb34 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:24.645654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8c971-5d0e-47df-9203-e52fe31a519c None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:24.680712 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201f9c1-16df-4791-8831-66e14c21c997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:24.681251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201f9c1-16df-4791-8831-66e14c21c997 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:24.681529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201f9c1-16df-4791-8831-66e14c21c997 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:24.681799 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201f9c1-16df-4791-8831-66e14c21c997 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:24.682440 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201f9c1-16df-4791-8831-66e14c21c997 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:24.682747 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201f9c1-16df-4791-8831-66e14c21c997 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:24.684148 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201f9c1-16df-4791-8831-66e14c21c997 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:24.697116 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 526/1050] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:24.702411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201f9c1-16df-4791-8831-66e14c21c997 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:24.707591 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 525/1051] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Sep 14 19:35:24 2022] POST /identity/v3/users => generated 285 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:35:24.777937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:24.822244 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201f9c1-16df-4791-8831-66e14c21c997 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:24.861413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f643062-9c9e-4cb7-8657-883fdbe61b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:24.862071 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f643062-9c9e-4cb7-8657-883fdbe61b40 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:24.862353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f643062-9c9e-4cb7-8657-883fdbe61b40 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:24.862628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f643062-9c9e-4cb7-8657-883fdbe61b40 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:24.871641 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f643062-9c9e-4cb7-8657-883fdbe61b40 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:24.873117 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f643062-9c9e-4cb7-8657-883fdbe61b40 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:24.886139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-2f643062-9c9e-4cb7-8657-883fdbe61b40 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 19:35:24.886139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:24.886139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:24.886139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:24.886139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:24.886139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:24.886139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:24.886139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:24.886139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:24.886139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:24.886139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:24.886139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:24.886139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:35:24.886139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:35:24.886139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:35:24.886139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:35:24.887137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:24.887137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:24.887137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:35:24.887137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:35:24.887137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:35:24.887137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:35:24.887137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:24.887137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:24.887137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:24.887137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:24.887137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:24.887137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:24.887137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:24.887137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:24.887137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:24.887137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:24.887137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:24.887137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:24.888154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:24.888154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:24.888154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:35:24.888154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:35:24.888154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:35:24.888154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:35:24.888154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:35:24.888154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:35:24.888154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 19:35:24.888154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:24.888154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 527/1052] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Sep 14 19:35:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:35:24.893433 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff27cf-1274-4ae3-a96c-abbd3512fb34 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:25.002140 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff27cf-1274-4ae3-a96c-abbd3512fb34 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:25.003985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:25.039098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e99ed-d526-4376-94c5-6cf6979a5882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:25.039770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e99ed-d526-4376-94c5-6cf6979a5882 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:25.040051 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e99ed-d526-4376-94c5-6cf6979a5882 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:25.040374 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e99ed-d526-4376-94c5-6cf6979a5882 None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:25.041114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e99ed-d526-4376-94c5-6cf6979a5882 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:25.041422 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e99ed-d526-4376-94c5-6cf6979a5882 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:25.042914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e99ed-d526-4376-94c5-6cf6979a5882 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:25.061554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 526/1053] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Sep 14 19:35:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:25.067370 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f643062-9c9e-4cb7-8657-883fdbe61b40 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:25.173343 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f643062-9c9e-4cb7-8657-883fdbe61b40 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:25.198317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:25.210447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03270c-fac5-4cef-8412-f907758da895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:25.211098 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03270c-fac5-4cef-8412-f907758da895 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:25.211379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03270c-fac5-4cef-8412-f907758da895 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:25.211740 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03270c-fac5-4cef-8412-f907758da895 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:25.222297 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03270c-fac5-4cef-8412-f907758da895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:25.223979 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03270c-fac5-4cef-8412-f907758da895 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:25.238937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-1b03270c-fac5-4cef-8412-f907758da895 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:25.238937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:25.238937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:25.238937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:25.238937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:25.238937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:25.238937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:25.238937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:25.238937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:25.238937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:25.238937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:25.238937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:25.238937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:35:25.238937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:35:25.238937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:35:25.238937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:35:25.240128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:25.240128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:25.240128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:25.240128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:25.240128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:25.240128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:25.240128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:25.240128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:25.240128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:25.240128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:25.240128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:25.240128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:25.240128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:25.240128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:25.240128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:25.240128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:25.240128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:35:25.241103 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:35:25.241103 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:25.241103 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:25.243633 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 528/1054] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:25.246790 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e99ed-d526-4376-94c5-6cf6979a5882 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:25.276327 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d873a24-d80f-4449-b491-bb4c4052a32a None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:25.276568 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d873a24-d80f-4449-b491-bb4c4052a32a None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:25.276802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d873a24-d80f-4449-b491-bb4c4052a32a None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:25.278143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 529/1055] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:35:25.283037 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25feea38-8ee2-4ee5-9895-6a7a365e7719 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:25.283320 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25feea38-8ee2-4ee5-9895-6a7a365e7719 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:25.283629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25feea38-8ee2-4ee5-9895-6a7a365e7719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:25.302989 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-25feea38-8ee2-4ee5-9895-6a7a365e7719 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:25.304242 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-25feea38-8ee2-4ee5-9895-6a7a365e7719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:25.356967 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e99ed-d526-4376-94c5-6cf6979a5882 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:25.387774 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 530/1056] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 19:35:25.394640 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aff649-998e-4ab4-abe8-b1a9c5ccbd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:25.395259 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aff649-998e-4ab4-abe8-b1a9c5ccbd11 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:25.395557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aff649-998e-4ab4-abe8-b1a9c5ccbd11 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:25.395843 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aff649-998e-4ab4-abe8-b1a9c5ccbd11 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:25.396483 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aff649-998e-4ab4-abe8-b1a9c5ccbd11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:25.396790 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aff649-998e-4ab4-abe8-b1a9c5ccbd11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:25.398157 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aff649-998e-4ab4-abe8-b1a9c5ccbd11 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:25.415205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 527/1057] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:25.416763 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25feea38-8ee2-4ee5-9895-6a7a365e7719 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:25.518162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25feea38-8ee2-4ee5-9895-6a7a365e7719 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:25.522437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:25.554101 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a696a6-5c9c-4d6f-8a74-4a62fa806d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:25.554664 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a696a6-5c9c-4d6f-8a74-4a62fa806d1b None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:25.554941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a696a6-5c9c-4d6f-8a74-4a62fa806d1b None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:25.555239 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a696a6-5c9c-4d6f-8a74-4a62fa806d1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:25.562146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a696a6-5c9c-4d6f-8a74-4a62fa806d1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:25.563631 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a696a6-5c9c-4d6f-8a74-4a62fa806d1b None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:25.575831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-57a696a6-5c9c-4d6f-8a74-4a62fa806d1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:35:25.575831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:25.575831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:25.575831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:25.575831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:25.575831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:25.575831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:25.575831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:25.575831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:25.575831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:25.575831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:25.575831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:25.575831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:35:25.575831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:35:25.575831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:35:25.576714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:35:25.576714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:25.576714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:25.576714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:25.576714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:25.576714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:25.576714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:25.576714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:25.576714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:25.576714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:25.576714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:25.576714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:25.576714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:25.576714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:25.576714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:25.576714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:25.576714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:25.582575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:35:25.582575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:35:25.582575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:35:25.582575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:35:25.582575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:35:25.582575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:35:25.582575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:35:25.582575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:25.582575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 531/1058] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:35:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:25.583063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aff649-998e-4ab4-abe8-b1a9c5ccbd11 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:25.606148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:25.656018 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a696a6-5c9c-4d6f-8a74-4a62fa806d1b None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:25.688168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aff649-998e-4ab4-abe8-b1a9c5ccbd11 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:25.728993 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b17ef-37a5-413e-8cec-0f3c33c92c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:25.730321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b17ef-37a5-413e-8cec-0f3c33c92c62 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:25.730635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b17ef-37a5-413e-8cec-0f3c33c92c62 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:25.730917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b17ef-37a5-413e-8cec-0f3c33c92c62 None admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:25.731636 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b17ef-37a5-413e-8cec-0f3c33c92c62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:25.731935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b17ef-37a5-413e-8cec-0f3c33c92c62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:25.733351 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b17ef-37a5-413e-8cec-0f3c33c92c62 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:25.745966 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 528/1059] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:35:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:25.752033 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b17ef-37a5-413e-8cec-0f3c33c92c62 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:25.764491 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a696a6-5c9c-4d6f-8a74-4a62fa806d1b None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:25.803869 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a1322-0c70-4525-90fc-e01f9d7c9c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:25.804553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a1322-0c70-4525-90fc-e01f9d7c9c13 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:25.804769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a1322-0c70-4525-90fc-e01f9d7c9c13 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:25.805038 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a1322-0c70-4525-90fc-e01f9d7c9c13 None admin] PATH_INFO: `/v3/services/image` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:25.806216 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a1322-0c70-4525-90fc-e01f9d7c9c13 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:25.807610 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a1322-0c70-4525-90fc-e01f9d7c9c13 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:25.817471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-287a1322-0c70-4525-90fc-e01f9d7c9c13 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 19:35:25.817471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:25.817471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:35:25.817471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:35:25.817471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:35:25.817471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:35:25.817471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:35:25.817471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:25.817471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 19:35:25.817471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:25.817471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:35:25.817471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:25.817471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:25.817471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:25.817471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:25.817471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:25.817471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:25.823816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:25.823816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:25.823816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:25.823816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:25.823816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:25.823816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:25.823816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:35:25.823816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:35:25.823816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:35:25.823816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:35:25.823816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:25.823816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:25.823816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:25.823816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:25.823816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:25.823816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:25.824904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:25.824904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:25.824904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:25.824904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:25.824904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:25.824904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:25.824904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:25.824904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:25.824904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:25.824904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:25.824904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:35:25.824904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:35:25.824904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 19:35:25.824904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:25.824904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 532/1060] 10.222.0.15 () {56 vars in 1105 bytes} [Wed Sep 14 19:35:25 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:35:25.826992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a1322-0c70-4525-90fc-e01f9d7c9c13 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:25.841310 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:25.855705 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:25.863461 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b17ef-37a5-413e-8cec-0f3c33c92c62 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:25.901035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10526920-77b4-443f-a2fc-af9b940b030d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:25.901982 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10526920-77b4-443f-a2fc-af9b940b030d None admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:25.902457 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10526920-77b4-443f-a2fc-af9b940b030d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:25.902979 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10526920-77b4-443f-a2fc-af9b940b030d None admin] PATH_INFO: `/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/421f6cc846b342918a177d2794eb3db8/roles/bbffc2c569f64cd89c9598d29c9aa6fc` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:25.905504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10526920-77b4-443f-a2fc-af9b940b030d None admin] RBAC: Authorizing `identity:create_grant(project_id=2e3e0c278ce94ce3a132496923eef365, user_id=421f6cc846b342918a177d2794eb3db8, role_id=bbffc2c569f64cd89c9598d29c9aa6fc)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:25.907223 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10526920-77b4-443f-a2fc-af9b940b030d None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:25.929532 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a1322-0c70-4525-90fc-e01f9d7c9c13 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:25.965921 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946695b-9910-4711-922d-7350bf5ae709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:25.966528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946695b-9910-4711-922d-7350bf5ae709 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:25.966803 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946695b-9910-4711-922d-7350bf5ae709 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:25.967098 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946695b-9910-4711-922d-7350bf5ae709 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:25.967762 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946695b-9910-4711-922d-7350bf5ae709 None admin] RBAC: Adding query filter params (name=image) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:25.968480 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946695b-9910-4711-922d-7350bf5ae709 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:25.969411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946695b-9910-4711-922d-7350bf5ae709 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:25.974356 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 533/1061] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:25.977495 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 529/1062] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:35:25 2022] PUT /identity/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/421f6cc846b342918a177d2794eb3db8/roles/bbffc2c569f64cd89c9598d29c9aa6fc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:35:25.980032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946695b-9910-4711-922d-7350bf5ae709 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:26.088737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:26.102276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946695b-9910-4711-922d-7350bf5ae709 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:26.139703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b0b8b-cb71-43e5-84be-7eb8e6440db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:26.140329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b0b8b-cb71-43e5-84be-7eb8e6440db7 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:26.140605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b0b8b-cb71-43e5-84be-7eb8e6440db7 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:26.140876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b0b8b-cb71-43e5-84be-7eb8e6440db7 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:26.141620 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b0b8b-cb71-43e5-84be-7eb8e6440db7 None admin] RBAC: Adding query filter params (type=image) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:26.141926 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b0b8b-cb71-43e5-84be-7eb8e6440db7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:26.143287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b0b8b-cb71-43e5-84be-7eb8e6440db7 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:26.150398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 534/1063] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:26.156204 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10526920-77b4-443f-a2fc-af9b940b030d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:26.260974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10526920-77b4-443f-a2fc-af9b940b030d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:26.295653 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28437415-1f5c-4d58-af0e-ea1d6da3d927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:26.296255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28437415-1f5c-4d58-af0e-ea1d6da3d927 None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:26.296528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28437415-1f5c-4d58-af0e-ea1d6da3d927 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:26.296796 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28437415-1f5c-4d58-af0e-ea1d6da3d927 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:26.297456 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28437415-1f5c-4d58-af0e-ea1d6da3d927 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:26.298816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28437415-1f5c-4d58-af0e-ea1d6da3d927 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:26.308535 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:26.383880 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 530/1064] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:35:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:35:27.034792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da938869-df77-43ac-8074-562892e9d166 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:27.035144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da938869-df77-43ac-8074-562892e9d166 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:27.035352 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da938869-df77-43ac-8074-562892e9d166 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:27.036764 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 535/1065] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:27.042758 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b7245-5c4c-4107-8c43-a3528e784af4 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:27.043216 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b7245-5c4c-4107-8c43-a3528e784af4 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:27.043319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b7245-5c4c-4107-8c43-a3528e784af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:27.062196 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-fa4b7245-5c4c-4107-8c43-a3528e784af4 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:27.063367 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-fa4b7245-5c4c-4107-8c43-a3528e784af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:27.136661 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 531/1066] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:27.403774 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da938869-df77-43ac-8074-562892e9d166 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:27.504989 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da938869-df77-43ac-8074-562892e9d166 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:27.538664 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdadee-e660-4337-99da-c716b929a56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:27.539302 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdadee-e660-4337-99da-c716b929a56c None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:27.539611 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdadee-e660-4337-99da-c716b929a56c None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:27.540080 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdadee-e660-4337-99da-c716b929a56c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:27.550521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdadee-e660-4337-99da-c716b929a56c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:35:27.555261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-54bdadee-e660-4337-99da-c716b929a56c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:35:27.555261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:27.555261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:27.555261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:27.555261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:27.555261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:27.555261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:27.555261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:27.555261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:27.555261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:27.555261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:27.555261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:27.555261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:35:27.555261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:35:27.555261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:35:27.555261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:35:27.557034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:35:27.557034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:35:27.557034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:35:27.557034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:35:27.557034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:27.557034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:27.557034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:27.557034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:27.557034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:27.557034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:27.557034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:27.557034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:27.557034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:27.557034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:27.557034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:27.557034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:27.557890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:27.557890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:27.557890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:27.557890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:27.557890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:35:27.557890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:35:27.557890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:35:27.557890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:35:27.557890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:35:27.557890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:35:27.557890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:35:27.557890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:27.559625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 536/1067] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:35:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:27.563197 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b7245-5c4c-4107-8c43-a3528e784af4 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:27.665520 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b7245-5c4c-4107-8c43-a3528e784af4 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:27.688359 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:27.700804 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c437348-9a5d-48a3-8c76-7953441288d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:27.701408 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c437348-9a5d-48a3-8c76-7953441288d7 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:27.701682 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c437348-9a5d-48a3-8c76-7953441288d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:27.708808 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c437348-9a5d-48a3-8c76-7953441288d7 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:27.708808 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c437348-9a5d-48a3-8c76-7953441288d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:27.708808 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c437348-9a5d-48a3-8c76-7953441288d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:27.708808 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c437348-9a5d-48a3-8c76-7953441288d7 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:27.712939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 532/1068] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:35:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:27.718727 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdadee-e660-4337-99da-c716b929a56c None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:27.738058 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:27.820426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdadee-e660-4337-99da-c716b929a56c None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:27.853936 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f478249-c63c-49c6-8410-0fe7e03546d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:27.854566 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f478249-c63c-49c6-8410-0fe7e03546d0 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:27.854840 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f478249-c63c-49c6-8410-0fe7e03546d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:27.855107 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f478249-c63c-49c6-8410-0fe7e03546d0 None admin] PATH_INFO: `/v3/users/628922429e874d49b6443c0ccf014f0c` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:27.868684 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f478249-c63c-49c6-8410-0fe7e03546d0 None admin] RBAC: Authorizing `identity:get_user(user_id=628922429e874d49b6443c0ccf014f0c)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:27.870095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f478249-c63c-49c6-8410-0fe7e03546d0 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:27.871869 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 537/1069] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:35:27 2022] GET /identity/v3/users/628922429e874d49b6443c0ccf014f0c => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:27.877569 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c437348-9a5d-48a3-8c76-7953441288d7 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:27.976543 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c437348-9a5d-48a3-8c76-7953441288d7 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:28.013164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e83c63-addb-477a-bd4b-fb20aca21ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:28.013778 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e83c63-addb-477a-bd4b-fb20aca21ce9 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:28.014045 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e83c63-addb-477a-bd4b-fb20aca21ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:28.014310 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e83c63-addb-477a-bd4b-fb20aca21ce9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:28.072024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:28.090018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e83c63-addb-477a-bd4b-fb20aca21ce9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:28.091464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e83c63-addb-477a-bd4b-fb20aca21ce9 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:28.182119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b567db1-1489-4fbe-a9d9-ce47d0f0c6c0 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:28.182413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b567db1-1489-4fbe-a9d9-ce47d0f0c6c0 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:28.182692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b567db1-1489-4fbe-a9d9-ce47d0f0c6c0 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:28.184233 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 538/1070] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:28.189155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9195d77-a8c2-48a7-a5dd-a145bf411933 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:28.189438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9195d77-a8c2-48a7-a5dd-a145bf411933 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:28.189712 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9195d77-a8c2-48a7-a5dd-a145bf411933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:28.205760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 533/1071] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:35:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 19:35:28.208367 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-f9195d77-a8c2-48a7-a5dd-a145bf411933 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:28.209556 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f9195d77-a8c2-48a7-a5dd-a145bf411933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:28.211438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e83c63-addb-477a-bd4b-fb20aca21ce9 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:28.278526 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 539/1072] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 19:35:28.295749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:28.344532 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e83c63-addb-477a-bd4b-fb20aca21ce9 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:28.355573 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494cc43-b79f-48a6-bbe3-0a4eeb060344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:28.355573 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494cc43-b79f-48a6-bbe3-0a4eeb060344 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:28.355573 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494cc43-b79f-48a6-bbe3-0a4eeb060344 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:28.355573 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494cc43-b79f-48a6-bbe3-0a4eeb060344 None admin] PATH_INFO: `/v3/projects/ef101e0c29084f888702045ef07ce7cb` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:28.361117 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494cc43-b79f-48a6-bbe3-0a4eeb060344 None admin] RBAC: Authorizing `identity:get_project(project_id=ef101e0c29084f888702045ef07ce7cb)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:28.364189 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494cc43-b79f-48a6-bbe3-0a4eeb060344 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:28.373525 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 534/1073] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:35:28 2022] GET /identity/v3/projects/ef101e0c29084f888702045ef07ce7cb => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:28.380677 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9195d77-a8c2-48a7-a5dd-a145bf411933 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:28.385755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:28.485361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9195d77-a8c2-48a7-a5dd-a145bf411933 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:28.518780 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae00b5-c8c0-4db6-b529-35c9fa88118c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:28.519376 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae00b5-c8c0-4db6-b529-35c9fa88118c None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:28.519679 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae00b5-c8c0-4db6-b529-35c9fa88118c None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:28.519947 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae00b5-c8c0-4db6-b529-35c9fa88118c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:28.520660 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae00b5-c8c0-4db6-b529-35c9fa88118c None admin] RBAC: Adding query filter params (role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a, scope.project.id=ef101e0c29084f888702045ef07ce7cb, user.id=628922429e874d49b6443c0ccf014f0c) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:28.520965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae00b5-c8c0-4db6-b529-35c9fa88118c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:28.522385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae00b5-c8c0-4db6-b529-35c9fa88118c None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:28.528906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 540/1074] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:35:28 2022] GET /identity/v3/role_assignments?user.id=628922429e874d49b6443c0ccf014f0c&scope.project.id=ef101e0c29084f888702045ef07ce7cb&role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:28.555865 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494cc43-b79f-48a6-bbe3-0a4eeb060344 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:28.562228 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b4aaf-890a-4538-9e93-df2e2f0b4cc8 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:28.562511 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b4aaf-890a-4538-9e93-df2e2f0b4cc8 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:28.562780 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b4aaf-890a-4538-9e93-df2e2f0b4cc8 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:28.564355 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 541/1075] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:35:28.569962 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c590467-290b-4341-8b5a-e54ecebc32c8 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:28.570242 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c590467-290b-4341-8b5a-e54ecebc32c8 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:28.570517 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c590467-290b-4341-8b5a-e54ecebc32c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:28.590509 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-2c590467-290b-4341-8b5a-e54ecebc32c8 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:28.591851 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2c590467-290b-4341-8b5a-e54ecebc32c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:28.662255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:28.667283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494cc43-b79f-48a6-bbe3-0a4eeb060344 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:28.669033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 542/1076] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 19:35:28.707026 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0c48b-b3ee-408f-9cce-b1020d9f9f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:28.707698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0c48b-b3ee-408f-9cce-b1020d9f9f36 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:28.707973 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0c48b-b3ee-408f-9cce-b1020d9f9f36 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:28.708300 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0c48b-b3ee-408f-9cce-b1020d9f9f36 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:28.721805 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0c48b-b3ee-408f-9cce-b1020d9f9f36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:35:28.726708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-53b0c48b-b3ee-408f-9cce-b1020d9f9f36 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 19:35:28.726708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:28.726708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:28.726708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:28.726708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:28.726708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:28.726708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:28.726708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:28.726708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:28.726708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:28.726708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:28.726708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:28.726708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:35:28.726708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:35:28.726708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:35:28.726708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:35:28.728462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:35:28.728462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:35:28.728462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:35:28.728462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:35:28.728462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:28.728462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:28.728462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:28.728462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:28.728462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:28.728462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:28.728462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:28.728462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:28.728462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:28.728462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:28.728462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:28.728462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:28.729316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:28.729316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:28.729316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:28.729316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:28.729316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:35:28.729316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:35:28.729316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:35:28.729316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:35:28.729316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:35:28.729316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:35:28.729316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 19:35:28.729316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:28.729316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 535/1077] 10.222.0.15 () {56 vars in 1120 bytes} [Wed Sep 14 19:35:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:28.734460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c590467-290b-4341-8b5a-e54ecebc32c8 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:28.834146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c590467-290b-4341-8b5a-e54ecebc32c8 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:28.871516 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea151f-effc-4084-b339-ca4470614e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:28.872158 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea151f-effc-4084-b339-ca4470614e3a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:28.872438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea151f-effc-4084-b339-ca4470614e3a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:28.872710 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea151f-effc-4084-b339-ca4470614e3a None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:28.873374 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea151f-effc-4084-b339-ca4470614e3a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:28.873677 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea151f-effc-4084-b339-ca4470614e3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:28.875050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea151f-effc-4084-b339-ca4470614e3a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:28.888366 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 543/1078] 10.222.0.15 () {56 vars in 1115 bytes} [Wed Sep 14 19:35:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:28.890129 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0c48b-b3ee-408f-9cce-b1020d9f9f36 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:28.905328 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:28.949051 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea151f-effc-4084-b339-ca4470614e3a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:28.995275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0c48b-b3ee-408f-9cce-b1020d9f9f36 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:29.021906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:29.035924 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381adde-3e75-4174-90ee-376d182f8476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:29.036560 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381adde-3e75-4174-90ee-376d182f8476 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:29.039047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381adde-3e75-4174-90ee-376d182f8476 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:29.039047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381adde-3e75-4174-90ee-376d182f8476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:29.048006 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381adde-3e75-4174-90ee-376d182f8476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:29.049684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381adde-3e75-4174-90ee-376d182f8476 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:29.064531 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea151f-effc-4084-b339-ca4470614e3a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:29.065518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-f381adde-3e75-4174-90ee-376d182f8476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:29.065518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:29.065518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:29.065518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:29.065518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:29.065518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:29.065518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:29.065518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:29.065518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:29.065518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:29.065518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:29.065518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:29.065518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:35:29.065518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:35:29.065518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:35:29.065518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:35:29.066429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:29.066429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:29.066429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:29.066429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:29.066429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:29.066429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:29.066429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:29.066429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:29.066429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:29.066429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:29.066429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:29.066429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:29.066429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:29.066429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:29.066429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:29.066429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:29.066429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:35:29.067511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:35:29.067511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:29.067511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:29.071576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 536/1079] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:29.072511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381adde-3e75-4174-90ee-376d182f8476 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:29.103864 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012c6a4-45b3-477e-93ba-d7c5f14d3d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:29.104671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012c6a4-45b3-477e-93ba-d7c5f14d3d7a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:29.104782 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012c6a4-45b3-477e-93ba-d7c5f14d3d7a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:29.105021 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012c6a4-45b3-477e-93ba-d7c5f14d3d7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:29.137823 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:29.175474 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012c6a4-45b3-477e-93ba-d7c5f14d3d7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:29.177061 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012c6a4-45b3-477e-93ba-d7c5f14d3d7a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:29.178353 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381adde-3e75-4174-90ee-376d182f8476 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:29.215065 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd0a38-a6c6-4fc1-af8b-e29673edc6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:29.215722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd0a38-a6c6-4fc1-af8b-e29673edc6a0 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:29.216001 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd0a38-a6c6-4fc1-af8b-e29673edc6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:29.216267 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd0a38-a6c6-4fc1-af8b-e29673edc6a0 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:29.216901 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd0a38-a6c6-4fc1-af8b-e29673edc6a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:29.217200 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd0a38-a6c6-4fc1-af8b-e29673edc6a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:29.219067 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd0a38-a6c6-4fc1-af8b-e29673edc6a0 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:29.241109 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 537/1080] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:29.241322 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:29.242571 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd0a38-a6c6-4fc1-af8b-e29673edc6a0 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:29.282553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 544/1081] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:35:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 19:35:29.288844 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012c6a4-45b3-477e-93ba-d7c5f14d3d7a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:29.351565 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd0a38-a6c6-4fc1-af8b-e29673edc6a0 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:29.383797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:29.395535 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04610b34-afac-421e-b2ee-c592734302ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:29.404595 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04610b34-afac-421e-b2ee-c592734302ed None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:29.404595 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04610b34-afac-421e-b2ee-c592734302ed None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:29.404595 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04610b34-afac-421e-b2ee-c592734302ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:29.404900 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012c6a4-45b3-477e-93ba-d7c5f14d3d7a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:29.404991 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04610b34-afac-421e-b2ee-c592734302ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:29.406328 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04610b34-afac-421e-b2ee-c592734302ed None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:29.420363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-04610b34-afac-421e-b2ee-c592734302ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 19:35:29.420363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:29.420363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:29.420363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:29.420363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:29.420363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:29.420363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:29.420363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:29.420363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:29.420363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:29.420363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:29.420363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:29.420363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:35:29.420363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:35:29.420363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:35:29.420363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:35:29.421522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:29.421522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:29.421522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:35:29.421522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:35:29.421522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:35:29.421522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:35:29.421522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:29.421522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:29.421522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:29.421522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:29.421522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:29.421522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:29.421522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:29.421522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:29.421522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:29.421522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:29.421522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:29.421522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:29.422472 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:29.422472 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:29.422472 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:35:29.422472 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:35:29.422472 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:35:29.422472 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:35:29.422472 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:35:29.422472 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:35:29.422472 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 19:35:29.422472 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:29.422472 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 538/1082] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Sep 14 19:35:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:29.427120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04610b34-afac-421e-b2ee-c592734302ed None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:29.441474 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d05a0e-2351-468c-bd62-a4ef8ccac6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:29.442113 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d05a0e-2351-468c-bd62-a4ef8ccac6fd None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:29.442424 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d05a0e-2351-468c-bd62-a4ef8ccac6fd None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:29.442648 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d05a0e-2351-468c-bd62-a4ef8ccac6fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:29.454724 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d05a0e-2351-468c-bd62-a4ef8ccac6fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:29.456429 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d05a0e-2351-468c-bd62-a4ef8ccac6fd None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:29.471211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-c8d05a0e-2351-468c-bd62-a4ef8ccac6fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:29.471211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:29.471211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:29.471211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:29.471211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:29.471211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:29.471211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:29.471211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:29.471211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:29.471211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:29.471211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:29.471211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:29.471211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:35:29.471211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:35:29.471211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:35:29.471211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:35:29.472412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:29.472412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:29.472412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:29.472412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:29.472412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:29.472412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:29.472412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:29.472412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:29.472412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:29.472412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:29.472412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:29.472412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:29.472412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:29.472412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:29.472412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:29.472412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:29.472412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:35:29.473522 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:35:29.473522 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:29.473522 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:29.475515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 545/1083] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:35:29.481629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d05a0e-2351-468c-bd62-a4ef8ccac6fd None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:29.497795 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:29.535162 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04610b34-afac-421e-b2ee-c592734302ed None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:29.569286 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274dbad-d9c4-4bc8-bef1-095e97e97223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:29.569887 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274dbad-d9c4-4bc8-bef1-095e97e97223 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:29.570162 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274dbad-d9c4-4bc8-bef1-095e97e97223 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:29.570429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274dbad-d9c4-4bc8-bef1-095e97e97223 None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:29.571151 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274dbad-d9c4-4bc8-bef1-095e97e97223 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:29.574977 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274dbad-d9c4-4bc8-bef1-095e97e97223 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:29.574977 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274dbad-d9c4-4bc8-bef1-095e97e97223 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:29.596552 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 539/1084] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Sep 14 19:35:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:29.597571 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274dbad-d9c4-4bc8-bef1-095e97e97223 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:29.598741 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d05a0e-2351-468c-bd62-a4ef8ccac6fd None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:29.633353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a5860-3b17-4cd2-9229-24fd4d61ab7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:29.633888 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a5860-3b17-4cd2-9229-24fd4d61ab7f None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:29.634174 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a5860-3b17-4cd2-9229-24fd4d61ab7f None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:29.634461 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a5860-3b17-4cd2-9229-24fd4d61ab7f None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:29.635076 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a5860-3b17-4cd2-9229-24fd4d61ab7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:29.635383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a5860-3b17-4cd2-9229-24fd4d61ab7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:29.636781 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a5860-3b17-4cd2-9229-24fd4d61ab7f None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:29.640746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:29.648897 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 546/1085] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:29.703468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274dbad-d9c4-4bc8-bef1-095e97e97223 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:29.744744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1198e8-fc83-485a-8519-65d25ea66f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:29.745377 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1198e8-fc83-485a-8519-65d25ea66f69 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:29.745651 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1198e8-fc83-485a-8519-65d25ea66f69 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:29.745918 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1198e8-fc83-485a-8519-65d25ea66f69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:29.823035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1198e8-fc83-485a-8519-65d25ea66f69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:29.824099 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1198e8-fc83-485a-8519-65d25ea66f69 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:29.869632 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:29.938853 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 540/1086] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:35:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 19:35:29.941254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a5860-3b17-4cd2-9229-24fd4d61ab7f None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:30.016833 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:30.045609 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a5860-3b17-4cd2-9229-24fd4d61ab7f None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:30.079000 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596abe3-1de9-420d-bcc2-778e712b46b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:30.079659 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596abe3-1de9-420d-bcc2-778e712b46b2 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:30.079937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596abe3-1de9-420d-bcc2-778e712b46b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:30.080211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596abe3-1de9-420d-bcc2-778e712b46b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:30.089844 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596abe3-1de9-420d-bcc2-778e712b46b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:30.091262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596abe3-1de9-420d-bcc2-778e712b46b2 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:30.105636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-8596abe3-1de9-420d-bcc2-778e712b46b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:30.105636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:30.105636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:30.105636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:30.105636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:30.105636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:30.105636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:30.105636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:30.105636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:30.105636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:30.105636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:30.105636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:30.105636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:35:30.105636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:35:30.105636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:35:30.105636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:35:30.106883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:30.106883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:30.106883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:30.106883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:30.106883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:30.106883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:30.106883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:30.106883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:30.106883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:30.106883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:30.106883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:30.106883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:30.106883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:30.106883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:30.106883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:30.106883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:30.106883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:35:30.108310 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:35:30.108310 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:35:30.108310 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:30.108310 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 547/1087] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:35:30.112367 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1198e8-fc83-485a-8519-65d25ea66f69 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:30.213770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1198e8-fc83-485a-8519-65d25ea66f69 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:30.248368 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf98277-9f12-46b0-bb16-23f26af4b101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:30.248972 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf98277-9f12-46b0-bb16-23f26af4b101 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:30.249248 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf98277-9f12-46b0-bb16-23f26af4b101 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:30.249520 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf98277-9f12-46b0-bb16-23f26af4b101 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:30.250159 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf98277-9f12-46b0-bb16-23f26af4b101 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:30.250461 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf98277-9f12-46b0-bb16-23f26af4b101 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:30.251844 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf98277-9f12-46b0-bb16-23f26af4b101 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:30.263461 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 541/1088] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:30.269230 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596abe3-1de9-420d-bcc2-778e712b46b2 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:30.368311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596abe3-1de9-420d-bcc2-778e712b46b2 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:30.393268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:30.404684 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04419c-52d2-4635-8a95-58eadd071b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:30.405326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04419c-52d2-4635-8a95-58eadd071b27 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:30.405607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04419c-52d2-4635-8a95-58eadd071b27 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:30.405878 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04419c-52d2-4635-8a95-58eadd071b27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:30.412674 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04419c-52d2-4635-8a95-58eadd071b27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:30.414159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04419c-52d2-4635-8a95-58eadd071b27 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:30.426438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-9e04419c-52d2-4635-8a95-58eadd071b27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:35:30.426438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:30.426438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:30.426438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:30.426438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:30.426438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:30.426438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:30.426438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:30.426438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:30.426438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:30.426438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:30.426438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:30.426438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:35:30.426438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:35:30.426438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:35:30.427314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:35:30.427314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:30.427314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:30.427314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:30.427314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:30.427314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:30.427314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:30.427314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:30.427314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:30.427314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:30.427314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:30.427314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:30.427314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:30.427314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:30.427314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:30.427314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:30.427314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:30.428269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:35:30.428269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:35:30.428269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:35:30.428269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:35:30.428269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:35:30.428269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:35:30.428269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:35:30.428269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:30.431691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 548/1089] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:35:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:30.433664 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf98277-9f12-46b0-bb16-23f26af4b101 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:30.436557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:30.535514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf98277-9f12-46b0-bb16-23f26af4b101 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:30.571284 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4aac1-e711-44dd-b3c0-ec5de2ce6316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:30.572386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4aac1-e711-44dd-b3c0-ec5de2ce6316 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:30.572820 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4aac1-e711-44dd-b3c0-ec5de2ce6316 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:30.573100 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4aac1-e711-44dd-b3c0-ec5de2ce6316 None admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:30.573825 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4aac1-e711-44dd-b3c0-ec5de2ce6316 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:30.574135 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4aac1-e711-44dd-b3c0-ec5de2ce6316 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:30.575635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4aac1-e711-44dd-b3c0-ec5de2ce6316 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:30.589801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 542/1090] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:35:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:30.595901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04419c-52d2-4635-8a95-58eadd071b27 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:30.673755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d6309-834c-44ee-b7ff-bc4d4a6c2aef None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:30.674025 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d6309-834c-44ee-b7ff-bc4d4a6c2aef None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:30.674298 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d6309-834c-44ee-b7ff-bc4d4a6c2aef None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:30.675805 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 543/1091] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:35:30.680862 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3763-f13c-436d-9007-ca51a167e26c None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:30.681142 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3763-f13c-436d-9007-ca51a167e26c None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:30.681408 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3763-f13c-436d-9007-ca51a167e26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:30.694256 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04419c-52d2-4635-8a95-58eadd071b27 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:30.699427 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-169e3763-f13c-436d-9007-ca51a167e26c None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:30.700633 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-169e3763-f13c-436d-9007-ca51a167e26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:30.728854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186591c6-212a-44d6-991b-6df76c0f3b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:30.729465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186591c6-212a-44d6-991b-6df76c0f3b95 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:30.729765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186591c6-212a-44d6-991b-6df76c0f3b95 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:30.730043 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186591c6-212a-44d6-991b-6df76c0f3b95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:30.730760 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186591c6-212a-44d6-991b-6df76c0f3b95 None admin] RBAC: Adding query filter params (role.id=bbffc2c569f64cd89c9598d29c9aa6fc, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=421f6cc846b342918a177d2794eb3db8) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:30.731072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186591c6-212a-44d6-991b-6df76c0f3b95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:30.732527 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186591c6-212a-44d6-991b-6df76c0f3b95 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:30.738403 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 549/1092] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:35:30 2022] GET /identity/v3/role_assignments?user.id=421f6cc846b342918a177d2794eb3db8&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=bbffc2c569f64cd89c9598d29c9aa6fc => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:30.763474 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:30.774363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 544/1093] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 19:35:31.045404 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186591c6-212a-44d6-991b-6df76c0f3b95 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:31.096671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:31.147678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186591c6-212a-44d6-991b-6df76c0f3b95 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:31.183135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a7325-bb3b-42e0-8d64-590bd51669bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:31.183845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a7325-bb3b-42e0-8d64-590bd51669bf None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:31.184126 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a7325-bb3b-42e0-8d64-590bd51669bf None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:31.184399 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a7325-bb3b-42e0-8d64-590bd51669bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:31.194309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a7325-bb3b-42e0-8d64-590bd51669bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:35:31.199588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-1a3a7325-bb3b-42e0-8d64-590bd51669bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:35:31.199588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:31.199588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:31.199588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:31.199588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:31.199588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:31.199588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:31.199588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:31.199588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:31.199588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:31.199588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:31.199588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:31.199588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:35:31.199588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:35:31.199588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:35:31.199588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:35:31.200553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:35:31.200553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:35:31.200553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:35:31.200553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:35:31.200553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:31.200553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:31.200553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:31.200553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:31.200553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:31.200553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:31.200553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:31.200553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:31.200553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:31.200553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:31.200553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:31.200553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:31.201406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:31.201406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:31.201406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:31.201406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:31.201406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:35:31.201406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:35:31.201406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:35:31.201406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:35:31.201406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:35:31.201406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:35:31.201406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:35:31.201406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:35:31.201406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 550/1094] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:35:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:31.206926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e3763-f13c-436d-9007-ca51a167e26c None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:31.310692 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e3763-f13c-436d-9007-ca51a167e26c None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:31.344718 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8675857-c15a-4b48-b9c1-c7c937d4faf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:31.345320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8675857-c15a-4b48-b9c1-c7c937d4faf1 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:31.345599 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8675857-c15a-4b48-b9c1-c7c937d4faf1 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:31.345865 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8675857-c15a-4b48-b9c1-c7c937d4faf1 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:31.346529 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8675857-c15a-4b48-b9c1-c7c937d4faf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:31.346826 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8675857-c15a-4b48-b9c1-c7c937d4faf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:31.348213 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8675857-c15a-4b48-b9c1-c7c937d4faf1 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:31.356427 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 545/1095] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:35:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:31.362629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a7325-bb3b-42e0-8d64-590bd51669bf None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:31.465847 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a7325-bb3b-42e0-8d64-590bd51669bf None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:31.474714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:31.499965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b7112-d976-40ae-9485-f0889e92f40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:31.500598 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b7112-d976-40ae-9485-f0889e92f40c None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:31.500873 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b7112-d976-40ae-9485-f0889e92f40c None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:31.501145 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b7112-d976-40ae-9485-f0889e92f40c None admin] PATH_INFO: `/v3/users/628922429e874d49b6443c0ccf014f0c` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:31.502265 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b7112-d976-40ae-9485-f0889e92f40c None admin] RBAC: Authorizing `identity:get_user(user_id=628922429e874d49b6443c0ccf014f0c)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:31.503718 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b7112-d976-40ae-9485-f0889e92f40c None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:31.505700 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 551/1096] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:35:31 2022] GET /identity/v3/users/628922429e874d49b6443c0ccf014f0c => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:31.511614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8675857-c15a-4b48-b9c1-c7c937d4faf1 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:31.568080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:31.615723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8675857-c15a-4b48-b9c1-c7c937d4faf1 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:31.655231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c4d42-bb2d-4fe6-9805-0ead81cf3adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:31.655895 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c4d42-bb2d-4fe6-9805-0ead81cf3adf None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:31.656178 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c4d42-bb2d-4fe6-9805-0ead81cf3adf None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:31.656453 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c4d42-bb2d-4fe6-9805-0ead81cf3adf None admin] PATH_INFO: `/v3/projects/ef101e0c29084f888702045ef07ce7cb` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:31.657565 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c4d42-bb2d-4fe6-9805-0ead81cf3adf None admin] RBAC: Authorizing `identity:get_project(project_id=ef101e0c29084f888702045ef07ce7cb)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:31.659000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c4d42-bb2d-4fe6-9805-0ead81cf3adf None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:31.660938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 546/1097] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:35:31 2022] GET /identity/v3/projects/ef101e0c29084f888702045ef07ce7cb => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:31.666917 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b7112-d976-40ae-9485-f0889e92f40c None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:31.761703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b7112-d976-40ae-9485-f0889e92f40c None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:31.793898 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31c5f7-bdff-46f4-a098-a8b241e8ebc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:31.794535 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31c5f7-bdff-46f4-a098-a8b241e8ebc2 None admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:31.794807 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31c5f7-bdff-46f4-a098-a8b241e8ebc2 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:31.795075 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31c5f7-bdff-46f4-a098-a8b241e8ebc2 None admin] PATH_INFO: `/v3/projects/ef101e0c29084f888702045ef07ce7cb/users/628922429e874d49b6443c0ccf014f0c/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:31.796954 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31c5f7-bdff-46f4-a098-a8b241e8ebc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef101e0c29084f888702045ef07ce7cb, user_id=628922429e874d49b6443c0ccf014f0c, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:31.798367 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31c5f7-bdff-46f4-a098-a8b241e8ebc2 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:31.882975 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 552/1098] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:35:31 2022] PUT /identity/v3/projects/ef101e0c29084f888702045ef07ce7cb/users/628922429e874d49b6443c0ccf014f0c/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:35:34.025563 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1493c3-03b7-45a3-ae1a-dc67a7a79e2c None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:34.026096 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1493c3-03b7-45a3-ae1a-dc67a7a79e2c None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:34.026096 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1493c3-03b7-45a3-ae1a-dc67a7a79e2c None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:34.027457 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 547/1099] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:34.032947 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cdb4a-2fc1-4360-a3df-f8fdcb134ccd None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:34.033349 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cdb4a-2fc1-4360-a3df-f8fdcb134ccd None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:34.033490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cdb4a-2fc1-4360-a3df-f8fdcb134ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:34.051391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-9f5cdb4a-2fc1-4360-a3df-f8fdcb134ccd None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:34.052599 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-9f5cdb4a-2fc1-4360-a3df-f8fdcb134ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:34.080931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:34.116841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 553/1100] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:34.394546 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1493c3-03b7-45a3-ae1a-dc67a7a79e2c None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:34.497249 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1493c3-03b7-45a3-ae1a-dc67a7a79e2c None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:34.519277 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:34.530491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974211a-1375-4efe-91f9-033985ead0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:34.531115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974211a-1375-4efe-91f9-033985ead0f3 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:34.531397 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974211a-1375-4efe-91f9-033985ead0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:34.531699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974211a-1375-4efe-91f9-033985ead0f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:34.542386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974211a-1375-4efe-91f9-033985ead0f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:35:34.547281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-e974211a-1375-4efe-91f9-033985ead0f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:35:34.547281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:34.547281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:34.547281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:34.547281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:34.547281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:34.547281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:34.547281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:34.547281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:34.547281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:34.547281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:34.547281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:34.547281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:35:34.547281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:35:34.547281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:35:34.547281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:35:34.548431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:35:34.548431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:35:34.548431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:35:34.548431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:35:34.548431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:34.548431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:34.548431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:34.548431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:34.548431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:34.548431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:34.548431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:34.548431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:34.548431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:34.548431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:34.548431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:34.548431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:34.549358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:34.549358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:34.549358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:34.549358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:34.549358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:35:34.549358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:35:34.549358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:35:34.549358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:35:34.549358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:35:34.549358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:35:34.549358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:35:34.549358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:34.549358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 548/1101] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:35:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 19:35:34.554655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5cdb4a-2fc1-4360-a3df-f8fdcb134ccd None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:34.656946 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5cdb4a-2fc1-4360-a3df-f8fdcb134ccd None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:34.690136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dffae1-4fe8-4ac1-9033-2d97f44b13f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:34.690741 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dffae1-4fe8-4ac1-9033-2d97f44b13f8 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:34.691019 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dffae1-4fe8-4ac1-9033-2d97f44b13f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:34.691305 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dffae1-4fe8-4ac1-9033-2d97f44b13f8 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:34.691978 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dffae1-4fe8-4ac1-9033-2d97f44b13f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:34.692280 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dffae1-4fe8-4ac1-9033-2d97f44b13f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:34.693642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dffae1-4fe8-4ac1-9033-2d97f44b13f8 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:34.702465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 554/1102] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:35:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:34.708581 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974211a-1375-4efe-91f9-033985ead0f3 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:34.806818 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974211a-1375-4efe-91f9-033985ead0f3 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:34.840436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5a122-fd68-4c90-98c2-bbc253d3b40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:34.841058 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5a122-fd68-4c90-98c2-bbc253d3b40f None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:34.841338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5a122-fd68-4c90-98c2-bbc253d3b40f None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:34.841607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5a122-fd68-4c90-98c2-bbc253d3b40f None admin] PATH_INFO: `/v3/users/628922429e874d49b6443c0ccf014f0c` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:34.842786 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5a122-fd68-4c90-98c2-bbc253d3b40f None admin] RBAC: Authorizing `identity:get_user(user_id=628922429e874d49b6443c0ccf014f0c)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:34.844238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5a122-fd68-4c90-98c2-bbc253d3b40f None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:34.845879 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 549/1103] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:35:34 2022] GET /identity/v3/users/628922429e874d49b6443c0ccf014f0c => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:34.851766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dffae1-4fe8-4ac1-9033-2d97f44b13f8 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:34.881007 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:34.959501 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dffae1-4fe8-4ac1-9033-2d97f44b13f8 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:34.995719 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4a54e-fcc3-4a6a-b1cc-6cce9739a289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:34.996328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4a54e-fcc3-4a6a-b1cc-6cce9739a289 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:34.996614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4a54e-fcc3-4a6a-b1cc-6cce9739a289 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:34.996905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4a54e-fcc3-4a6a-b1cc-6cce9739a289 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:35.064127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4a54e-fcc3-4a6a-b1cc-6cce9739a289 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:35.065566 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4a54e-fcc3-4a6a-b1cc-6cce9739a289 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:35.091964 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:35.222956 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 555/1104] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:35:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 19:35:35.229631 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5a122-fd68-4c90-98c2-bbc253d3b40f None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:35.278314 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:35.328405 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5a122-fd68-4c90-98c2-bbc253d3b40f None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:35.361922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ebbd5-ff51-48a6-b680-06e79992f862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:35.362547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ebbd5-ff51-48a6-b680-06e79992f862 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:35.362828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ebbd5-ff51-48a6-b680-06e79992f862 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:35.363102 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ebbd5-ff51-48a6-b680-06e79992f862 None admin] PATH_INFO: `/v3/projects/ef101e0c29084f888702045ef07ce7cb` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:35.364235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ebbd5-ff51-48a6-b680-06e79992f862 None admin] RBAC: Authorizing `identity:get_project(project_id=ef101e0c29084f888702045ef07ce7cb)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:35.365658 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ebbd5-ff51-48a6-b680-06e79992f862 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:35.367292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 550/1105] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:35:35 2022] GET /identity/v3/projects/ef101e0c29084f888702045ef07ce7cb => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:35:35.374165 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4a54e-fcc3-4a6a-b1cc-6cce9739a289 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:35.468829 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4a54e-fcc3-4a6a-b1cc-6cce9739a289 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:35.494529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:35.501993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9b708-68ac-4873-b3de-e2afda636640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:35.508459 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9b708-68ac-4873-b3de-e2afda636640 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:35.508459 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9b708-68ac-4873-b3de-e2afda636640 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:35.508459 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9b708-68ac-4873-b3de-e2afda636640 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:35.508459 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9b708-68ac-4873-b3de-e2afda636640 None admin] RBAC: Adding query filter params (role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a, scope.project.id=ef101e0c29084f888702045ef07ce7cb, user.id=628922429e874d49b6443c0ccf014f0c) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:35.508459 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9b708-68ac-4873-b3de-e2afda636640 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:35.508459 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9b708-68ac-4873-b3de-e2afda636640 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:35.511047 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 556/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:35:35 2022] GET /identity/v3/role_assignments?user.id=628922429e874d49b6443c0ccf014f0c&scope.project.id=ef101e0c29084f888702045ef07ce7cb&role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:37.652540 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ed6bd-2000-4f27-b897-bf2d4f6748e7 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:37.653055 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ed6bd-2000-4f27-b897-bf2d4f6748e7 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:37.653055 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ed6bd-2000-4f27-b897-bf2d4f6748e7 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:37.654338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 551/1107] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:37.659851 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d67689-952b-4cf9-b5f8-ef8c3e962ef5 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:37.660260 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d67689-952b-4cf9-b5f8-ef8c3e962ef5 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:37.660398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d67689-952b-4cf9-b5f8-ef8c3e962ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:37.678943 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-37d67689-952b-4cf9-b5f8-ef8c3e962ef5 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:37.680170 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-37d67689-952b-4cf9-b5f8-ef8c3e962ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:37.744791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 557/1108] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:38.012505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ed6bd-2000-4f27-b897-bf2d4f6748e7 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:38.113406 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ed6bd-2000-4f27-b897-bf2d4f6748e7 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:38.130210 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:38.146348 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfc80a-19b0-402d-b682-2d03aa9dcb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:38.146968 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfc80a-19b0-402d-b682-2d03aa9dcb7b None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:38.147246 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfc80a-19b0-402d-b682-2d03aa9dcb7b None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:38.147516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfc80a-19b0-402d-b682-2d03aa9dcb7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:38.149591 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfc80a-19b0-402d-b682-2d03aa9dcb7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:38.150234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfc80a-19b0-402d-b682-2d03aa9dcb7b None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:38.152663 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 552/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:38.158565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d67689-952b-4cf9-b5f8-ef8c3e962ef5 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:38.262603 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d67689-952b-4cf9-b5f8-ef8c3e962ef5 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:38.284724 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:38.296139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf66fbd-79a3-42c8-a827-f5351029d312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:38.296749 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf66fbd-79a3-42c8-a827-f5351029d312 None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:38.300246 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf66fbd-79a3-42c8-a827-f5351029d312 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:38.300246 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf66fbd-79a3-42c8-a827-f5351029d312 None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:38.300246 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf66fbd-79a3-42c8-a827-f5351029d312 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:38.300246 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf66fbd-79a3-42c8-a827-f5351029d312 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:38.387764 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 558/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Sep 14 19:35:38 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:35:40.559494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971373b-d4ef-48d5-abe2-1193f3ebbdc7 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:40.560045 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971373b-d4ef-48d5-abe2-1193f3ebbdc7 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:40.560045 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971373b-d4ef-48d5-abe2-1193f3ebbdc7 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:40.561409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 553/1111] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:40.566854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929cde1-7568-4259-b507-2c744dfdd2e0 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:40.567249 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929cde1-7568-4259-b507-2c744dfdd2e0 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:40.567395 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929cde1-7568-4259-b507-2c744dfdd2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:40.585483 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-4929cde1-7568-4259-b507-2c744dfdd2e0 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:40.586655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4929cde1-7568-4259-b507-2c744dfdd2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:40.651636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 559/1112] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:40.917251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971373b-d4ef-48d5-abe2-1193f3ebbdc7 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:41.017970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971373b-d4ef-48d5-abe2-1193f3ebbdc7 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:41.051003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf77a24-832a-4337-abb5-978ff9056c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:41.051652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf77a24-832a-4337-abb5-978ff9056c56 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:41.051927 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf77a24-832a-4337-abb5-978ff9056c56 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:41.052192 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf77a24-832a-4337-abb5-978ff9056c56 None admin] PATH_INFO: `/v3/roles/fd65be88941941298be36b142df9b505` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:41.053557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf77a24-832a-4337-abb5-978ff9056c56 None admin] RBAC: Authorizing `identity:get_role(role_id=fd65be88941941298be36b142df9b505)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:41.054913 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf77a24-832a-4337-abb5-978ff9056c56 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:41.056233 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 554/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:35:40 2022] GET /identity/v3/roles/fd65be88941941298be36b142df9b505 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:41.062535 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929cde1-7568-4259-b507-2c744dfdd2e0 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:41.157218 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929cde1-7568-4259-b507-2c744dfdd2e0 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:41.166810 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:41.191081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de88db9-3486-4f4f-9eb9-996d41448405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:41.191684 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de88db9-3486-4f4f-9eb9-996d41448405 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:41.192156 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de88db9-3486-4f4f-9eb9-996d41448405 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:41.192646 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de88db9-3486-4f4f-9eb9-996d41448405 None admin] PATH_INFO: `/v3/users/4e3fe4f14b734621874876cad9371253` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:41.205911 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de88db9-3486-4f4f-9eb9-996d41448405 None admin] RBAC: Authorizing `identity:get_user(user_id=4e3fe4f14b734621874876cad9371253)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:41.207406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de88db9-3486-4f4f-9eb9-996d41448405 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:41.209031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 560/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:35:41 2022] GET /identity/v3/users/4e3fe4f14b734621874876cad9371253 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:41.214815 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf77a24-832a-4337-abb5-978ff9056c56 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:41.269341 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:41.313510 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf77a24-832a-4337-abb5-978ff9056c56 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:41.346749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7432cb-5d4f-4594-b84c-d81dc8f39b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:41.347345 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7432cb-5d4f-4594-b84c-d81dc8f39b52 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:41.347651 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7432cb-5d4f-4594-b84c-d81dc8f39b52 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:41.347928 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7432cb-5d4f-4594-b84c-d81dc8f39b52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:41.415650 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7432cb-5d4f-4594-b84c-d81dc8f39b52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:41.417921 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7432cb-5d4f-4594-b84c-d81dc8f39b52 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:41.470314 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:41.515961 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 555/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:35:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 19:35:41.521911 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de88db9-3486-4f4f-9eb9-996d41448405 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:41.617451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de88db9-3486-4f4f-9eb9-996d41448405 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:41.655379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb7119-7de3-4380-b94d-01178460f2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:41.656038 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb7119-7de3-4380-b94d-01178460f2a4 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:41.656311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb7119-7de3-4380-b94d-01178460f2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:41.656576 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb7119-7de3-4380-b94d-01178460f2a4 None admin] PATH_INFO: `/v3/projects/ef101e0c29084f888702045ef07ce7cb` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:41.657687 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb7119-7de3-4380-b94d-01178460f2a4 None admin] RBAC: Authorizing `identity:get_project(project_id=ef101e0c29084f888702045ef07ce7cb)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:41.659088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb7119-7de3-4380-b94d-01178460f2a4 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:41.660740 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 561/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:35:41 2022] GET /identity/v3/projects/ef101e0c29084f888702045ef07ce7cb => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:41.667986 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7432cb-5d4f-4594-b84c-d81dc8f39b52 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:41.764359 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7432cb-5d4f-4594-b84c-d81dc8f39b52 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:41.797643 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b7d09-f3d2-45a0-b28d-c8cc1f3339ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:41.798234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b7d09-f3d2-45a0-b28d-c8cc1f3339ac None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:41.798504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b7d09-f3d2-45a0-b28d-c8cc1f3339ac None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:41.798767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b7d09-f3d2-45a0-b28d-c8cc1f3339ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:41.799480 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b7d09-f3d2-45a0-b28d-c8cc1f3339ac None admin] RBAC: Adding query filter params (role.id=fd65be88941941298be36b142df9b505, scope.project.id=ef101e0c29084f888702045ef07ce7cb, user.id=4e3fe4f14b734621874876cad9371253) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:41.799809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b7d09-f3d2-45a0-b28d-c8cc1f3339ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:41.801220 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b7d09-f3d2-45a0-b28d-c8cc1f3339ac None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:41.806322 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 556/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:35:41 2022] GET /identity/v3/role_assignments?user.id=4e3fe4f14b734621874876cad9371253&scope.project.id=ef101e0c29084f888702045ef07ce7cb&role.id=fd65be88941941298be36b142df9b505 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:43.949334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d608f-dec3-4080-9f91-4c88db4230bd None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:43.949872 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d608f-dec3-4080-9f91-4c88db4230bd None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:43.949872 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d608f-dec3-4080-9f91-4c88db4230bd None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:43.951837 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 562/1118] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:43.957096 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0651097-3377-486b-b1b6-bd979ddbe449 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:43.957534 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0651097-3377-486b-b1b6-bd979ddbe449 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:43.957627 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0651097-3377-486b-b1b6-bd979ddbe449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:43.975221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-b0651097-3377-486b-b1b6-bd979ddbe449 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:43.976523 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b0651097-3377-486b-b1b6-bd979ddbe449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:43.989328 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:44.042622 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 557/1119] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:44.314988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d608f-dec3-4080-9f91-4c88db4230bd None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:44.349135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:44.416516 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d608f-dec3-4080-9f91-4c88db4230bd None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:44.454313 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2f491-c995-47af-82f8-4d8832f1e940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:44.454928 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2f491-c995-47af-82f8-4d8832f1e940 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:44.455204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2f491-c995-47af-82f8-4d8832f1e940 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:44.455475 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2f491-c995-47af-82f8-4d8832f1e940 None admin] PATH_INFO: `/v3/roles/fd65be88941941298be36b142df9b505` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:44.456883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2f491-c995-47af-82f8-4d8832f1e940 None admin] RBAC: Authorizing `identity:get_role(role_id=fd65be88941941298be36b142df9b505)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:44.458239 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2f491-c995-47af-82f8-4d8832f1e940 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:44.459575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 563/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:35:44 2022] GET /identity/v3/roles/fd65be88941941298be36b142df9b505 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:44.466031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0651097-3377-486b-b1b6-bd979ddbe449 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:44.564930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0651097-3377-486b-b1b6-bd979ddbe449 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:44.598666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb58f2-cbda-4d16-b118-b985a1b9d604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:44.599283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb58f2-cbda-4d16-b118-b985a1b9d604 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:44.599574 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb58f2-cbda-4d16-b118-b985a1b9d604 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:44.599848 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb58f2-cbda-4d16-b118-b985a1b9d604 None admin] PATH_INFO: `/v3/users/4e3fe4f14b734621874876cad9371253` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:44.600974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb58f2-cbda-4d16-b118-b985a1b9d604 None admin] RBAC: Authorizing `identity:get_user(user_id=4e3fe4f14b734621874876cad9371253)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:44.602391 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb58f2-cbda-4d16-b118-b985a1b9d604 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:44.603956 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 558/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:35:44 2022] GET /identity/v3/users/4e3fe4f14b734621874876cad9371253 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:44.610650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2f491-c995-47af-82f8-4d8832f1e940 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:44.705828 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2f491-c995-47af-82f8-4d8832f1e940 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:44.707307 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:44.739784 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec2b38-f190-4b67-adb9-bc3a6f0acad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:44.740406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec2b38-f190-4b67-adb9-bc3a6f0acad9 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:44.740687 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec2b38-f190-4b67-adb9-bc3a6f0acad9 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:44.740957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec2b38-f190-4b67-adb9-bc3a6f0acad9 None admin] PATH_INFO: `/v3/projects/ef101e0c29084f888702045ef07ce7cb` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:44.742073 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec2b38-f190-4b67-adb9-bc3a6f0acad9 None admin] RBAC: Authorizing `identity:get_project(project_id=ef101e0c29084f888702045ef07ce7cb)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:44.743484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec2b38-f190-4b67-adb9-bc3a6f0acad9 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:44.745269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 564/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:35:44 2022] GET /identity/v3/projects/ef101e0c29084f888702045ef07ce7cb => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:44.751072 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb58f2-cbda-4d16-b118-b985a1b9d604 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:44.768584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:44.847772 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb58f2-cbda-4d16-b118-b985a1b9d604 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:44.880413 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00fc8f-372c-4c6b-80ac-d44bb5d5e70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:44.880996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00fc8f-372c-4c6b-80ac-d44bb5d5e70b None admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:44.881268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00fc8f-372c-4c6b-80ac-d44bb5d5e70b None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:44.881536 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00fc8f-372c-4c6b-80ac-d44bb5d5e70b None admin] PATH_INFO: `/v3/projects/ef101e0c29084f888702045ef07ce7cb/users/4e3fe4f14b734621874876cad9371253/roles/fd65be88941941298be36b142df9b505` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:44.883650 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00fc8f-372c-4c6b-80ac-d44bb5d5e70b None admin] RBAC: Authorizing `identity:create_grant(project_id=ef101e0c29084f888702045ef07ce7cb, user_id=4e3fe4f14b734621874876cad9371253, role_id=fd65be88941941298be36b142df9b505)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:44.885176 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00fc8f-372c-4c6b-80ac-d44bb5d5e70b None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:44.964584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 559/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:35:44 2022] PUT /identity/v3/projects/ef101e0c29084f888702045ef07ce7cb/users/4e3fe4f14b734621874876cad9371253/roles/fd65be88941941298be36b142df9b505 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:35:47.126176 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b57a5-753e-4c57-906a-990c4bc7421e None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:47.126704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b57a5-753e-4c57-906a-990c4bc7421e None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:47.126704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b57a5-753e-4c57-906a-990c4bc7421e None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:47.128093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 565/1124] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:47.133222 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555243b-f048-48f3-9b2a-b0a914acef37 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:47.133626 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555243b-f048-48f3-9b2a-b0a914acef37 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:47.133763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555243b-f048-48f3-9b2a-b0a914acef37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:47.152034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-8555243b-f048-48f3-9b2a-b0a914acef37 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:47.153203 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-8555243b-f048-48f3-9b2a-b0a914acef37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:47.217693 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 560/1125] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:47.492275 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b57a5-753e-4c57-906a-990c4bc7421e None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:47.591647 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b57a5-753e-4c57-906a-990c4bc7421e None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:47.624864 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f7fb0-efe5-4202-8b67-ca1cdec3dcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:47.625497 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f7fb0-efe5-4202-8b67-ca1cdec3dcf0 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:47.625777 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f7fb0-efe5-4202-8b67-ca1cdec3dcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:47.626053 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f7fb0-efe5-4202-8b67-ca1cdec3dcf0 None admin] PATH_INFO: `/v3/roles/fd65be88941941298be36b142df9b505` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:47.627453 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f7fb0-efe5-4202-8b67-ca1cdec3dcf0 None admin] RBAC: Authorizing `identity:get_role(role_id=fd65be88941941298be36b142df9b505)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:47.628872 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f7fb0-efe5-4202-8b67-ca1cdec3dcf0 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:47.630237 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 566/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:35:47 2022] GET /identity/v3/roles/fd65be88941941298be36b142df9b505 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:47.636244 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555243b-f048-48f3-9b2a-b0a914acef37 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:47.644468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:47.736708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555243b-f048-48f3-9b2a-b0a914acef37 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:47.769262 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6a5a8-4edf-4828-ad16-bf8363138c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:47.769829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6a5a8-4edf-4828-ad16-bf8363138c17 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:47.770102 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6a5a8-4edf-4828-ad16-bf8363138c17 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:47.770367 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6a5a8-4edf-4828-ad16-bf8363138c17 None admin] PATH_INFO: `/v3/users/4e3fe4f14b734621874876cad9371253` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:47.771462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6a5a8-4edf-4828-ad16-bf8363138c17 None admin] RBAC: Authorizing `identity:get_user(user_id=4e3fe4f14b734621874876cad9371253)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:47.772900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6a5a8-4edf-4828-ad16-bf8363138c17 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:47.774466 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 561/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:35:47 2022] GET /identity/v3/users/4e3fe4f14b734621874876cad9371253 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:47.780785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f7fb0-efe5-4202-8b67-ca1cdec3dcf0 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:47.820018 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:47.877504 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f7fb0-efe5-4202-8b67-ca1cdec3dcf0 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:47.909896 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7114d3f-2238-4e02-a4ee-b8e17ac010e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:47.910497 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7114d3f-2238-4e02-a4ee-b8e17ac010e2 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:47.910771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7114d3f-2238-4e02-a4ee-b8e17ac010e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:47.911038 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7114d3f-2238-4e02-a4ee-b8e17ac010e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:47.974464 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7114d3f-2238-4e02-a4ee-b8e17ac010e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:47.975918 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7114d3f-2238-4e02-a4ee-b8e17ac010e2 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:48.014169 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:48.073921 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 567/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:35:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 19:35:48.079869 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6a5a8-4edf-4828-ad16-bf8363138c17 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:48.151344 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:48.175463 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6a5a8-4edf-4828-ad16-bf8363138c17 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:48.208583 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88158eae-b106-48d4-b753-c5554e00f987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:48.209194 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88158eae-b106-48d4-b753-c5554e00f987 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:48.209468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88158eae-b106-48d4-b753-c5554e00f987 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:48.209735 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88158eae-b106-48d4-b753-c5554e00f987 None admin] PATH_INFO: `/v3/projects/ef101e0c29084f888702045ef07ce7cb` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:48.210826 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88158eae-b106-48d4-b753-c5554e00f987 None admin] RBAC: Authorizing `identity:get_project(project_id=ef101e0c29084f888702045ef07ce7cb)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:48.212264 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88158eae-b106-48d4-b753-c5554e00f987 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:48.213859 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 562/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:35:48 2022] GET /identity/v3/projects/ef101e0c29084f888702045ef07ce7cb => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:48.220541 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7114d3f-2238-4e02-a4ee-b8e17ac010e2 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:48.332683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7114d3f-2238-4e02-a4ee-b8e17ac010e2 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:48.364947 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f552c1-a4fb-4297-98f3-6fc4da94dc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:48.365548 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f552c1-a4fb-4297-98f3-6fc4da94dc37 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:48.365820 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f552c1-a4fb-4297-98f3-6fc4da94dc37 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:48.366086 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f552c1-a4fb-4297-98f3-6fc4da94dc37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:48.366808 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f552c1-a4fb-4297-98f3-6fc4da94dc37 None admin] RBAC: Adding query filter params (role.id=fd65be88941941298be36b142df9b505, scope.project.id=ef101e0c29084f888702045ef07ce7cb, user.id=4e3fe4f14b734621874876cad9371253) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:48.367108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f552c1-a4fb-4297-98f3-6fc4da94dc37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:48.368566 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f552c1-a4fb-4297-98f3-6fc4da94dc37 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:48.375050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 568/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:35:48 2022] GET /identity/v3/role_assignments?user.id=4e3fe4f14b734621874876cad9371253&scope.project.id=ef101e0c29084f888702045ef07ce7cb&role.id=fd65be88941941298be36b142df9b505 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:50.580414 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058758e-14c7-44b9-b75c-75ece46f071c None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:50.580965 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058758e-14c7-44b9-b75c-75ece46f071c None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:50.580965 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058758e-14c7-44b9-b75c-75ece46f071c None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:50.582294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 563/1131] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:50.587580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95f380-ab0d-4dc2-b855-87fe14fd6ff0 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:50.587977 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95f380-ab0d-4dc2-b855-87fe14fd6ff0 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:50.588131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95f380-ab0d-4dc2-b855-87fe14fd6ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:50.594319 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:50.606112 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-bb95f380-ab0d-4dc2-b855-87fe14fd6ff0 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:50.607282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-bb95f380-ab0d-4dc2-b855-87fe14fd6ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:50.671117 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 569/1132] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:50.939408 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058758e-14c7-44b9-b75c-75ece46f071c None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:51.038430 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058758e-14c7-44b9-b75c-75ece46f071c None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:51.070308 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253991c7-6126-4aef-ac48-dd02e7dfb096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:51.070923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253991c7-6126-4aef-ac48-dd02e7dfb096 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:51.071199 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253991c7-6126-4aef-ac48-dd02e7dfb096 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:51.071470 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253991c7-6126-4aef-ac48-dd02e7dfb096 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:51.072603 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253991c7-6126-4aef-ac48-dd02e7dfb096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:51.074665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253991c7-6126-4aef-ac48-dd02e7dfb096 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:51.076235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 564/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:51.082003 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95f380-ab0d-4dc2-b855-87fe14fd6ff0 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:51.178625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95f380-ab0d-4dc2-b855-87fe14fd6ff0 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:51.208118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:51.212823 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7dd2b-77ab-46df-9775-1cd01b8d2643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:51.213422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7dd2b-77ab-46df-9775-1cd01b8d2643 None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:51.213699 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7dd2b-77ab-46df-9775-1cd01b8d2643 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:51.213969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7dd2b-77ab-46df-9775-1cd01b8d2643 None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:51.215041 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7dd2b-77ab-46df-9775-1cd01b8d2643 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:51.216534 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7dd2b-77ab-46df-9775-1cd01b8d2643 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:51.348994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 570/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Sep 14 19:35:51 2022] POST /identity/v3/projects => generated 311 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:35:53.524195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56316c2a-8caa-459e-ac17-1c8cf10df9a0 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:53.524766 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56316c2a-8caa-459e-ac17-1c8cf10df9a0 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:53.524766 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56316c2a-8caa-459e-ac17-1c8cf10df9a0 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:53.526051 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 565/1135] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:53.531563 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325737c1-ff2c-4f70-97ad-417eed130cd9 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:53.532013 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325737c1-ff2c-4f70-97ad-417eed130cd9 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:53.532140 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325737c1-ff2c-4f70-97ad-417eed130cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:53.549924 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-325737c1-ff2c-4f70-97ad-417eed130cd9 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:53.551113 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-325737c1-ff2c-4f70-97ad-417eed130cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:53.615335 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 571/1136] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:53.883436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56316c2a-8caa-459e-ac17-1c8cf10df9a0 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:53.896377 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:53.984234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56316c2a-8caa-459e-ac17-1c8cf10df9a0 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:54.017053 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c5b6b-eccd-4a05-992a-105634446199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:54.017670 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c5b6b-eccd-4a05-992a-105634446199 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:54.017943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c5b6b-eccd-4a05-992a-105634446199 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:54.018209 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c5b6b-eccd-4a05-992a-105634446199 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:54.019306 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c5b6b-eccd-4a05-992a-105634446199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:54.020758 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c5b6b-eccd-4a05-992a-105634446199 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:54.022287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 566/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:35:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:54.028599 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325737c1-ff2c-4f70-97ad-417eed130cd9 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:54.126266 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325737c1-ff2c-4f70-97ad-417eed130cd9 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:54.140517 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:54.161068 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5338bb1-4f7e-44ef-ad4b-541ebbfdddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:54.161668 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5338bb1-4f7e-44ef-ad4b-541ebbfdddca None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:54.161946 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5338bb1-4f7e-44ef-ad4b-541ebbfdddca None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:54.162217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5338bb1-4f7e-44ef-ad4b-541ebbfdddca None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:54.162854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5338bb1-4f7e-44ef-ad4b-541ebbfdddca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:54.164549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5338bb1-4f7e-44ef-ad4b-541ebbfdddca None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:54.228278 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 572/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Sep 14 19:35:54 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:35:56.409183 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f268574-6390-443f-b1aa-93d7a232747f None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:56.409674 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f268574-6390-443f-b1aa-93d7a232747f None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:56.409773 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f268574-6390-443f-b1aa-93d7a232747f None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:56.411060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 567/1139] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:56.416473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fb23b-92e3-43c1-813f-82bc7231155e None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:56.416858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fb23b-92e3-43c1-813f-82bc7231155e None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:56.417021 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fb23b-92e3-43c1-813f-82bc7231155e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:56.434908 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-997fb23b-92e3-43c1-813f-82bc7231155e None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:56.436111 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-997fb23b-92e3-43c1-813f-82bc7231155e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:35:56.500449 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 573/1140] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:35:56.768075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f268574-6390-443f-b1aa-93d7a232747f None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:56.846910 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:56.869143 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f268574-6390-443f-b1aa-93d7a232747f None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:56.901731 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ce04c-f1f5-46bf-a195-9cff19c226cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:56.902913 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ce04c-f1f5-46bf-a195-9cff19c226cc None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:56.903312 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ce04c-f1f5-46bf-a195-9cff19c226cc None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:56.903615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ce04c-f1f5-46bf-a195-9cff19c226cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:56.913784 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ce04c-f1f5-46bf-a195-9cff19c226cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:35:56.919274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-515ce04c-f1f5-46bf-a195-9cff19c226cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:35:56.919274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:35:56.919274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:35:56.919274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:35:56.919274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:35:56.919274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:35:56.919274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:35:56.919274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:35:56.919274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:35:56.919274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:35:56.919274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:35:56.919274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:35:56.919274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:35:56.919274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:35:56.919274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:35:56.919274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:35:56.920484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:35:56.920484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:35:56.920484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:35:56.920484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:35:56.920484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:35:56.920484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:35:56.920484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:35:56.920484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:35:56.920484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:35:56.920484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:35:56.920484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:35:56.920484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:35:56.920484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:35:56.920484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:35:56.920484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:35:56.920484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:35:56.921701 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:35:56.921701 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:35:56.921701 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:35:56.921701 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:35:56.921701 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:35:56.921701 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:35:56.921701 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:35:56.921701 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:35:56.921701 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:35:56.921701 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:35:56.921701 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:35:56.921701 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:35:56.921701 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 568/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:35:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:35:56.926369 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fb23b-92e3-43c1-813f-82bc7231155e None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:57.021226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:57.024167 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fb23b-92e3-43c1-813f-82bc7231155e None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:57.061872 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d936826-90e2-48ce-a2fe-a504f65db440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:57.062475 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d936826-90e2-48ce-a2fe-a504f65db440 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:57.062755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d936826-90e2-48ce-a2fe-a504f65db440 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:57.063030 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d936826-90e2-48ce-a2fe-a504f65db440 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:57.063720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d936826-90e2-48ce-a2fe-a504f65db440 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:57.064027 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d936826-90e2-48ce-a2fe-a504f65db440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:57.065387 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d936826-90e2-48ce-a2fe-a504f65db440 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:57.073106 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 574/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:35:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:57.079828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ce04c-f1f5-46bf-a195-9cff19c226cc None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:57.178205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ce04c-f1f5-46bf-a195-9cff19c226cc None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:57.210666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc4579-0725-4b14-a682-399664939002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:57.211283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc4579-0725-4b14-a682-399664939002 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:57.211582 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc4579-0725-4b14-a682-399664939002 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:57.211863 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc4579-0725-4b14-a682-399664939002 None admin] PATH_INFO: `/v3/users/ea52ca8ae49248c380624a472b5e0860` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:57.220700 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:57.226243 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc4579-0725-4b14-a682-399664939002 None admin] RBAC: Authorizing `identity:get_user(user_id=ea52ca8ae49248c380624a472b5e0860)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:57.234419 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc4579-0725-4b14-a682-399664939002 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:57.234419 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 569/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:35:57 2022] GET /identity/v3/users/ea52ca8ae49248c380624a472b5e0860 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:57.235505 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d936826-90e2-48ce-a2fe-a504f65db440 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:57.331331 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d936826-90e2-48ce-a2fe-a504f65db440 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:57.362548 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2cbfd-6458-4224-b1a8-f00fd3c7387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:57.363144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2cbfd-6458-4224-b1a8-f00fd3c7387d None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:57.363419 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2cbfd-6458-4224-b1a8-f00fd3c7387d None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:57.363713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2cbfd-6458-4224-b1a8-f00fd3c7387d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:57.393727 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:57.429608 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2cbfd-6458-4224-b1a8-f00fd3c7387d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:57.431038 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2cbfd-6458-4224-b1a8-f00fd3c7387d None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:57.526222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 575/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:35:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 19:35:57.532264 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc4579-0725-4b14-a682-399664939002 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:57.629951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc4579-0725-4b14-a682-399664939002 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:57.663333 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b33c5-62e2-48ba-b245-0d0cada87be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:57.664236 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b33c5-62e2-48ba-b245-0d0cada87be0 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:57.664517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b33c5-62e2-48ba-b245-0d0cada87be0 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:57.664789 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b33c5-62e2-48ba-b245-0d0cada87be0 None admin] PATH_INFO: `/v3/projects/b1e577e0277f4f6d9acf14613cff5e87` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:57.665905 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b33c5-62e2-48ba-b245-0d0cada87be0 None admin] RBAC: Authorizing `identity:get_project(project_id=b1e577e0277f4f6d9acf14613cff5e87)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:57.667326 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b33c5-62e2-48ba-b245-0d0cada87be0 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:57.669552 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 570/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:35:57 2022] GET /identity/v3/projects/b1e577e0277f4f6d9acf14613cff5e87 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:57.675852 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2cbfd-6458-4224-b1a8-f00fd3c7387d None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:35:57.734030 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:35:57.770910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2cbfd-6458-4224-b1a8-f00fd3c7387d None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:35:57.804108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe106d-1f36-4372-a1d4-57a3fdc7d6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:35:57.804707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe106d-1f36-4372-a1d4-57a3fdc7d6e5 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:57.804986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe106d-1f36-4372-a1d4-57a3fdc7d6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:57.805260 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe106d-1f36-4372-a1d4-57a3fdc7d6e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:57.805985 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe106d-1f36-4372-a1d4-57a3fdc7d6e5 None admin] RBAC: Adding query filter params (role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a, scope.project.id=b1e577e0277f4f6d9acf14613cff5e87, user.id=ea52ca8ae49248c380624a472b5e0860) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:35:57.806289 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe106d-1f36-4372-a1d4-57a3fdc7d6e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:35:57.807740 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe106d-1f36-4372-a1d4-57a3fdc7d6e5 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:35:57.813485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 576/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:35:57 2022] GET /identity/v3/role_assignments?user.id=ea52ca8ae49248c380624a472b5e0860&scope.project.id=b1e577e0277f4f6d9acf14613cff5e87&role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:35:59.939372 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76874c8f-ee71-4578-9ad6-53b3cb908eb2 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:59.939963 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76874c8f-ee71-4578-9ad6-53b3cb908eb2 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:59.939963 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76874c8f-ee71-4578-9ad6-53b3cb908eb2 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:59.941283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 571/1147] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:35:59.946609 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f160c99-e5e8-40df-9662-b58dc5f80089 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:35:59.947022 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f160c99-e5e8-40df-9662-b58dc5f80089 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:35:59.947121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f160c99-e5e8-40df-9662-b58dc5f80089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:35:59.965840 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-2f160c99-e5e8-40df-9662-b58dc5f80089 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:35:59.967015 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2f160c99-e5e8-40df-9662-b58dc5f80089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:36:00.030240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 577/1148] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:35:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:36:00.302492 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76874c8f-ee71-4578-9ad6-53b3cb908eb2 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:00.365837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:00.406271 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76874c8f-ee71-4578-9ad6-53b3cb908eb2 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:00.439309 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a214e-7ccf-4533-bfd8-396502d9778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:00.439950 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a214e-7ccf-4533-bfd8-396502d9778c None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:00.440225 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a214e-7ccf-4533-bfd8-396502d9778c None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:00.440493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a214e-7ccf-4533-bfd8-396502d9778c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:00.450752 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a214e-7ccf-4533-bfd8-396502d9778c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:36:00.455471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-131a214e-7ccf-4533-bfd8-396502d9778c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:36:00.455471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:36:00.455471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:36:00.455471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:36:00.455471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:36:00.455471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:36:00.455471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:36:00.455471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:36:00.455471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:36:00.455471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:36:00.455471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:36:00.455471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:36:00.455471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:36:00.455471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:36:00.455471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:36:00.455471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:36:00.456596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:36:00.456596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:36:00.456596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:36:00.456596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:36:00.456596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:36:00.456596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:36:00.456596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:36:00.456596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:36:00.456596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:36:00.456596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:36:00.456596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:36:00.456596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:36:00.456596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:36:00.456596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:36:00.456596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:36:00.456596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:36:00.457635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:36:00.457635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:36:00.457635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:36:00.457635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:36:00.457635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:36:00.457635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:36:00.457635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:36:00.457635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:36:00.457635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:36:00.457635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:36:00.457635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:36:00.457635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:36:00.457635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 572/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:36:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:36:00.462668 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f160c99-e5e8-40df-9662-b58dc5f80089 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:00.516880 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:00.559226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f160c99-e5e8-40df-9662-b58dc5f80089 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:00.591793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f8a8e-2373-4733-925e-87f7be487b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:00.592397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f8a8e-2373-4733-925e-87f7be487b60 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:00.592674 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f8a8e-2373-4733-925e-87f7be487b60 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:00.592944 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f8a8e-2373-4733-925e-87f7be487b60 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:00.593596 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f8a8e-2373-4733-925e-87f7be487b60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:36:00.593900 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f8a8e-2373-4733-925e-87f7be487b60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:00.595249 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f8a8e-2373-4733-925e-87f7be487b60 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:00.603025 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 578/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:36:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:36:00.609535 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a214e-7ccf-4533-bfd8-396502d9778c None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:00.706478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a214e-7ccf-4533-bfd8-396502d9778c None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:00.728929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:00.739717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60906eed-4021-4924-bcc4-da31a7764048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:00.740335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60906eed-4021-4924-bcc4-da31a7764048 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:00.740609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60906eed-4021-4924-bcc4-da31a7764048 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:00.740877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60906eed-4021-4924-bcc4-da31a7764048 None admin] PATH_INFO: `/v3/users/ea52ca8ae49248c380624a472b5e0860` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:00.741980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60906eed-4021-4924-bcc4-da31a7764048 None admin] RBAC: Authorizing `identity:get_user(user_id=ea52ca8ae49248c380624a472b5e0860)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:00.743398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60906eed-4021-4924-bcc4-da31a7764048 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:00.744984 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 573/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:36:00 2022] GET /identity/v3/users/ea52ca8ae49248c380624a472b5e0860 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:36:00.751224 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f8a8e-2373-4733-925e-87f7be487b60 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:00.848087 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f8a8e-2373-4733-925e-87f7be487b60 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:00.863933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:00.879922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe57bf-9eb7-45f7-9c86-71a3283dd51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:00.880542 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe57bf-9eb7-45f7-9c86-71a3283dd51d None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:00.880816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe57bf-9eb7-45f7-9c86-71a3283dd51d None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:00.881081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe57bf-9eb7-45f7-9c86-71a3283dd51d None admin] PATH_INFO: `/v3/projects/b1e577e0277f4f6d9acf14613cff5e87` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:00.882172 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe57bf-9eb7-45f7-9c86-71a3283dd51d None admin] RBAC: Authorizing `identity:get_project(project_id=b1e577e0277f4f6d9acf14613cff5e87)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:00.883597 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe57bf-9eb7-45f7-9c86-71a3283dd51d None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:00.885195 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 579/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:36:00 2022] GET /identity/v3/projects/b1e577e0277f4f6d9acf14613cff5e87 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:36:00.891683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60906eed-4021-4924-bcc4-da31a7764048 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:00.988421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60906eed-4021-4924-bcc4-da31a7764048 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:01.021335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce467a-1d71-4db6-a987-dd48b3d778a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:01.021980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce467a-1d71-4db6-a987-dd48b3d778a9 None admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:01.022258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce467a-1d71-4db6-a987-dd48b3d778a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:01.022533 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce467a-1d71-4db6-a987-dd48b3d778a9 None admin] PATH_INFO: `/v3/projects/b1e577e0277f4f6d9acf14613cff5e87/users/ea52ca8ae49248c380624a472b5e0860/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:01.024439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce467a-1d71-4db6-a987-dd48b3d778a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1e577e0277f4f6d9acf14613cff5e87, user_id=ea52ca8ae49248c380624a472b5e0860, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:01.025856 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce467a-1d71-4db6-a987-dd48b3d778a9 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:01.121058 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 574/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:36:00 2022] PUT /identity/v3/projects/b1e577e0277f4f6d9acf14613cff5e87/users/ea52ca8ae49248c380624a472b5e0860/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:36:03.294232 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fe312-14f3-4e9b-8844-23d975b251ec None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:03.294795 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fe312-14f3-4e9b-8844-23d975b251ec None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:03.294929 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fe312-14f3-4e9b-8844-23d975b251ec None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:03.296348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 580/1154] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:36:03.301601 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc2ff1-7a84-4ee9-92d2-d484541054f0 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:03.302030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc2ff1-7a84-4ee9-92d2-d484541054f0 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:03.302122 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc2ff1-7a84-4ee9-92d2-d484541054f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:03.320087 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-04dc2ff1-7a84-4ee9-92d2-d484541054f0 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:36:03.321244 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-04dc2ff1-7a84-4ee9-92d2-d484541054f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:36:03.367279 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:03.388915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 575/1155] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:36:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:36:03.669287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fe312-14f3-4e9b-8844-23d975b251ec None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:03.769075 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fe312-14f3-4e9b-8844-23d975b251ec None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:03.801607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4604f-ada3-442f-a8cc-c6389eb1904b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:03.802236 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4604f-ada3-442f-a8cc-c6389eb1904b None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:03.802514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4604f-ada3-442f-a8cc-c6389eb1904b None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:03.802782 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4604f-ada3-442f-a8cc-c6389eb1904b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:03.813216 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4604f-ada3-442f-a8cc-c6389eb1904b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:36:03.817981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-caa4604f-ada3-442f-a8cc-c6389eb1904b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:36:03.817981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:36:03.817981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:36:03.817981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:36:03.817981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:36:03.817981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:36:03.817981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:36:03.817981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:36:03.817981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:36:03.817981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:36:03.817981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:36:03.817981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:36:03.817981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:36:03.817981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:36:03.817981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:36:03.817981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:36:03.823428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:36:03.823428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:36:03.823428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:36:03.823428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:36:03.823428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:36:03.823428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:36:03.823428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:36:03.823428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:36:03.823428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:36:03.823428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:36:03.823428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:36:03.823428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:36:03.823428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:36:03.823428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:36:03.823428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:36:03.823428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:36:03.824486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:36:03.824486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:36:03.824486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:36:03.824486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:36:03.824486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:36:03.824486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:36:03.824486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:36:03.824486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:36:03.824486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:36:03.824486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:36:03.824486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:36:03.824486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:36:03.824486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 581/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:36:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:36:03.825843 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc2ff1-7a84-4ee9-92d2-d484541054f0 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:03.923330 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc2ff1-7a84-4ee9-92d2-d484541054f0 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:03.956619 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cd9c3-a8a4-4e74-863f-d887aac35836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:03.957211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cd9c3-a8a4-4e74-863f-d887aac35836 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:03.957487 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cd9c3-a8a4-4e74-863f-d887aac35836 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:03.957756 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cd9c3-a8a4-4e74-863f-d887aac35836 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:03.958432 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795cd9c3-a8a4-4e74-863f-d887aac35836 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:36:03.958712 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795cd9c3-a8a4-4e74-863f-d887aac35836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:03.960097 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795cd9c3-a8a4-4e74-863f-d887aac35836 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:03.968595 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 576/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:36:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:36:03.974747 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4604f-ada3-442f-a8cc-c6389eb1904b None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:04.019796 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:04.071942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4604f-ada3-442f-a8cc-c6389eb1904b None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:04.109453 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6e957-1b7b-42c2-a3af-78735e3b7ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:04.110081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6e957-1b7b-42c2-a3af-78735e3b7ec6 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:04.110355 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6e957-1b7b-42c2-a3af-78735e3b7ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:04.110621 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6e957-1b7b-42c2-a3af-78735e3b7ec6 None admin] PATH_INFO: `/v3/users/ea52ca8ae49248c380624a472b5e0860` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:04.111831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6e957-1b7b-42c2-a3af-78735e3b7ec6 None admin] RBAC: Authorizing `identity:get_user(user_id=ea52ca8ae49248c380624a472b5e0860)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:04.113243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6e957-1b7b-42c2-a3af-78735e3b7ec6 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:04.114808 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 582/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:36:03 2022] GET /identity/v3/users/ea52ca8ae49248c380624a472b5e0860 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:36:04.120805 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cd9c3-a8a4-4e74-863f-d887aac35836 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:04.166515 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:04.220096 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cd9c3-a8a4-4e74-863f-d887aac35836 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:04.252973 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6e679-1efe-40d7-9a81-710df5973d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:04.253568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6e679-1efe-40d7-9a81-710df5973d92 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:04.253844 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6e679-1efe-40d7-9a81-710df5973d92 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:04.254114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6e679-1efe-40d7-9a81-710df5973d92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:04.324491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6e679-1efe-40d7-9a81-710df5973d92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:04.326560 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6e679-1efe-40d7-9a81-710df5973d92 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:04.368338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:04.425489 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 577/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:36:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 19:36:04.431509 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6e957-1b7b-42c2-a3af-78735e3b7ec6 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:04.527306 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6e957-1b7b-42c2-a3af-78735e3b7ec6 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:04.540413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:04.560942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0b412-4439-45fd-b40d-d00ad99b7470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:04.561568 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0b412-4439-45fd-b40d-d00ad99b7470 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:04.561850 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0b412-4439-45fd-b40d-d00ad99b7470 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:04.562124 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0b412-4439-45fd-b40d-d00ad99b7470 None admin] PATH_INFO: `/v3/projects/b1e577e0277f4f6d9acf14613cff5e87` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:04.563240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0b412-4439-45fd-b40d-d00ad99b7470 None admin] RBAC: Authorizing `identity:get_project(project_id=b1e577e0277f4f6d9acf14613cff5e87)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:04.564692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0b412-4439-45fd-b40d-d00ad99b7470 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:04.566388 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 583/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:36:04 2022] GET /identity/v3/projects/b1e577e0277f4f6d9acf14613cff5e87 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:36:04.572546 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6e679-1efe-40d7-9a81-710df5973d92 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:04.668346 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6e679-1efe-40d7-9a81-710df5973d92 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:04.702092 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104b653-64ec-4ec3-bddd-9a66b7f451b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:04.702678 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104b653-64ec-4ec3-bddd-9a66b7f451b9 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:04.702956 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104b653-64ec-4ec3-bddd-9a66b7f451b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:04.703227 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104b653-64ec-4ec3-bddd-9a66b7f451b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:04.703971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104b653-64ec-4ec3-bddd-9a66b7f451b9 None admin] RBAC: Adding query filter params (role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a, scope.project.id=b1e577e0277f4f6d9acf14613cff5e87, user.id=ea52ca8ae49248c380624a472b5e0860) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:36:04.704279 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104b653-64ec-4ec3-bddd-9a66b7f451b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:04.705698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104b653-64ec-4ec3-bddd-9a66b7f451b9 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:04.711327 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 578/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:36:04 2022] GET /identity/v3/role_assignments?user.id=ea52ca8ae49248c380624a472b5e0860&scope.project.id=b1e577e0277f4f6d9acf14613cff5e87&role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:36:06.890974 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114600f8-dc06-47d9-ac98-5ccfe4241f57 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:06.891527 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114600f8-dc06-47d9-ac98-5ccfe4241f57 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:06.891527 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114600f8-dc06-47d9-ac98-5ccfe4241f57 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:06.892873 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 584/1162] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:36:06.898052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5f56d-1890-4a90-98cc-000cda0154bf None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:06.898468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5f56d-1890-4a90-98cc-000cda0154bf None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:06.898580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5f56d-1890-4a90-98cc-000cda0154bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:06.917578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-90b5f56d-1890-4a90-98cc-000cda0154bf None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:36:06.918781 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-90b5f56d-1890-4a90-98cc-000cda0154bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:36:06.921140 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:06.985613 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 579/1163] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:36:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 19:36:07.261111 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114600f8-dc06-47d9-ac98-5ccfe4241f57 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:07.361499 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114600f8-dc06-47d9-ac98-5ccfe4241f57 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:07.395250 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade66258-f074-4cf3-b97a-605703912519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:07.396053 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade66258-f074-4cf3-b97a-605703912519 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:07.396334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade66258-f074-4cf3-b97a-605703912519 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:07.396607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade66258-f074-4cf3-b97a-605703912519 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:07.444290 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:07.461864 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade66258-f074-4cf3-b97a-605703912519 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:07.469756 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade66258-f074-4cf3-b97a-605703912519 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:07.557646 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 585/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:36:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 19:36:07.563537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5f56d-1890-4a90-98cc-000cda0154bf None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:07.658989 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5f56d-1890-4a90-98cc-000cda0154bf None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:07.692617 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13062e-5a51-4e42-8642-14dca80306bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:07.693237 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13062e-5a51-4e42-8642-14dca80306bc None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:07.693514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13062e-5a51-4e42-8642-14dca80306bc None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:07.693784 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13062e-5a51-4e42-8642-14dca80306bc None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:07.700943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13062e-5a51-4e42-8642-14dca80306bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:07.702422 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13062e-5a51-4e42-8642-14dca80306bc None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:07.704148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:07.714103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-1b13062e-5a51-4e42-8642-14dca80306bc None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 14 19:36:07.714103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:36:07.714103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 14 19:36:07.714103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 14 19:36:07.714103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:36:07.714103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:36:07.714103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:36:07.714103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:36:07.714103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 14 19:36:07.714103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:36:07.714103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:36:07.714103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:36:07.714103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:36:07.714103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:36:07.714103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:36:07.714103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:36:07.714103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:36:07.722205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:36:07.722205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:36:07.722205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:36:07.722205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:36:07.722205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:36:07.722205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:36:07.722205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:36:07.722205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:36:07.722205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:36:07.722205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:36:07.722205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:36:07.722205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:36:07.722205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:36:07.722205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:36:07.722205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:36:07.722205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:36:07.723331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:36:07.723331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:36:07.723331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:36:07.723331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:36:07.723331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:36:07.723331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:36:07.723331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:36:07.723331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:36:07.723331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:36:07.723331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:36:07.723331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 14 19:36:07.723331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:36:07.723331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 14 19:36:07.723331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:36:07.723331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 580/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Sep 14 19:36:07 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:36:07.724250 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade66258-f074-4cf3-b97a-605703912519 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:07.799249 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:07.817098 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade66258-f074-4cf3-b97a-605703912519 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:07.850590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ef524-b273-40b3-a091-6eeebbb00385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:07.851188 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ef524-b273-40b3-a091-6eeebbb00385 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:07.851466 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ef524-b273-40b3-a091-6eeebbb00385 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:07.851763 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ef524-b273-40b3-a091-6eeebbb00385 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:07.852390 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ef524-b273-40b3-a091-6eeebbb00385 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:36:07.852689 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ef524-b273-40b3-a091-6eeebbb00385 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:07.854036 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ef524-b273-40b3-a091-6eeebbb00385 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:07.861410 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 586/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Wed Sep 14 19:36:07 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:36:09.982810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d09e46-7f94-4cb9-af93-68f8313ea2ed None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:09.983342 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d09e46-7f94-4cb9-af93-68f8313ea2ed None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:09.983342 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d09e46-7f94-4cb9-af93-68f8313ea2ed None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:09.984704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 581/1167] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:36:09.989899 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b786008-bdd4-4c1d-a506-8a141d9b3310 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:09.990290 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b786008-bdd4-4c1d-a506-8a141d9b3310 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:09.990456 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b786008-bdd4-4c1d-a506-8a141d9b3310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:10.008439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-7b786008-bdd4-4c1d-a506-8a141d9b3310 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:36:10.009633 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-7b786008-bdd4-4c1d-a506-8a141d9b3310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:36:10.074248 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 587/1168] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:36:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 19:36:10.349960 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d09e46-7f94-4cb9-af93-68f8313ea2ed None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:10.449746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d09e46-7f94-4cb9-af93-68f8313ea2ed None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:10.483410 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160865b-7f9a-4354-900d-e16fe9615c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:10.484066 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160865b-7f9a-4354-900d-e16fe9615c7a None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:10.484393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160865b-7f9a-4354-900d-e16fe9615c7a None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:10.484661 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160865b-7f9a-4354-900d-e16fe9615c7a None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:10.485328 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160865b-7f9a-4354-900d-e16fe9615c7a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:10.486681 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160865b-7f9a-4354-900d-e16fe9615c7a None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:10.573930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 582/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Wed Sep 14 19:36:10 2022] POST /identity/v3/domains => generated 267 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:36:12.754147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39870bfd-1cc1-4817-b23b-5f8e8fea0392 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:12.754662 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39870bfd-1cc1-4817-b23b-5f8e8fea0392 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:12.754662 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39870bfd-1cc1-4817-b23b-5f8e8fea0392 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:12.756013 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 588/1170] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:36:12.761109 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedd7d6-f4c9-4c12-bb37-4c1da3979a17 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:12.761498 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedd7d6-f4c9-4c12-bb37-4c1da3979a17 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:12.761653 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedd7d6-f4c9-4c12-bb37-4c1da3979a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:12.779402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-5bedd7d6-f4c9-4c12-bb37-4c1da3979a17 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:36:12.780601 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-5bedd7d6-f4c9-4c12-bb37-4c1da3979a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:36:12.834423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:12.848033 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 583/1171] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:36:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:36:13.113255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39870bfd-1cc1-4817-b23b-5f8e8fea0392 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:13.189363 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:13.211790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39870bfd-1cc1-4817-b23b-5f8e8fea0392 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:13.246093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205472a-69d6-48ae-9c4b-b7451531d39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:13.246722 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205472a-69d6-48ae-9c4b-b7451531d39a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:13.247002 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205472a-69d6-48ae-9c4b-b7451531d39a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:13.247271 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205472a-69d6-48ae-9c4b-b7451531d39a None admin] PATH_INFO: `/v3/domains/e90273fa08b94873819ec68d565233d0` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:13.257779 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205472a-69d6-48ae-9c4b-b7451531d39a None admin] RBAC: Authorizing `identity:get_domain(domain_id=e90273fa08b94873819ec68d565233d0)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:13.259204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205472a-69d6-48ae-9c4b-b7451531d39a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:13.260816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 589/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Wed Sep 14 19:36:13 2022] GET /identity/v3/domains/e90273fa08b94873819ec68d565233d0 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:36:13.266661 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedd7d6-f4c9-4c12-bb37-4c1da3979a17 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:13.365488 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedd7d6-f4c9-4c12-bb37-4c1da3979a17 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:13.398725 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046d847-2b96-49e7-8569-0e9c6fa5ebe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:13.399330 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046d847-2b96-49e7-8569-0e9c6fa5ebe7 None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:13.399641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046d847-2b96-49e7-8569-0e9c6fa5ebe7 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:13.399914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046d847-2b96-49e7-8569-0e9c6fa5ebe7 None admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:13.400569 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046d847-2b96-49e7-8569-0e9c6fa5ebe7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:13.401995 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046d847-2b96-49e7-8569-0e9c6fa5ebe7 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:13.505639 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 584/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Sep 14 19:36:13 2022] POST /identity/v3/projects => generated 361 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:36:15.660296 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8cdea-2b44-4488-834f-5e433ec87968 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:15.660794 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8cdea-2b44-4488-834f-5e433ec87968 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:15.660794 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8cdea-2b44-4488-834f-5e433ec87968 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:15.662114 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 590/1174] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:36:15.667532 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef65a5-e3bb-4e32-8b34-a9cc1a253a42 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:15.667975 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef65a5-e3bb-4e32-8b34-a9cc1a253a42 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:15.668103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef65a5-e3bb-4e32-8b34-a9cc1a253a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:15.687137 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-53ef65a5-e3bb-4e32-8b34-a9cc1a253a42 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:36:15.688336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-53ef65a5-e3bb-4e32-8b34-a9cc1a253a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:36:15.723277 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:15.755410 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 585/1175] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:36:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:36:16.022646 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8cdea-2b44-4488-834f-5e433ec87968 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:16.124731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8cdea-2b44-4488-834f-5e433ec87968 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:16.157744 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b6cfd-0adc-44ec-8cd1-39002c8e8cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:16.158370 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b6cfd-0adc-44ec-8cd1-39002c8e8cb2 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:16.158652 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b6cfd-0adc-44ec-8cd1-39002c8e8cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:16.158926 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b6cfd-0adc-44ec-8cd1-39002c8e8cb2 None admin] PATH_INFO: `/v3/domains/e90273fa08b94873819ec68d565233d0` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:16.160073 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b6cfd-0adc-44ec-8cd1-39002c8e8cb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e90273fa08b94873819ec68d565233d0)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:16.161499 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b6cfd-0adc-44ec-8cd1-39002c8e8cb2 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:16.163056 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 591/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Wed Sep 14 19:36:16 2022] GET /identity/v3/domains/e90273fa08b94873819ec68d565233d0 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:36:16.169004 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef65a5-e3bb-4e32-8b34-a9cc1a253a42 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:16.263777 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef65a5-e3bb-4e32-8b34-a9cc1a253a42 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:16.298505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5abf6-f78c-40a2-9e2a-3563dde1423a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:16.299042 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5abf6-f78c-40a2-9e2a-3563dde1423a None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:16.299313 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5abf6-f78c-40a2-9e2a-3563dde1423a None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:16.299601 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5abf6-f78c-40a2-9e2a-3563dde1423a None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:16.300255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5abf6-f78c-40a2-9e2a-3563dde1423a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:16.301774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5abf6-f78c-40a2-9e2a-3563dde1423a None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:16.426157 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 586/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Sep 14 19:36:16 2022] POST /identity/v3/users => generated 311 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:36:18.610891 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47615d27-759e-4b12-b903-857563d0deed None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:18.611455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47615d27-759e-4b12-b903-857563d0deed None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:18.611455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47615d27-759e-4b12-b903-857563d0deed None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:18.612819 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 592/1178] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:36:18.617953 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed073e-c43c-4390-a36b-f491a819fe52 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:18.618354 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed073e-c43c-4390-a36b-f491a819fe52 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:18.618492 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed073e-c43c-4390-a36b-f491a819fe52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:18.636225 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-77ed073e-c43c-4390-a36b-f491a819fe52 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:36:18.637321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-77ed073e-c43c-4390-a36b-f491a819fe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:36:18.657112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:18.703585 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 587/1179] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:36:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:36:18.978206 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47615d27-759e-4b12-b903-857563d0deed None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:18.982026 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:19.079197 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47615d27-759e-4b12-b903-857563d0deed None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:19.119452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9065cb6-d92c-464b-aa45-896ca5777380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:19.120119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9065cb6-d92c-464b-aa45-896ca5777380 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:19.120400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9065cb6-d92c-464b-aa45-896ca5777380 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:19.120676 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9065cb6-d92c-464b-aa45-896ca5777380 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:19.131454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9065cb6-d92c-464b-aa45-896ca5777380 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:36:19.136267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-b9065cb6-d92c-464b-aa45-896ca5777380 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:36:19.136267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:36:19.136267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:36:19.136267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:36:19.136267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:36:19.136267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:36:19.136267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:36:19.136267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:36:19.136267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:36:19.136267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:36:19.136267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:36:19.136267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:36:19.136267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:36:19.136267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:36:19.136267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:36:19.136267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:36:19.139574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:36:19.139574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:36:19.139574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:36:19.139574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:36:19.139574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:36:19.139574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:36:19.139574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:36:19.139574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:36:19.139574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:36:19.139574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:36:19.139574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:36:19.139574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:36:19.139574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:36:19.139574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:36:19.139574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:36:19.139574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:36:19.140730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:36:19.140730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:36:19.140730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:36:19.140730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:36:19.140730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:36:19.140730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:36:19.140730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:36:19.140730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:36:19.140730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:36:19.140730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:36:19.140730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:36:19.140730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:36:19.140730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 593/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:36:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:36:19.143840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed073e-c43c-4390-a36b-f491a819fe52 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:19.239316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed073e-c43c-4390-a36b-f491a819fe52 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:19.272660 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb0677-6e8c-41a2-89c4-88027fb05817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:19.273268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb0677-6e8c-41a2-89c4-88027fb05817 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:19.273550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb0677-6e8c-41a2-89c4-88027fb05817 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:19.273822 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb0677-6e8c-41a2-89c4-88027fb05817 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:19.274497 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb0677-6e8c-41a2-89c4-88027fb05817 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:36:19.274784 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb0677-6e8c-41a2-89c4-88027fb05817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:19.276173 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb0677-6e8c-41a2-89c4-88027fb05817 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:19.284613 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 588/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:36:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:36:19.290765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9065cb6-d92c-464b-aa45-896ca5777380 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:19.352706 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:19.390052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9065cb6-d92c-464b-aa45-896ca5777380 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:19.423755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3b50e-cfd6-46ff-a0a0-fcae8b6359d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:19.424380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3b50e-cfd6-46ff-a0a0-fcae8b6359d8 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:19.424661 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3b50e-cfd6-46ff-a0a0-fcae8b6359d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:19.424933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3b50e-cfd6-46ff-a0a0-fcae8b6359d8 None admin] PATH_INFO: `/v3/users/dd53e8930cef491881a04986b82ed3bd` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:19.437769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3b50e-cfd6-46ff-a0a0-fcae8b6359d8 None admin] RBAC: Authorizing `identity:get_user(user_id=dd53e8930cef491881a04986b82ed3bd)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:19.439206 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3b50e-cfd6-46ff-a0a0-fcae8b6359d8 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:19.440843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 594/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:36:19 2022] GET /identity/v3/users/dd53e8930cef491881a04986b82ed3bd => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:36:19.446613 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb0677-6e8c-41a2-89c4-88027fb05817 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:19.471550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:19.556959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb0677-6e8c-41a2-89c4-88027fb05817 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:19.590419 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f1035-4116-48f6-88f8-af7ceb067d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:19.591024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f1035-4116-48f6-88f8-af7ceb067d43 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:19.591304 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f1035-4116-48f6-88f8-af7ceb067d43 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:19.591599 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f1035-4116-48f6-88f8-af7ceb067d43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:19.657906 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f1035-4116-48f6-88f8-af7ceb067d43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:19.659358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f1035-4116-48f6-88f8-af7ceb067d43 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:19.676477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:19.754852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 589/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:36:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 19:36:19.760860 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3b50e-cfd6-46ff-a0a0-fcae8b6359d8 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:19.862189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3b50e-cfd6-46ff-a0a0-fcae8b6359d8 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:19.884631 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:19.896545 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09db47-05ac-4603-83fe-575a57949739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:19.897175 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09db47-05ac-4603-83fe-575a57949739 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:19.897453 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09db47-05ac-4603-83fe-575a57949739 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:19.897723 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09db47-05ac-4603-83fe-575a57949739 None admin] PATH_INFO: `/v3/projects/c1595b98454a4cf18592bca47099ecef` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:19.898828 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09db47-05ac-4603-83fe-575a57949739 None admin] RBAC: Authorizing `identity:get_project(project_id=c1595b98454a4cf18592bca47099ecef)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:19.900312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09db47-05ac-4603-83fe-575a57949739 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:19.901936 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 595/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:36:19 2022] GET /identity/v3/projects/c1595b98454a4cf18592bca47099ecef => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:36:19.908309 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f1035-4116-48f6-88f8-af7ceb067d43 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:20.005076 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f1035-4116-48f6-88f8-af7ceb067d43 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:20.021711 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:20.037698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c2a73-6772-40aa-90b3-90176203d44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:20.038295 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c2a73-6772-40aa-90b3-90176203d44d None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:20.038566 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c2a73-6772-40aa-90b3-90176203d44d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:20.038832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c2a73-6772-40aa-90b3-90176203d44d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:20.039556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c2a73-6772-40aa-90b3-90176203d44d None admin] RBAC: Adding query filter params (role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a, scope.project.id=c1595b98454a4cf18592bca47099ecef, user.id=dd53e8930cef491881a04986b82ed3bd) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:36:20.039865 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c2a73-6772-40aa-90b3-90176203d44d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:20.041277 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c2a73-6772-40aa-90b3-90176203d44d None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:20.046776 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 590/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:36:19 2022] GET /identity/v3/role_assignments?user.id=dd53e8930cef491881a04986b82ed3bd&scope.project.id=c1595b98454a4cf18592bca47099ecef&role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:36:22.199690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd64cfe-7e88-4bf1-9fe7-5f4282a4af21 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:22.200225 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd64cfe-7e88-4bf1-9fe7-5f4282a4af21 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:22.200225 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd64cfe-7e88-4bf1-9fe7-5f4282a4af21 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:22.201562 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 596/1186] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:36:22.206735 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ed84e-e10f-47ad-aa4c-175192dc9bee None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:22.207141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ed84e-e10f-47ad-aa4c-175192dc9bee None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:22.207283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ed84e-e10f-47ad-aa4c-175192dc9bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:22.226013 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-9b5ed84e-e10f-47ad-aa4c-175192dc9bee None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:36:22.227213 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-9b5ed84e-e10f-47ad-aa4c-175192dc9bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:36:22.293535 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 591/1187] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:36:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:36:22.563616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd64cfe-7e88-4bf1-9fe7-5f4282a4af21 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:22.660665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd64cfe-7e88-4bf1-9fe7-5f4282a4af21 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:22.694149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10b44b-68d1-42ab-a518-be2b363d0052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:22.694768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10b44b-68d1-42ab-a518-be2b363d0052 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:22.695047 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10b44b-68d1-42ab-a518-be2b363d0052 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:22.695318 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10b44b-68d1-42ab-a518-be2b363d0052 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:22.705251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10b44b-68d1-42ab-a518-be2b363d0052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:36:22.710039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-6c10b44b-68d1-42ab-a518-be2b363d0052 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:36:22.710039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:36:22.710039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:36:22.710039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:36:22.710039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:36:22.710039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:36:22.710039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:36:22.710039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:36:22.710039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:36:22.710039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:36:22.710039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:36:22.710039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:36:22.710039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:36:22.710039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:36:22.710039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:36:22.710039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:36:22.711204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:36:22.711204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:36:22.711204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:36:22.711204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:36:22.711204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:36:22.711204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:36:22.711204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:36:22.711204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:36:22.711204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:36:22.711204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:36:22.711204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:36:22.711204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:36:22.711204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:36:22.711204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:36:22.711204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:36:22.711204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:36:22.712300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:36:22.712300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:36:22.712300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:36:22.712300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:36:22.712300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:36:22.712300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:36:22.712300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:36:22.712300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:36:22.712300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:36:22.712300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:36:22.712300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:36:22.712300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:36:22.712300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 597/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:36:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:36:22.716992 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ed84e-e10f-47ad-aa4c-175192dc9bee None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:22.815120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ed84e-e10f-47ad-aa4c-175192dc9bee None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:22.828063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:22.848960 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243522e5-decb-4d7f-80e3-45215d7a67e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:22.849560 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243522e5-decb-4d7f-80e3-45215d7a67e7 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:22.849837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243522e5-decb-4d7f-80e3-45215d7a67e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:22.850106 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243522e5-decb-4d7f-80e3-45215d7a67e7 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:22.850763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243522e5-decb-4d7f-80e3-45215d7a67e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:36:22.851062 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243522e5-decb-4d7f-80e3-45215d7a67e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:22.852459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243522e5-decb-4d7f-80e3-45215d7a67e7 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:22.860681 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 592/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:36:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:36:22.867222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10b44b-68d1-42ab-a518-be2b363d0052 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:22.917143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:22.965302 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10b44b-68d1-42ab-a518-be2b363d0052 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:23.003185 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04201420-b856-4558-836d-979817e0e1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:23.003847 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04201420-b856-4558-836d-979817e0e1cb None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:23.004125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04201420-b856-4558-836d-979817e0e1cb None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:23.004393 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04201420-b856-4558-836d-979817e0e1cb None admin] PATH_INFO: `/v3/users/dd53e8930cef491881a04986b82ed3bd` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:23.005516 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04201420-b856-4558-836d-979817e0e1cb None admin] RBAC: Authorizing `identity:get_user(user_id=dd53e8930cef491881a04986b82ed3bd)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:23.006922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04201420-b856-4558-836d-979817e0e1cb None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:23.008502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 598/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:36:22 2022] GET /identity/v3/users/dd53e8930cef491881a04986b82ed3bd => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:36:23.014283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243522e5-decb-4d7f-80e3-45215d7a67e7 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:23.113760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243522e5-decb-4d7f-80e3-45215d7a67e7 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:23.146182 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e7695-83cd-46a6-ae2a-39521fb3ca25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:23.146795 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e7695-83cd-46a6-ae2a-39521fb3ca25 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:23.147069 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e7695-83cd-46a6-ae2a-39521fb3ca25 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:23.147338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e7695-83cd-46a6-ae2a-39521fb3ca25 None admin] PATH_INFO: `/v3/projects/c1595b98454a4cf18592bca47099ecef` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:23.148457 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e7695-83cd-46a6-ae2a-39521fb3ca25 None admin] RBAC: Authorizing `identity:get_project(project_id=c1595b98454a4cf18592bca47099ecef)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:23.149907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e7695-83cd-46a6-ae2a-39521fb3ca25 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:23.151494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 593/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:36:23 2022] GET /identity/v3/projects/c1595b98454a4cf18592bca47099ecef => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:36:23.158253 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04201420-b856-4558-836d-979817e0e1cb None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:23.255661 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04201420-b856-4558-836d-979817e0e1cb None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:23.272860 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:23.289485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab54e3-211b-4999-b173-f27ea120bcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:23.290138 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab54e3-211b-4999-b173-f27ea120bcb4 None admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:23.290420 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab54e3-211b-4999-b173-f27ea120bcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:23.290696 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab54e3-211b-4999-b173-f27ea120bcb4 None admin] PATH_INFO: `/v3/projects/c1595b98454a4cf18592bca47099ecef/users/dd53e8930cef491881a04986b82ed3bd/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:23.292880 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab54e3-211b-4999-b173-f27ea120bcb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1595b98454a4cf18592bca47099ecef, user_id=dd53e8930cef491881a04986b82ed3bd, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:23.294301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab54e3-211b-4999-b173-f27ea120bcb4 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:23.368155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 599/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:36:23 2022] PUT /identity/v3/projects/c1595b98454a4cf18592bca47099ecef/users/dd53e8930cef491881a04986b82ed3bd/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:36:25.495761 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e72560-17e0-41c8-a021-18afd4a08a3e None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:25.496303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e72560-17e0-41c8-a021-18afd4a08a3e None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:25.496303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e72560-17e0-41c8-a021-18afd4a08a3e None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:25.497630 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 594/1193] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:36:25.502832 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02300e5-19e4-4f90-ac68-ad6e130a4af3 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:25.503228 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02300e5-19e4-4f90-ac68-ad6e130a4af3 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:25.503381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02300e5-19e4-4f90-ac68-ad6e130a4af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:25.521593 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-e02300e5-19e4-4f90-ac68-ad6e130a4af3 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:36:25.523131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-e02300e5-19e4-4f90-ac68-ad6e130a4af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:36:25.587183 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 600/1194] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:36:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:36:25.855155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e72560-17e0-41c8-a021-18afd4a08a3e None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:25.900136 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:25.956502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e72560-17e0-41c8-a021-18afd4a08a3e None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:25.988652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc28f65-f04c-4e02-8e5c-9aa5823f6f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:25.989269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc28f65-f04c-4e02-8e5c-9aa5823f6f0f None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:25.989544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc28f65-f04c-4e02-8e5c-9aa5823f6f0f None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:25.989813 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc28f65-f04c-4e02-8e5c-9aa5823f6f0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:26.000872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc28f65-f04c-4e02-8e5c-9aa5823f6f0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:36:26.005797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-6fc28f65-f04c-4e02-8e5c-9aa5823f6f0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:36:26.005797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:36:26.005797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:36:26.005797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:36:26.005797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:36:26.005797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:36:26.005797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:36:26.005797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:36:26.005797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:36:26.005797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:36:26.005797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:36:26.005797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:36:26.005797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:36:26.005797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:36:26.005797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:36:26.005797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:36:26.006907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:36:26.006907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:36:26.006907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:36:26.006907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:36:26.006907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:36:26.006907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:36:26.006907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:36:26.006907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:36:26.006907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:36:26.006907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:36:26.006907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:36:26.006907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:36:26.006907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:36:26.006907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:36:26.006907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:36:26.006907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:36:26.007974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:36:26.007974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:36:26.007974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:36:26.007974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:36:26.007974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:36:26.007974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:36:26.007974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:36:26.007974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:36:26.007974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:36:26.007974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:36:26.007974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:36:26.007974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:36:26.007974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 595/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:36:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:36:26.012942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02300e5-19e4-4f90-ac68-ad6e130a4af3 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:26.108426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02300e5-19e4-4f90-ac68-ad6e130a4af3 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:26.117278 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:26.141243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647ff6e-1c1f-47e1-9d47-dc2c2556f3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:26.141838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647ff6e-1c1f-47e1-9d47-dc2c2556f3e4 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:26.142118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647ff6e-1c1f-47e1-9d47-dc2c2556f3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:26.142389 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647ff6e-1c1f-47e1-9d47-dc2c2556f3e4 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:26.143041 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647ff6e-1c1f-47e1-9d47-dc2c2556f3e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:36:26.143343 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647ff6e-1c1f-47e1-9d47-dc2c2556f3e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:26.144729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647ff6e-1c1f-47e1-9d47-dc2c2556f3e4 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:26.152771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 601/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:36:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:36:26.159287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc28f65-f04c-4e02-8e5c-9aa5823f6f0f None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:26.262056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc28f65-f04c-4e02-8e5c-9aa5823f6f0f None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:26.263599 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:26.297218 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387be659-c81c-4f99-bbbc-27f6292086c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:26.297833 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387be659-c81c-4f99-bbbc-27f6292086c5 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:26.298107 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387be659-c81c-4f99-bbbc-27f6292086c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:26.298373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387be659-c81c-4f99-bbbc-27f6292086c5 None admin] PATH_INFO: `/v3/users/dd53e8930cef491881a04986b82ed3bd` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:26.299459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387be659-c81c-4f99-bbbc-27f6292086c5 None admin] RBAC: Authorizing `identity:get_user(user_id=dd53e8930cef491881a04986b82ed3bd)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:26.300905 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387be659-c81c-4f99-bbbc-27f6292086c5 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:26.302428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 596/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Sep 14 19:36:26 2022] GET /identity/v3/users/dd53e8930cef491881a04986b82ed3bd => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:36:26.308241 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647ff6e-1c1f-47e1-9d47-dc2c2556f3e4 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:26.409174 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647ff6e-1c1f-47e1-9d47-dc2c2556f3e4 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:26.446156 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccd9f2-d81f-4664-9160-bf06e614ba3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:26.446769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccd9f2-d81f-4664-9160-bf06e614ba3a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:26.447050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccd9f2-d81f-4664-9160-bf06e614ba3a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:26.447327 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccd9f2-d81f-4664-9160-bf06e614ba3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:26.485827 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:26.513194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccd9f2-d81f-4664-9160-bf06e614ba3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:26.514640 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccd9f2-d81f-4664-9160-bf06e614ba3a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:26.617630 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 602/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:36:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 19:36:26.623647 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387be659-c81c-4f99-bbbc-27f6292086c5 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:26.721215 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387be659-c81c-4f99-bbbc-27f6292086c5 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:26.754230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1227c-c39c-44ea-9faa-594ac8df0605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:26.754844 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1227c-c39c-44ea-9faa-594ac8df0605 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:26.755119 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1227c-c39c-44ea-9faa-594ac8df0605 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:26.755386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1227c-c39c-44ea-9faa-594ac8df0605 None admin] PATH_INFO: `/v3/projects/c1595b98454a4cf18592bca47099ecef` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:26.756505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1227c-c39c-44ea-9faa-594ac8df0605 None admin] RBAC: Authorizing `identity:get_project(project_id=c1595b98454a4cf18592bca47099ecef)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:26.757917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1227c-c39c-44ea-9faa-594ac8df0605 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:26.759495 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 597/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Sep 14 19:36:26 2022] GET /identity/v3/projects/c1595b98454a4cf18592bca47099ecef => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:36:26.766022 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccd9f2-d81f-4664-9160-bf06e614ba3a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:36:26.832749 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:26.861478 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccd9f2-d81f-4664-9160-bf06e614ba3a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:36:26.895571 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb2df5-61d8-4d37-a94d-6a69821823a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:36:26.896115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb2df5-61d8-4d37-a94d-6a69821823a4 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:36:26.896388 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb2df5-61d8-4d37-a94d-6a69821823a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:36:26.896653 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb2df5-61d8-4d37-a94d-6a69821823a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:36:26.897358 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb2df5-61d8-4d37-a94d-6a69821823a4 None admin] RBAC: Adding query filter params (role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a, scope.project.id=c1595b98454a4cf18592bca47099ecef, user.id=dd53e8930cef491881a04986b82ed3bd) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:36:26.897659 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb2df5-61d8-4d37-a94d-6a69821823a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:36:26.899066 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb2df5-61d8-4d37-a94d-6a69821823a4 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:36:26.904539 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 603/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:36:26 2022] GET /identity/v3/role_assignments?user.id=dd53e8930cef491881a04986b82ed3bd&scope.project.id=c1595b98454a4cf18592bca47099ecef&role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:36:36.749741 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=81 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:36:36.902006 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=33 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:43.233502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c988671-9f25-42b2-85c1-4d89b5dfdc57 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:43.234085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c988671-9f25-42b2-85c1-4d89b5dfdc57 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:43.234200 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c988671-9f25-42b2-85c1-4d89b5dfdc57 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:43.235444 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 598/1201] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:37:43.240804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038bf5c-a840-499a-968f-28c889d26a95 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:43.241206 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038bf5c-a840-499a-968f-28c889d26a95 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:43.241352 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038bf5c-a840-499a-968f-28c889d26a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:43.259683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-4038bf5c-a840-499a-968f-28c889d26a95 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:37:43.261541 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4038bf5c-a840-499a-968f-28c889d26a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:37:43.329126 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 604/1202] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:37:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:37:43.609460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c988671-9f25-42b2-85c1-4d89b5dfdc57 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:43.711533 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c988671-9f25-42b2-85c1-4d89b5dfdc57 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:43.745251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01b58c-172d-459e-82f3-83632b2d4a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:43.745878 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01b58c-172d-459e-82f3-83632b2d4a30 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:43.746158 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01b58c-172d-459e-82f3-83632b2d4a30 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:43.746431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01b58c-172d-459e-82f3-83632b2d4a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:43.756914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01b58c-172d-459e-82f3-83632b2d4a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:43.758348 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01b58c-172d-459e-82f3-83632b2d4a30 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:43.772755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-1c01b58c-172d-459e-82f3-83632b2d4a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:37:43.772755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:37:43.772755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:37:43.772755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:37:43.772755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:37:43.772755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:37:43.772755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:37:43.772755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:37:43.772755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:37:43.772755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:37:43.772755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:37:43.772755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:37:43.772755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:37:43.772755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:37:43.772755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:37:43.772755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:37:43.773962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:37:43.773962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:37:43.773962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:37:43.773962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:37:43.773962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:37:43.773962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:37:43.773962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:37:43.773962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:37:43.773962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:37:43.773962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:37:43.773962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:37:43.773962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:37:43.773962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:37:43.773962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:37:43.773962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:37:43.773962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:37:43.773962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:37:43.775323 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:37:43.775323 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:37:43.775323 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:37:43.775323 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 599/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:37:43.780653 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038bf5c-a840-499a-968f-28c889d26a95 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:43.882699 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038bf5c-a840-499a-968f-28c889d26a95 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:43.909940 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:43.915663 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c9ef3-2b67-4875-9a21-99f6fd07bb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:43.916837 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c9ef3-2b67-4875-9a21-99f6fd07bb7f None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:43.917113 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c9ef3-2b67-4875-9a21-99f6fd07bb7f None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:43.917383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c9ef3-2b67-4875-9a21-99f6fd07bb7f None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:43.918016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c9ef3-2b67-4875-9a21-99f6fd07bb7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:37:43.918318 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c9ef3-2b67-4875-9a21-99f6fd07bb7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:43.919760 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c9ef3-2b67-4875-9a21-99f6fd07bb7f None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:43.930862 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 605/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:37:43.938745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01b58c-172d-459e-82f3-83632b2d4a30 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:43.990459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:44.036733 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01b58c-172d-459e-82f3-83632b2d4a30 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:44.069627 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a9c1b-3f54-42b4-9b15-1b561693893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:44.070236 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a9c1b-3f54-42b4-9b15-1b561693893f None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:44.070512 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a9c1b-3f54-42b4-9b15-1b561693893f None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:44.070781 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a9c1b-3f54-42b4-9b15-1b561693893f None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:44.071437 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a9c1b-3f54-42b4-9b15-1b561693893f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:44.074748 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a9c1b-3f54-42b4-9b15-1b561693893f None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:44.184387 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 600/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Sep 14 19:37:43 2022] POST /identity/v3/users => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:37:46.365747 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298ef90-7be2-4190-84d1-16bb8e49639e None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:46.366293 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298ef90-7be2-4190-84d1-16bb8e49639e None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:46.366293 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298ef90-7be2-4190-84d1-16bb8e49639e None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:46.368312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 606/1206] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:37:46.374036 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b73fb-fea8-4268-8131-e093e90e08a5 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:46.374524 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b73fb-fea8-4268-8131-e093e90e08a5 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:46.374524 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b73fb-fea8-4268-8131-e093e90e08a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:46.393301 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-0f7b73fb-fea8-4268-8131-e093e90e08a5 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:37:46.394480 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0f7b73fb-fea8-4268-8131-e093e90e08a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:37:46.460831 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 601/1207] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:37:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:37:46.730680 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298ef90-7be2-4190-84d1-16bb8e49639e None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:46.829783 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298ef90-7be2-4190-84d1-16bb8e49639e None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:46.861753 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a23a39-8b27-4780-8eb9-afbd7a64f1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:46.862369 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a23a39-8b27-4780-8eb9-afbd7a64f1df None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:46.862641 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a23a39-8b27-4780-8eb9-afbd7a64f1df None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:46.862909 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a23a39-8b27-4780-8eb9-afbd7a64f1df None admin] PATH_INFO: `/v3/roles/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:46.876340 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a23a39-8b27-4780-8eb9-afbd7a64f1df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:37:46.881812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-c9a23a39-8b27-4780-8eb9-afbd7a64f1df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:37:46.881812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:37:46.881812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:37:46.881812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:37:46.881812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:37:46.881812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:37:46.881812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:37:46.881812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:37:46.881812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:37:46.881812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:37:46.881812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:37:46.881812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:37:46.881812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:37:46.881812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:37:46.881812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:37:46.881812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:37:46.883614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:37:46.883614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:37:46.883614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:37:46.883614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:37:46.883614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:37:46.883614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:37:46.883614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:37:46.883614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:37:46.883614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:37:46.883614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:37:46.883614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:37:46.883614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:37:46.883614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:37:46.883614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:37:46.883614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:37:46.883614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:37:46.884642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:37:46.884642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:37:46.884642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:37:46.884642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:37:46.884642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:37:46.884642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:37:46.884642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:37:46.884642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:37:46.884642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:37:46.884642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:37:46.884642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:37:46.884642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:37:46.884642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 607/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:37:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:37:46.889519 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b73fb-fea8-4268-8131-e093e90e08a5 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:46.927969 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:46.986323 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b73fb-fea8-4268-8131-e093e90e08a5 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:47.019804 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59cd35-d193-4c9b-a1eb-e54d89de3090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:47.020402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59cd35-d193-4c9b-a1eb-e54d89de3090 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:47.020674 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59cd35-d193-4c9b-a1eb-e54d89de3090 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:47.020937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59cd35-d193-4c9b-a1eb-e54d89de3090 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:47.021589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59cd35-d193-4c9b-a1eb-e54d89de3090 None admin] RBAC: Adding query filter params (name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:37:47.021884 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59cd35-d193-4c9b-a1eb-e54d89de3090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:47.023938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59cd35-d193-4c9b-a1eb-e54d89de3090 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:47.031662 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 602/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Sep 14 19:37:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:37:47.037636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a23a39-8b27-4780-8eb9-afbd7a64f1df None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:47.087118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:47.135985 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a23a39-8b27-4780-8eb9-afbd7a64f1df None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:47.167406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb448487-e364-40e5-af57-9d701bcdc074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:47.168061 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb448487-e364-40e5-af57-9d701bcdc074 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:47.168339 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb448487-e364-40e5-af57-9d701bcdc074 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:47.168612 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb448487-e364-40e5-af57-9d701bcdc074 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:47.178785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb448487-e364-40e5-af57-9d701bcdc074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:47.180993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb448487-e364-40e5-af57-9d701bcdc074 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:47.194481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-cb448487-e364-40e5-af57-9d701bcdc074 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:37:47.194481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:37:47.194481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:37:47.194481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:37:47.194481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:37:47.194481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:37:47.194481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:37:47.194481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:37:47.194481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:37:47.194481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:37:47.194481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:37:47.194481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:37:47.194481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:37:47.194481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:37:47.194481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:37:47.194481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:37:47.195768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:37:47.195768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:37:47.195768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:37:47.195768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:37:47.195768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:37:47.195768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:37:47.195768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:37:47.195768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:37:47.195768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:37:47.195768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:37:47.195768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:37:47.195768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:37:47.195768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:37:47.195768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:37:47.195768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:37:47.195768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:37:47.195768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:37:47.196705 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:37:47.196705 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:37:47.196705 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:37:47.196705 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 608/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:37:47.202070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59cd35-d193-4c9b-a1eb-e54d89de3090 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:47.299605 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:47.302553 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59cd35-d193-4c9b-a1eb-e54d89de3090 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:47.336851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce613f-473a-421e-9b81-7960f5c0bdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:47.337493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce613f-473a-421e-9b81-7960f5c0bdce None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:47.337771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce613f-473a-421e-9b81-7960f5c0bdce None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:47.338039 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce613f-473a-421e-9b81-7960f5c0bdce None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:47.338675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce613f-473a-421e-9b81-7960f5c0bdce None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:37:47.338977 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce613f-473a-421e-9b81-7960f5c0bdce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:47.340361 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce613f-473a-421e-9b81-7960f5c0bdce None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:47.351921 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 603/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:37:47.357749 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb448487-e364-40e5-af57-9d701bcdc074 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:47.459010 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb448487-e364-40e5-af57-9d701bcdc074 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:47.460652 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:47.492550 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2707720-1c2a-4a84-b882-2295aaf80703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:47.493259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2707720-1c2a-4a84-b882-2295aaf80703 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:47.493538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2707720-1c2a-4a84-b882-2295aaf80703 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:47.493807 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2707720-1c2a-4a84-b882-2295aaf80703 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:47.501059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2707720-1c2a-4a84-b882-2295aaf80703 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:47.502492 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2707720-1c2a-4a84-b882-2295aaf80703 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:47.513493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-f2707720-1c2a-4a84-b882-2295aaf80703 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 19:37:47.513493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:37:47.513493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:37:47.513493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:37:47.513493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:37:47.513493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:37:47.513493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:37:47.513493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:37:47.513493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:37:47.513493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:37:47.513493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:37:47.513493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:37:47.513493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:37:47.513493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:37:47.513493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:37:47.513493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:37:47.514615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:37:47.514615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:37:47.514615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:37:47.514615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:37:47.514615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:37:47.514615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:37:47.514615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:37:47.514615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:37:47.514615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:37:47.514615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:37:47.514615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:37:47.514615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:37:47.514615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:37:47.514615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:37:47.514615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:37:47.514615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:37:47.514615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:37:47.514615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:37:47.516093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:37:47.516093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:37:47.516093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:37:47.516093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:37:47.516093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:37:47.516093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:37:47.516093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:37:47.516093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:37:47.516093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 19:37:47.516093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:37:47.516093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 609/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:37:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:37:47.520464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce613f-473a-421e-9b81-7960f5c0bdce None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:47.621124 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce613f-473a-421e-9b81-7960f5c0bdce None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:47.655185 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd42b3d-7df6-4fef-9c81-a99dbafe0c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:47.655821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd42b3d-7df6-4fef-9c81-a99dbafe0c66 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:47.656100 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd42b3d-7df6-4fef-9c81-a99dbafe0c66 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:47.656372 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd42b3d-7df6-4fef-9c81-a99dbafe0c66 None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:47.657118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd42b3d-7df6-4fef-9c81-a99dbafe0c66 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:37:47.657420 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd42b3d-7df6-4fef-9c81-a99dbafe0c66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:47.658841 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd42b3d-7df6-4fef-9c81-a99dbafe0c66 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:47.680218 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 604/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Wed Sep 14 19:37:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:37:47.686307 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2707720-1c2a-4a84-b882-2295aaf80703 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:47.785652 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2707720-1c2a-4a84-b882-2295aaf80703 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:47.819664 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1bf09-6f2d-49f4-bbac-cbfcf4b2bacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:47.820356 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1bf09-6f2d-49f4-bbac-cbfcf4b2bacb None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:47.820645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1bf09-6f2d-49f4-bbac-cbfcf4b2bacb None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:47.820921 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1bf09-6f2d-49f4-bbac-cbfcf4b2bacb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:47.849496 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:47.886072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1bf09-6f2d-49f4-bbac-cbfcf4b2bacb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:47.887453 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1bf09-6f2d-49f4-bbac-cbfcf4b2bacb None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:47.985079 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 610/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:37:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 19:37:47.990885 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd42b3d-7df6-4fef-9c81-a99dbafe0c66 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:48.009457 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:48.088914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd42b3d-7df6-4fef-9c81-a99dbafe0c66 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:48.123806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363af3c-fa21-45c1-ae92-a4533bac02be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:48.124435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363af3c-fa21-45c1-ae92-a4533bac02be None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:48.124712 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363af3c-fa21-45c1-ae92-a4533bac02be None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:48.124980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363af3c-fa21-45c1-ae92-a4533bac02be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:48.135088 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363af3c-fa21-45c1-ae92-a4533bac02be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:48.136602 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363af3c-fa21-45c1-ae92-a4533bac02be None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:48.151287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-e363af3c-fa21-45c1-ae92-a4533bac02be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:37:48.151287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:37:48.151287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:37:48.151287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:37:48.151287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:37:48.151287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:37:48.151287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:37:48.151287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:37:48.151287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:37:48.151287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:37:48.151287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:37:48.151287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:37:48.151287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:37:48.151287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:37:48.151287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:37:48.151287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:37:48.154034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:37:48.154034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:37:48.154034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:37:48.154034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:37:48.154034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:37:48.154034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:37:48.154034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:37:48.154034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:37:48.154034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:37:48.154034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:37:48.154034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:37:48.154034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:37:48.154034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:37:48.154034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:37:48.154034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:37:48.154034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:37:48.154034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:37:48.155178 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:37:48.155178 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:37:48.155178 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:37:48.155178 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 605/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:37:48.158164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1bf09-6f2d-49f4-bbac-cbfcf4b2bacb None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:48.218189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:48.254919 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1bf09-6f2d-49f4-bbac-cbfcf4b2bacb None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:48.288258 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea60a39-5d09-4027-8535-c8aa23db3583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:48.288900 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea60a39-5d09-4027-8535-c8aa23db3583 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:48.289180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea60a39-5d09-4027-8535-c8aa23db3583 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:48.289450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea60a39-5d09-4027-8535-c8aa23db3583 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:48.290091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea60a39-5d09-4027-8535-c8aa23db3583 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:37:48.290421 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea60a39-5d09-4027-8535-c8aa23db3583 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:48.291806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea60a39-5d09-4027-8535-c8aa23db3583 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:48.303012 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 611/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:37:48.308786 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363af3c-fa21-45c1-ae92-a4533bac02be None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:48.377718 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:48.410505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363af3c-fa21-45c1-ae92-a4533bac02be None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:48.443276 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45b0c9-af51-4108-ae4d-c14dc2291bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:48.443930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45b0c9-af51-4108-ae4d-c14dc2291bce None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:48.445229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45b0c9-af51-4108-ae4d-c14dc2291bce None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:48.445509 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45b0c9-af51-4108-ae4d-c14dc2291bce None admin] PATH_INFO: `/v3/projects/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:48.452007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45b0c9-af51-4108-ae4d-c14dc2291bce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:48.453460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45b0c9-af51-4108-ae4d-c14dc2291bce None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:48.465514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-6f45b0c9-af51-4108-ae4d-c14dc2291bce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:37:48.465514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:37:48.465514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:37:48.465514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:37:48.465514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:37:48.465514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:37:48.465514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:37:48.465514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:37:48.465514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:37:48.465514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:37:48.465514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:37:48.465514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:37:48.465514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:37:48.465514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:37:48.465514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:37:48.466554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:37:48.466554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:37:48.466554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:37:48.466554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:37:48.466554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:37:48.466554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:37:48.466554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:37:48.466554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:37:48.466554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:37:48.466554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:37:48.466554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:37:48.466554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:37:48.466554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:37:48.466554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:37:48.466554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:37:48.466554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:37:48.466554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:37:48.467743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:37:48.467743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:37:48.467743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:37:48.467743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:37:48.467743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:37:48.467743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:37:48.467743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:37:48.467743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:37:48.467743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 606/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:37:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:37:48.472982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea60a39-5d09-4027-8535-c8aa23db3583 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:48.570853 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea60a39-5d09-4027-8535-c8aa23db3583 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:48.593028 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:48.604087 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7b6a8-4124-4b9e-8908-c505f91a0610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:48.604692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7b6a8-4124-4b9e-8908-c505f91a0610 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:48.604969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7b6a8-4124-4b9e-8908-c505f91a0610 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:48.605237 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7b6a8-4124-4b9e-8908-c505f91a0610 None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:48.605919 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7b6a8-4124-4b9e-8908-c505f91a0610 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:37:48.606223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7b6a8-4124-4b9e-8908-c505f91a0610 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:48.607661 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7b6a8-4124-4b9e-8908-c505f91a0610 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:48.620318 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 612/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:37:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:37:48.626500 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45b0c9-af51-4108-ae4d-c14dc2291bce None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:48.726135 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45b0c9-af51-4108-ae4d-c14dc2291bce None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:48.754230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:48.761319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8837107-c196-4458-b992-86414b85bad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:48.761914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8837107-c196-4458-b992-86414b85bad9 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:48.762184 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8837107-c196-4458-b992-86414b85bad9 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:48.762450 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8837107-c196-4458-b992-86414b85bad9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:48.763160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8837107-c196-4458-b992-86414b85bad9 None admin] RBAC: Adding query filter params (role.id=b2e8ea485659485f92e729741880d447, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=6942a851a69b446e90a2b138f4482465) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:37:48.763460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8837107-c196-4458-b992-86414b85bad9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:48.764930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8837107-c196-4458-b992-86414b85bad9 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:48.770070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 607/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:37:48 2022] GET /identity/v3/role_assignments?user.id=6942a851a69b446e90a2b138f4482465&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=b2e8ea485659485f92e729741880d447 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:37:50.924593 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302de9b2-9930-4068-ba6c-aba10b83c909 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:50.925148 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302de9b2-9930-4068-ba6c-aba10b83c909 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:50.925148 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302de9b2-9930-4068-ba6c-aba10b83c909 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:50.926543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 613/1220] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:37:50.931794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b138a-41b1-4558-844a-59cf002c0887 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:50.932254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b138a-41b1-4558-844a-59cf002c0887 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:50.932385 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b138a-41b1-4558-844a-59cf002c0887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:50.950191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-8a9b138a-41b1-4558-844a-59cf002c0887 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:37:50.951347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-8a9b138a-41b1-4558-844a-59cf002c0887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:37:51.017633 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 608/1221] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:37:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 19:37:51.283750 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302de9b2-9930-4068-ba6c-aba10b83c909 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:51.383916 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302de9b2-9930-4068-ba6c-aba10b83c909 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:51.416959 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da9a39-4135-4cd9-b1bf-3a874701fd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:51.417585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da9a39-4135-4cd9-b1bf-3a874701fd22 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:51.417857 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da9a39-4135-4cd9-b1bf-3a874701fd22 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:51.418123 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da9a39-4135-4cd9-b1bf-3a874701fd22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:51.428168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da9a39-4135-4cd9-b1bf-3a874701fd22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:37:51.432866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-21da9a39-4135-4cd9-b1bf-3a874701fd22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:37:51.432866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:37:51.432866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:37:51.432866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:37:51.432866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:37:51.432866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:37:51.432866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:37:51.432866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:37:51.432866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:37:51.432866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:37:51.432866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:37:51.432866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:37:51.432866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:37:51.432866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:37:51.432866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:37:51.432866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:37:51.433931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:37:51.433931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:37:51.433931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:37:51.433931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:37:51.433931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:37:51.433931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:37:51.433931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:37:51.433931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:37:51.433931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:37:51.433931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:37:51.433931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:37:51.433931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:37:51.433931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:37:51.433931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:37:51.433931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:37:51.433931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:37:51.435045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:37:51.435045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:37:51.435045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:37:51.435045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:37:51.435045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:37:51.435045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:37:51.435045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:37:51.435045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:37:51.435045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:37:51.435045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:37:51.435045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:37:51.435045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:37:51.438853 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 614/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:37:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:37:51.440035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b138a-41b1-4558-844a-59cf002c0887 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:51.539307 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b138a-41b1-4558-844a-59cf002c0887 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:51.562884 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:51.574184 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfa252-f744-46b7-a040-d1d6d8fb68db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:51.574791 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfa252-f744-46b7-a040-d1d6d8fb68db None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:51.575073 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfa252-f744-46b7-a040-d1d6d8fb68db None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:51.575349 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfa252-f744-46b7-a040-d1d6d8fb68db None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:51.576045 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfa252-f744-46b7-a040-d1d6d8fb68db None admin] RBAC: Adding query filter params (name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:37:51.576347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfa252-f744-46b7-a040-d1d6d8fb68db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:51.577705 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfa252-f744-46b7-a040-d1d6d8fb68db None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:51.586161 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 609/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Sep 14 19:37:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:37:51.592359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da9a39-4135-4cd9-b1bf-3a874701fd22 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:51.635664 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:51.688569 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da9a39-4135-4cd9-b1bf-3a874701fd22 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:51.720658 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47265e-87ef-4453-ae4b-556aa17284bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:51.721288 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47265e-87ef-4453-ae4b-556aa17284bc None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:51.721563 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47265e-87ef-4453-ae4b-556aa17284bc None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:51.721833 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47265e-87ef-4453-ae4b-556aa17284bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:51.731342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47265e-87ef-4453-ae4b-556aa17284bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:51.732814 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47265e-87ef-4453-ae4b-556aa17284bc None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:51.747326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-4d47265e-87ef-4453-ae4b-556aa17284bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:37:51.747326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:37:51.747326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:37:51.747326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:37:51.747326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:37:51.747326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:37:51.747326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:37:51.747326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:37:51.747326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:37:51.747326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:37:51.747326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:37:51.747326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:37:51.747326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:37:51.747326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:37:51.747326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:37:51.747326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:37:51.748472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:37:51.748472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:37:51.748472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:37:51.748472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:37:51.748472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:37:51.748472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:37:51.748472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:37:51.748472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:37:51.748472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:37:51.748472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:37:51.748472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:37:51.748472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:37:51.748472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:37:51.748472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:37:51.748472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:37:51.748472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:37:51.748472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:37:51.749461 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:37:51.749461 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:37:51.749461 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:37:51.749461 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 615/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:37:51.754929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfa252-f744-46b7-a040-d1d6d8fb68db None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:51.855293 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfa252-f744-46b7-a040-d1d6d8fb68db None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:51.889204 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cef23-89c0-454f-8b01-b8b3816c91d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:51.889801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cef23-89c0-454f-8b01-b8b3816c91d8 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:51.890073 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cef23-89c0-454f-8b01-b8b3816c91d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:51.890338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cef23-89c0-454f-8b01-b8b3816c91d8 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:51.891006 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0cef23-89c0-454f-8b01-b8b3816c91d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:37:51.891303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0cef23-89c0-454f-8b01-b8b3816c91d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:51.892700 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0cef23-89c0-454f-8b01-b8b3816c91d8 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:51.904398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 610/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:37:51.910127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47265e-87ef-4453-ae4b-556aa17284bc None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:52.002896 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:52.009236 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47265e-87ef-4453-ae4b-556aa17284bc None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:52.041947 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce85774-60e4-41b6-889f-5ce06560d8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:52.042575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce85774-60e4-41b6-889f-5ce06560d8bc None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:52.042854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce85774-60e4-41b6-889f-5ce06560d8bc None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:52.043128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce85774-60e4-41b6-889f-5ce06560d8bc None admin] PATH_INFO: `/v3/users/placement` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:52.051392 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce85774-60e4-41b6-889f-5ce06560d8bc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:52.053069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce85774-60e4-41b6-889f-5ce06560d8bc None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:52.063870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-dce85774-60e4-41b6-889f-5ce06560d8bc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 19:37:52.063870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:37:52.063870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:37:52.063870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:37:52.063870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:37:52.063870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:37:52.063870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:37:52.063870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:37:52.063870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:37:52.063870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:37:52.063870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:37:52.063870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:37:52.063870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:37:52.063870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:37:52.063870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:37:52.063870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:37:52.069373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:37:52.069373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:37:52.069373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:37:52.069373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:37:52.069373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:37:52.069373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:37:52.069373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:37:52.069373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:37:52.069373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:37:52.069373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:37:52.069373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:37:52.069373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:37:52.069373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:37:52.069373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:37:52.069373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:37:52.069373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:37:52.069373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:37:52.069373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:37:52.070508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:37:52.070508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:37:52.070508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:37:52.070508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:37:52.070508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:37:52.070508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:37:52.070508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:37:52.070508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:37:52.070508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 19:37:52.070508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:37:52.070508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 616/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:37:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:37:52.071096 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cef23-89c0-454f-8b01-b8b3816c91d8 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:52.118610 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:52.173541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cef23-89c0-454f-8b01-b8b3816c91d8 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:52.206889 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c291ab-bd50-4227-81b4-59e92bb8d1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:52.207487 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c291ab-bd50-4227-81b4-59e92bb8d1b9 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:52.207798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c291ab-bd50-4227-81b4-59e92bb8d1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:52.208067 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c291ab-bd50-4227-81b4-59e92bb8d1b9 None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:52.208784 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c291ab-bd50-4227-81b4-59e92bb8d1b9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:37:52.209083 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c291ab-bd50-4227-81b4-59e92bb8d1b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:52.210490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c291ab-bd50-4227-81b4-59e92bb8d1b9 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:52.227693 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 611/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Wed Sep 14 19:37:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:37:52.233575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce85774-60e4-41b6-889f-5ce06560d8bc None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:52.331550 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce85774-60e4-41b6-889f-5ce06560d8bc None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:52.365125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775283ed-f00e-4b85-bb17-80deb47bcdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:52.365739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775283ed-f00e-4b85-bb17-80deb47bcdc3 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:52.366046 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775283ed-f00e-4b85-bb17-80deb47bcdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:52.366314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775283ed-f00e-4b85-bb17-80deb47bcdc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:52.377880 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775283ed-f00e-4b85-bb17-80deb47bcdc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:52.379401 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775283ed-f00e-4b85-bb17-80deb47bcdc3 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:52.393446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-775283ed-f00e-4b85-bb17-80deb47bcdc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:37:52.393446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:37:52.393446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:37:52.393446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:37:52.393446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:37:52.393446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:37:52.393446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:37:52.393446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:37:52.393446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:37:52.393446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:37:52.393446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:37:52.393446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:37:52.393446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:37:52.393446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:37:52.393446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:37:52.393446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:37:52.395118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:37:52.395118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:37:52.395118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:37:52.395118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:37:52.395118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:37:52.395118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:37:52.395118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:37:52.395118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:37:52.395118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:37:52.395118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:37:52.395118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:37:52.395118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:37:52.395118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:37:52.395118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:37:52.395118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:37:52.395118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:37:52.395118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:37:52.396251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:37:52.396251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:37:52.396251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:37:52.396251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 617/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:37:52.400796 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c291ab-bd50-4227-81b4-59e92bb8d1b9 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:52.507962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c291ab-bd50-4227-81b4-59e92bb8d1b9 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:52.510288 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:52.541508 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de6618-ae96-45d8-addf-bd5bec777f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:52.542130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de6618-ae96-45d8-addf-bd5bec777f2d None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:52.542402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de6618-ae96-45d8-addf-bd5bec777f2d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:52.542666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de6618-ae96-45d8-addf-bd5bec777f2d None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:52.543291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de6618-ae96-45d8-addf-bd5bec777f2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:37:52.543618 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de6618-ae96-45d8-addf-bd5bec777f2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:52.544963 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de6618-ae96-45d8-addf-bd5bec777f2d None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:52.556555 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 612/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:37:52.562246 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775283ed-f00e-4b85-bb17-80deb47bcdc3 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:52.571859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:52.660930 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775283ed-f00e-4b85-bb17-80deb47bcdc3 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:52.693042 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0cb28-7f41-4024-8bac-9ca60d6005b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:52.693673 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0cb28-7f41-4024-8bac-9ca60d6005b1 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:52.693949 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0cb28-7f41-4024-8bac-9ca60d6005b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:52.694221 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0cb28-7f41-4024-8bac-9ca60d6005b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:52.701379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0cb28-7f41-4024-8bac-9ca60d6005b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:52.702802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0cb28-7f41-4024-8bac-9ca60d6005b1 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:52.714353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-eaf0cb28-7f41-4024-8bac-9ca60d6005b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:37:52.714353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:37:52.714353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:37:52.714353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:37:52.714353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:37:52.714353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:37:52.714353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:37:52.714353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:37:52.714353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:37:52.714353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:37:52.714353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:37:52.714353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:37:52.714353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:37:52.714353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:37:52.714353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:37:52.715417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:37:52.715417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:37:52.715417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:37:52.715417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:37:52.715417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:37:52.715417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:37:52.715417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:37:52.715417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:37:52.715417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:37:52.715417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:37:52.715417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:37:52.715417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:37:52.715417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:37:52.715417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:37:52.715417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:37:52.715417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:37:52.715417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:37:52.716755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:37:52.716755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:37:52.716755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:37:52.716755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:37:52.716755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:37:52.716755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:37:52.716755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:37:52.716755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:37:52.716755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 618/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:37:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:37:52.721445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de6618-ae96-45d8-addf-bd5bec777f2d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:52.823510 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de6618-ae96-45d8-addf-bd5bec777f2d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:52.857919 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3cd67-7d3b-4b7b-be91-c9b62946e76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:52.858525 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3cd67-7d3b-4b7b-be91-c9b62946e76b None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:52.858803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3cd67-7d3b-4b7b-be91-c9b62946e76b None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:52.859074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3cd67-7d3b-4b7b-be91-c9b62946e76b None admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:52.859848 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3cd67-7d3b-4b7b-be91-c9b62946e76b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:37:52.860153 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3cd67-7d3b-4b7b-be91-c9b62946e76b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:52.864570 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3cd67-7d3b-4b7b-be91-c9b62946e76b None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:52.873758 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 613/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:37:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:37:52.880493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0cb28-7f41-4024-8bac-9ca60d6005b1 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:52.953154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:52.986013 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0cb28-7f41-4024-8bac-9ca60d6005b1 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:53.017449 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404e825-d98e-4b68-8d2f-a17902dc9520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:53.018086 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404e825-d98e-4b68-8d2f-a17902dc9520 None admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:53.018362 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404e825-d98e-4b68-8d2f-a17902dc9520 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:53.019310 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404e825-d98e-4b68-8d2f-a17902dc9520 None admin] PATH_INFO: `/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/6942a851a69b446e90a2b138f4482465/roles/b2e8ea485659485f92e729741880d447` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:53.032657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404e825-d98e-4b68-8d2f-a17902dc9520 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e3e0c278ce94ce3a132496923eef365, user_id=6942a851a69b446e90a2b138f4482465, role_id=b2e8ea485659485f92e729741880d447)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:53.034199 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404e825-d98e-4b68-8d2f-a17902dc9520 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:53.165809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 619/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:37:52 2022] PUT /identity/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/6942a851a69b446e90a2b138f4482465/roles/b2e8ea485659485f92e729741880d447 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:37:55.338199 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51c346-994f-476d-acb7-67ed9c379d0b None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:55.338831 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51c346-994f-476d-acb7-67ed9c379d0b None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:55.338831 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51c346-994f-476d-acb7-67ed9c379d0b None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:55.340102 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 614/1233] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:37:55.345901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6de76c-47e9-4566-b8e8-c5604e1454d5 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:55.354361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6de76c-47e9-4566-b8e8-c5604e1454d5 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:55.354361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6de76c-47e9-4566-b8e8-c5604e1454d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:55.364870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-0d6de76c-47e9-4566-b8e8-c5604e1454d5 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:37:55.366076 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-0d6de76c-47e9-4566-b8e8-c5604e1454d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:37:55.433289 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 620/1234] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:37:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:37:55.703269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51c346-994f-476d-acb7-67ed9c379d0b None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:55.730009 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:55.805243 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51c346-994f-476d-acb7-67ed9c379d0b None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:55.837854 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71c777-ae23-4bed-9f12-ecd56d0f3b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:55.838476 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71c777-ae23-4bed-9f12-ecd56d0f3b08 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:55.838750 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71c777-ae23-4bed-9f12-ecd56d0f3b08 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:55.839017 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71c777-ae23-4bed-9f12-ecd56d0f3b08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:55.850733 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71c777-ae23-4bed-9f12-ecd56d0f3b08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:37:55.855620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-4b71c777-ae23-4bed-9f12-ecd56d0f3b08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:37:55.855620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:37:55.855620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:37:55.855620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:37:55.855620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:37:55.855620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:37:55.855620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:37:55.855620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:37:55.855620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:37:55.855620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:37:55.855620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:37:55.855620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:37:55.855620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:37:55.855620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:37:55.855620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:37:55.855620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:37:55.856774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:37:55.856774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:37:55.856774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:37:55.856774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:37:55.856774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:37:55.856774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:37:55.856774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:37:55.856774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:37:55.856774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:37:55.856774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:37:55.856774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:37:55.856774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:37:55.856774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:37:55.856774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:37:55.856774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:37:55.856774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:37:55.857708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:37:55.857708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:37:55.857708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:37:55.857708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:37:55.857708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:37:55.857708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:37:55.857708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:37:55.857708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:37:55.857708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:37:55.857708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:37:55.857708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 19:37:55.857708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:37:55.857708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 615/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Sep 14 19:37:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:37:55.864115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6de76c-47e9-4566-b8e8-c5604e1454d5 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:55.909868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:55.959665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6de76c-47e9-4566-b8e8-c5604e1454d5 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:55.992211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07c965-ee0d-4d2c-a596-0bc281dd93e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:55.992808 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07c965-ee0d-4d2c-a596-0bc281dd93e8 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:55.993082 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07c965-ee0d-4d2c-a596-0bc281dd93e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:55.993349 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07c965-ee0d-4d2c-a596-0bc281dd93e8 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:55.993993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07c965-ee0d-4d2c-a596-0bc281dd93e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:37:55.994293 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07c965-ee0d-4d2c-a596-0bc281dd93e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:55.995669 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07c965-ee0d-4d2c-a596-0bc281dd93e8 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:56.003238 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 621/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Sep 14 19:37:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:37:56.009125 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71c777-ae23-4bed-9f12-ecd56d0f3b08 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:56.094332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:56.113366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71c777-ae23-4bed-9f12-ecd56d0f3b08 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:56.146803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40f109-b2af-4378-b7ca-d559bf30db59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:56.147416 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40f109-b2af-4378-b7ca-d559bf30db59 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:56.147722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40f109-b2af-4378-b7ca-d559bf30db59 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:56.147995 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40f109-b2af-4378-b7ca-d559bf30db59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:56.158957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40f109-b2af-4378-b7ca-d559bf30db59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:56.160408 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40f109-b2af-4378-b7ca-d559bf30db59 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:56.174900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-1e40f109-b2af-4378-b7ca-d559bf30db59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:37:56.174900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:37:56.174900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:37:56.174900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:37:56.174900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:37:56.174900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:37:56.174900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:37:56.174900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:37:56.174900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:37:56.174900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:37:56.174900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:37:56.174900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:37:56.174900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:37:56.174900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:37:56.174900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:37:56.174900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:37:56.176105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:37:56.176105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:37:56.176105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:37:56.176105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:37:56.176105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:37:56.176105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:37:56.176105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:37:56.176105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:37:56.176105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:37:56.176105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:37:56.176105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:37:56.176105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:37:56.176105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:37:56.176105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:37:56.176105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:37:56.176105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:37:56.176105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:37:56.177336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:37:56.177336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:37:56.177336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:37:56.177336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 616/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:37:56.183214 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07c965-ee0d-4d2c-a596-0bc281dd93e8 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:56.279944 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07c965-ee0d-4d2c-a596-0bc281dd93e8 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:56.289090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:56.312750 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a5a28-941f-43c2-a878-76eee8ceae01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:56.313376 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a5a28-941f-43c2-a878-76eee8ceae01 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:56.313646 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a5a28-941f-43c2-a878-76eee8ceae01 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:56.313912 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a5a28-941f-43c2-a878-76eee8ceae01 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:56.314538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a5a28-941f-43c2-a878-76eee8ceae01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:37:56.314834 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a5a28-941f-43c2-a878-76eee8ceae01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:56.316232 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a5a28-941f-43c2-a878-76eee8ceae01 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:56.327463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 622/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:37:56.333777 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40f109-b2af-4378-b7ca-d559bf30db59 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:56.436069 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40f109-b2af-4378-b7ca-d559bf30db59 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:56.469003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11630e7b-b2fb-4c13-bb0e-2de9268beb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:56.470244 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11630e7b-b2fb-4c13-bb0e-2de9268beb1d None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:56.470561 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11630e7b-b2fb-4c13-bb0e-2de9268beb1d None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:56.470880 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11630e7b-b2fb-4c13-bb0e-2de9268beb1d None admin] PATH_INFO: `/v3/users/placement` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:56.473560 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:56.478347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11630e7b-b2fb-4c13-bb0e-2de9268beb1d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:56.479833 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11630e7b-b2fb-4c13-bb0e-2de9268beb1d None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:56.490767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-11630e7b-b2fb-4c13-bb0e-2de9268beb1d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 19:37:56.490767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:37:56.490767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:37:56.490767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:37:56.490767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:37:56.490767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:37:56.490767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:37:56.490767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:37:56.490767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:37:56.490767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:37:56.490767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:37:56.490767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:37:56.490767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:37:56.490767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:37:56.490767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:37:56.490767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:37:56.491806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:37:56.491806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:37:56.491806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:37:56.491806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:37:56.491806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:37:56.491806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:37:56.491806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:37:56.491806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:37:56.491806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:37:56.491806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:37:56.491806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:37:56.491806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:37:56.491806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:37:56.491806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:37:56.491806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:37:56.491806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:37:56.491806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:37:56.491806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:37:56.492872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:37:56.492872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:37:56.492872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:37:56.492872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:37:56.492872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:37:56.492872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:37:56.492872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:37:56.492872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:37:56.492872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 19:37:56.492872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:37:56.492872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 617/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:37:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:37:56.497972 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a5a28-941f-43c2-a878-76eee8ceae01 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:56.597227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a5a28-941f-43c2-a878-76eee8ceae01 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:56.630408 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a8b24-8a49-4b6b-8bdc-8a21573bce2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:56.631011 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a8b24-8a49-4b6b-8bdc-8a21573bce2d None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:56.631284 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a8b24-8a49-4b6b-8bdc-8a21573bce2d None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:56.631561 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a8b24-8a49-4b6b-8bdc-8a21573bce2d None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:56.632285 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a8b24-8a49-4b6b-8bdc-8a21573bce2d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:37:56.632584 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a8b24-8a49-4b6b-8bdc-8a21573bce2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:56.633988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a8b24-8a49-4b6b-8bdc-8a21573bce2d None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:56.650778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 623/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Wed Sep 14 19:37:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:37:56.656695 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11630e7b-b2fb-4c13-bb0e-2de9268beb1d None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:56.754121 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11630e7b-b2fb-4c13-bb0e-2de9268beb1d None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:56.794033 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86155d97-7585-44c7-ad26-83ae9bbd9a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:56.794891 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86155d97-7585-44c7-ad26-83ae9bbd9a49 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:56.795165 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86155d97-7585-44c7-ad26-83ae9bbd9a49 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:56.795431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86155d97-7585-44c7-ad26-83ae9bbd9a49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:56.855733 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:56.863193 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86155d97-7585-44c7-ad26-83ae9bbd9a49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:56.864676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86155d97-7585-44c7-ad26-83ae9bbd9a49 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:56.961819 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 618/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:37:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 19:37:56.967695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a8b24-8a49-4b6b-8bdc-8a21573bce2d None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:56.994691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:57.065067 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a8b24-8a49-4b6b-8bdc-8a21573bce2d None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:57.097917 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9eb2a5-fc72-4cf0-b04b-458ced819e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:57.098552 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9eb2a5-fc72-4cf0-b04b-458ced819e7a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:57.098836 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9eb2a5-fc72-4cf0-b04b-458ced819e7a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:57.099110 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9eb2a5-fc72-4cf0-b04b-458ced819e7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:57.108721 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9eb2a5-fc72-4cf0-b04b-458ced819e7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:57.110679 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9eb2a5-fc72-4cf0-b04b-458ced819e7a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:57.125565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-6a9eb2a5-fc72-4cf0-b04b-458ced819e7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:37:57.125565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:37:57.125565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:37:57.125565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:37:57.125565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:37:57.125565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:37:57.125565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:37:57.125565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:37:57.125565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:37:57.125565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:37:57.125565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:37:57.125565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:37:57.125565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:37:57.125565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:37:57.125565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:37:57.125565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:37:57.126645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:37:57.126645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:37:57.126645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:37:57.126645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:37:57.126645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:37:57.126645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:37:57.126645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:37:57.126645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:37:57.126645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:37:57.126645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:37:57.126645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:37:57.126645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:37:57.126645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:37:57.126645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:37:57.126645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:37:57.126645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:37:57.126645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:37:57.127747 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:37:57.127747 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:37:57.127747 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:37:57.127747 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 624/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:37:57.132439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86155d97-7585-44c7-ad26-83ae9bbd9a49 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:57.225041 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:57.230713 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86155d97-7585-44c7-ad26-83ae9bbd9a49 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:57.264027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da60452-9a04-4b4f-a521-ff0a92b8aff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:57.264699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da60452-9a04-4b4f-a521-ff0a92b8aff1 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:57.265031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da60452-9a04-4b4f-a521-ff0a92b8aff1 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:57.265330 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da60452-9a04-4b4f-a521-ff0a92b8aff1 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:57.266596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da60452-9a04-4b4f-a521-ff0a92b8aff1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:37:57.266892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da60452-9a04-4b4f-a521-ff0a92b8aff1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:57.268268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da60452-9a04-4b4f-a521-ff0a92b8aff1 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:57.279163 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 619/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:37:57.284955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9eb2a5-fc72-4cf0-b04b-458ced819e7a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:57.360734 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:57.382575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9eb2a5-fc72-4cf0-b04b-458ced819e7a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:57.415749 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12aa115-229a-4358-aa6a-dc11ba4934ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:57.416401 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12aa115-229a-4358-aa6a-dc11ba4934ce None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:57.416656 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12aa115-229a-4358-aa6a-dc11ba4934ce None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:57.416928 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12aa115-229a-4358-aa6a-dc11ba4934ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:57.423851 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12aa115-229a-4358-aa6a-dc11ba4934ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:57.425269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12aa115-229a-4358-aa6a-dc11ba4934ce None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:57.436193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-d12aa115-229a-4358-aa6a-dc11ba4934ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:37:57.436193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:37:57.436193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:37:57.436193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:37:57.436193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:37:57.436193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:37:57.436193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:37:57.436193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:37:57.436193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:37:57.436193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:37:57.436193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:37:57.436193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:37:57.436193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:37:57.436193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:37:57.436193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:37:57.437791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:37:57.437791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:37:57.437791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:37:57.437791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:37:57.437791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:37:57.437791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:37:57.437791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:37:57.437791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:37:57.437791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:37:57.437791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:37:57.437791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:37:57.437791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:37:57.437791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:37:57.437791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:37:57.437791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:37:57.437791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:37:57.437791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:37:57.438841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:37:57.438841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:37:57.438841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:37:57.438841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:37:57.438841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:37:57.438841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:37:57.438841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:37:57.438841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:37:57.438841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 625/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:37:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:37:57.444381 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da60452-9a04-4b4f-a521-ff0a92b8aff1 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:57.544770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da60452-9a04-4b4f-a521-ff0a92b8aff1 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:57.577511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b2674-b5f9-4c20-8d31-b9e5e14326d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:57.578148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b2674-b5f9-4c20-8d31-b9e5e14326d8 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:57.578510 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b2674-b5f9-4c20-8d31-b9e5e14326d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:57.578783 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b2674-b5f9-4c20-8d31-b9e5e14326d8 None admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:57.579462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b2674-b5f9-4c20-8d31-b9e5e14326d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:37:57.579791 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b2674-b5f9-4c20-8d31-b9e5e14326d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:57.581195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b2674-b5f9-4c20-8d31-b9e5e14326d8 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:57.592791 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 620/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:37:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:37:57.599586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12aa115-229a-4358-aa6a-dc11ba4934ce None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:37:57.700418 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12aa115-229a-4358-aa6a-dc11ba4934ce None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:37:57.734086 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d3c36-8d8b-4666-bc99-cb9f592e26a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:37:57.734665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d3c36-8d8b-4666-bc99-cb9f592e26a3 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:57.734937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d3c36-8d8b-4666-bc99-cb9f592e26a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:57.735204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d3c36-8d8b-4666-bc99-cb9f592e26a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:57.735945 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d3c36-8d8b-4666-bc99-cb9f592e26a3 None admin] RBAC: Adding query filter params (role.id=b2e8ea485659485f92e729741880d447, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=6942a851a69b446e90a2b138f4482465) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:37:57.736251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d3c36-8d8b-4666-bc99-cb9f592e26a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:37:57.737707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d3c36-8d8b-4666-bc99-cb9f592e26a3 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:37:57.743229 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 626/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:37:57 2022] GET /identity/v3/role_assignments?user.id=6942a851a69b446e90a2b138f4482465&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=b2e8ea485659485f92e729741880d447 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:37:59.966217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596edab-ffcc-4ca9-b2d7-85b523913549 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:59.966819 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596edab-ffcc-4ca9-b2d7-85b523913549 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:59.966819 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596edab-ffcc-4ca9-b2d7-85b523913549 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:59.968153 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 621/1247] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:37:59.973336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918e653-8dce-435f-83c7-393705c84230 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:37:59.973780 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918e653-8dce-435f-83c7-393705c84230 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:37:59.973880 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918e653-8dce-435f-83c7-393705c84230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:37:59.980167 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:37:59.992603 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-2918e653-8dce-435f-83c7-393705c84230 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:37:59.993813 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2918e653-8dce-435f-83c7-393705c84230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:38:00.058919 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 627/1248] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:37:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:38:00.333436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596edab-ffcc-4ca9-b2d7-85b523913549 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:00.351681 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:00.438518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596edab-ffcc-4ca9-b2d7-85b523913549 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:00.473092 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05df319-e732-4a6b-91ba-7703a6fdb530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:00.473717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05df319-e732-4a6b-91ba-7703a6fdb530 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:00.473993 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05df319-e732-4a6b-91ba-7703a6fdb530 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:00.474261 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05df319-e732-4a6b-91ba-7703a6fdb530 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:00.484468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05df319-e732-4a6b-91ba-7703a6fdb530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:38:00.489238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-c05df319-e732-4a6b-91ba-7703a6fdb530 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:38:00.489238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:38:00.489238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:38:00.489238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:38:00.489238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:38:00.489238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:38:00.489238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:38:00.489238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:38:00.489238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:38:00.489238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:38:00.489238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:38:00.489238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:38:00.489238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:38:00.489238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:38:00.489238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:38:00.489238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:38:00.490217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:38:00.490217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:38:00.490217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:38:00.490217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:38:00.490217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:38:00.490217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:38:00.490217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:38:00.490217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:38:00.490217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:38:00.490217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:38:00.490217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:38:00.490217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:38:00.490217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:38:00.490217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:38:00.490217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:38:00.490217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:38:00.491600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:38:00.491600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:38:00.491600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:38:00.491600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:38:00.491600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:38:00.491600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:38:00.491600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:38:00.491600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:38:00.491600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:38:00.491600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:38:00.491600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:38:00.491600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:38:00.491600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 622/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:38:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:38:00.496414 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918e653-8dce-435f-83c7-393705c84230 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:00.593414 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918e653-8dce-435f-83c7-393705c84230 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:00.622130 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:00.626946 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba8355-2c44-46ad-9772-9c547518cc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:00.627579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba8355-2c44-46ad-9772-9c547518cc47 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:00.627864 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba8355-2c44-46ad-9772-9c547518cc47 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:00.628142 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba8355-2c44-46ad-9772-9c547518cc47 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:00.628803 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba8355-2c44-46ad-9772-9c547518cc47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:00.629108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba8355-2c44-46ad-9772-9c547518cc47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:00.630460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba8355-2c44-46ad-9772-9c547518cc47 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:00.638900 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 628/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:38:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:38:00.644772 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05df319-e732-4a6b-91ba-7703a6fdb530 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:00.722285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:00.744300 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05df319-e732-4a6b-91ba-7703a6fdb530 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:00.777533 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e972994-bdc9-49d4-b168-c6e718dade0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:00.778165 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e972994-bdc9-49d4-b168-c6e718dade0f None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:00.778443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e972994-bdc9-49d4-b168-c6e718dade0f None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:00.779325 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e972994-bdc9-49d4-b168-c6e718dade0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:00.789242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e972994-bdc9-49d4-b168-c6e718dade0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:00.790690 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e972994-bdc9-49d4-b168-c6e718dade0f None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:00.805388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-7e972994-bdc9-49d4-b168-c6e718dade0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:38:00.805388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:38:00.805388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:38:00.805388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:38:00.805388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:38:00.805388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:38:00.805388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:38:00.805388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:38:00.805388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:38:00.805388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:38:00.805388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:38:00.805388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:38:00.805388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:38:00.805388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:38:00.805388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:38:00.805388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:38:00.806449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:38:00.806449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:38:00.806449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:38:00.806449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:38:00.806449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:38:00.806449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:38:00.806449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:38:00.806449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:38:00.806449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:38:00.806449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:38:00.806449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:38:00.806449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:38:00.806449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:38:00.806449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:38:00.806449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:38:00.806449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:38:00.806449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:38:00.807873 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:38:00.807873 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:38:00.807873 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:38:00.807873 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 623/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:38:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:38:00.812782 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba8355-2c44-46ad-9772-9c547518cc47 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:00.912057 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba8355-2c44-46ad-9772-9c547518cc47 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:00.945608 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcffe28-a27f-4dbd-b86e-cb03af1ab4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:00.946330 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcffe28-a27f-4dbd-b86e-cb03af1ab4f9 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:00.946636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcffe28-a27f-4dbd-b86e-cb03af1ab4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:00.946969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcffe28-a27f-4dbd-b86e-cb03af1ab4f9 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:00.947627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcffe28-a27f-4dbd-b86e-cb03af1ab4f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:00.947931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcffe28-a27f-4dbd-b86e-cb03af1ab4f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:00.949274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcffe28-a27f-4dbd-b86e-cb03af1ab4f9 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:00.961894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 629/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:38:00.968713 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e972994-bdc9-49d4-b168-c6e718dade0f None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:01.069920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e972994-bdc9-49d4-b168-c6e718dade0f None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:01.096294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:01.103914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf489b-2451-4ac6-9cda-e7f95e303262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:01.104548 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf489b-2451-4ac6-9cda-e7f95e303262 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:01.104842 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf489b-2451-4ac6-9cda-e7f95e303262 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:01.105096 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf489b-2451-4ac6-9cda-e7f95e303262 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:01.113259 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf489b-2451-4ac6-9cda-e7f95e303262 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:01.114680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf489b-2451-4ac6-9cda-e7f95e303262 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:01.126550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-09bf489b-2451-4ac6-9cda-e7f95e303262 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 19:38:01.126550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:38:01.126550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:38:01.126550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:38:01.126550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:38:01.126550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:38:01.126550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:38:01.126550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:38:01.126550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:38:01.126550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:38:01.126550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:38:01.126550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:38:01.126550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:38:01.126550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:38:01.126550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:38:01.126550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:38:01.127717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:38:01.127717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:38:01.127717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:38:01.127717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:38:01.127717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:38:01.127717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:38:01.127717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:38:01.127717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:38:01.127717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:38:01.127717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:38:01.127717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:38:01.127717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:38:01.127717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:38:01.127717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:38:01.127717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:38:01.127717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:38:01.127717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:38:01.127717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:38:01.129080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:38:01.129080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:38:01.129080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:38:01.129080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:38:01.129080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:38:01.129080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:38:01.129080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:38:01.129080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:38:01.129080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 19:38:01.129080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:38:01.129080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 624/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:38:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:38:01.133539 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcffe28-a27f-4dbd-b86e-cb03af1ab4f9 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:01.188335 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:01.230537 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcffe28-a27f-4dbd-b86e-cb03af1ab4f9 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:01.264204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef459d-e10c-4734-a2ad-f126a2d9c22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:01.264783 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef459d-e10c-4734-a2ad-f126a2d9c22a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:01.265057 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef459d-e10c-4734-a2ad-f126a2d9c22a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:01.265325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef459d-e10c-4734-a2ad-f126a2d9c22a None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:01.266050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef459d-e10c-4734-a2ad-f126a2d9c22a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:01.266333 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef459d-e10c-4734-a2ad-f126a2d9c22a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:01.267812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef459d-e10c-4734-a2ad-f126a2d9c22a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:01.284143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 630/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Wed Sep 14 19:38:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:38:01.290138 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf489b-2451-4ac6-9cda-e7f95e303262 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:01.390705 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf489b-2451-4ac6-9cda-e7f95e303262 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:01.424246 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ccd4d-8242-4910-96ef-06a06f3c663b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:01.424841 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ccd4d-8242-4910-96ef-06a06f3c663b None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:01.425114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ccd4d-8242-4910-96ef-06a06f3c663b None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:01.425380 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ccd4d-8242-4910-96ef-06a06f3c663b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:01.479033 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:01.490713 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ccd4d-8242-4910-96ef-06a06f3c663b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:01.492225 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ccd4d-8242-4910-96ef-06a06f3c663b None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:01.588476 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 625/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:38:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 19:38:01.595076 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef459d-e10c-4734-a2ad-f126a2d9c22a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:01.691490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef459d-e10c-4734-a2ad-f126a2d9c22a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:01.705682 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:01.726628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc74320-674f-477f-b5d9-c1d21a37f6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:01.727255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc74320-674f-477f-b5d9-c1d21a37f6f0 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:01.727531 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc74320-674f-477f-b5d9-c1d21a37f6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:01.727830 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc74320-674f-477f-b5d9-c1d21a37f6f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:01.737442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc74320-674f-477f-b5d9-c1d21a37f6f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:01.738809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc74320-674f-477f-b5d9-c1d21a37f6f0 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:01.753618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-8fc74320-674f-477f-b5d9-c1d21a37f6f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:38:01.753618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:38:01.753618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:38:01.753618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:38:01.753618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:38:01.753618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:38:01.753618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:38:01.753618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:38:01.753618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:38:01.753618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:38:01.753618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:38:01.753618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:38:01.753618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:38:01.753618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:38:01.753618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:38:01.753618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:38:01.754748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:38:01.754748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:38:01.754748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:38:01.754748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:38:01.754748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:38:01.754748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:38:01.754748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:38:01.754748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:38:01.754748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:38:01.754748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:38:01.754748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:38:01.754748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:38:01.754748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:38:01.754748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:38:01.754748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:38:01.754748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:38:01.754748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:38:01.755885 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:38:01.755885 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:38:01.755885 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:38:01.755885 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 631/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:38:01.760502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ccd4d-8242-4910-96ef-06a06f3c663b None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:01.848663 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:01.861118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ccd4d-8242-4910-96ef-06a06f3c663b None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:01.893870 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60060eea-3da1-43ef-9faa-ee158bab7f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:01.894468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60060eea-3da1-43ef-9faa-ee158bab7f95 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:01.894743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60060eea-3da1-43ef-9faa-ee158bab7f95 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:01.895080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60060eea-3da1-43ef-9faa-ee158bab7f95 None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:01.895744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60060eea-3da1-43ef-9faa-ee158bab7f95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:01.896046 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60060eea-3da1-43ef-9faa-ee158bab7f95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:01.897402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60060eea-3da1-43ef-9faa-ee158bab7f95 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:01.909831 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 626/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:38:01.915569 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc74320-674f-477f-b5d9-c1d21a37f6f0 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:02.015213 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc74320-674f-477f-b5d9-c1d21a37f6f0 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:02.048700 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da068487-297e-408b-ad13-38d289d04e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:02.049331 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da068487-297e-408b-ad13-38d289d04e6f None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:02.049611 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da068487-297e-408b-ad13-38d289d04e6f None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:02.049887 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da068487-297e-408b-ad13-38d289d04e6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:02.056354 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da068487-297e-408b-ad13-38d289d04e6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:02.057833 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da068487-297e-408b-ad13-38d289d04e6f None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:02.069217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-da068487-297e-408b-ad13-38d289d04e6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:38:02.069217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:38:02.069217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:38:02.069217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:38:02.069217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:38:02.069217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:38:02.069217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:38:02.069217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:38:02.069217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:38:02.069217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:38:02.069217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:38:02.069217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:38:02.069217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:38:02.069217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:38:02.069217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:38:02.070135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:38:02.070135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:38:02.070135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:38:02.070135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:38:02.070135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:38:02.070135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:38:02.070135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:38:02.070135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:38:02.070135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:38:02.070135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:38:02.070135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:38:02.070135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:38:02.070135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:38:02.070135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:38:02.070135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:38:02.070135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:38:02.070135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:38:02.071189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:38:02.071189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:38:02.071189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:38:02.071189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:38:02.071189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:38:02.071189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:38:02.071189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:38:02.071189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:38:02.071189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 632/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:38:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:38:02.076343 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60060eea-3da1-43ef-9faa-ee158bab7f95 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:02.176495 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60060eea-3da1-43ef-9faa-ee158bab7f95 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:02.209699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378df91-68db-4a61-9e2a-83004385a658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:02.210304 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378df91-68db-4a61-9e2a-83004385a658 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:02.210584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378df91-68db-4a61-9e2a-83004385a658 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:02.210856 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378df91-68db-4a61-9e2a-83004385a658 None admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:02.211557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378df91-68db-4a61-9e2a-83004385a658 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:02.211881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378df91-68db-4a61-9e2a-83004385a658 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:02.213305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378df91-68db-4a61-9e2a-83004385a658 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:02.226521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 627/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:38:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:38:02.233095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da068487-297e-408b-ad13-38d289d04e6f None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:02.258447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:02.331962 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da068487-297e-408b-ad13-38d289d04e6f None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:02.364581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659ba48-13cd-4ff6-b0e8-8e5c06be4537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:02.365181 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659ba48-13cd-4ff6-b0e8-8e5c06be4537 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:02.365460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659ba48-13cd-4ff6-b0e8-8e5c06be4537 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:02.365732 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659ba48-13cd-4ff6-b0e8-8e5c06be4537 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:02.366486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659ba48-13cd-4ff6-b0e8-8e5c06be4537 None admin] RBAC: Adding query filter params (role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=6942a851a69b446e90a2b138f4482465) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:02.366797 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659ba48-13cd-4ff6-b0e8-8e5c06be4537 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:02.368269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659ba48-13cd-4ff6-b0e8-8e5c06be4537 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:02.374079 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 633/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:38:02 2022] GET /identity/v3/role_assignments?user.id=6942a851a69b446e90a2b138f4482465&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:38:04.497805 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcbad8-2f76-41a3-811c-e85bd973ce7f None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:04.498357 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcbad8-2f76-41a3-811c-e85bd973ce7f None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:04.498357 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcbad8-2f76-41a3-811c-e85bd973ce7f None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:04.499747 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 628/1261] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:38:04.505243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5406441-2bc4-48ed-aeae-12e0a6d5445d None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:04.505661 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5406441-2bc4-48ed-aeae-12e0a6d5445d None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:04.505791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5406441-2bc4-48ed-aeae-12e0a6d5445d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:04.535846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-f5406441-2bc4-48ed-aeae-12e0a6d5445d None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:38:04.537067 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f5406441-2bc4-48ed-aeae-12e0a6d5445d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:38:04.609771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 634/1262] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:38:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:38:04.945373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcbad8-2f76-41a3-811c-e85bd973ce7f None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:04.956569 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:05.066161 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcbad8-2f76-41a3-811c-e85bd973ce7f None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:05.101294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65650b01-acde-4032-a565-e02bd0798d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:05.101916 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65650b01-acde-4032-a565-e02bd0798d45 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:05.102261 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65650b01-acde-4032-a565-e02bd0798d45 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:05.102594 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65650b01-acde-4032-a565-e02bd0798d45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:05.119715 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65650b01-acde-4032-a565-e02bd0798d45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:38:05.128576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-65650b01-acde-4032-a565-e02bd0798d45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:38:05.128576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:38:05.128576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:38:05.128576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:38:05.128576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:38:05.128576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:38:05.128576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:38:05.128576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:38:05.128576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:38:05.128576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:38:05.128576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:38:05.128576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:38:05.128576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:38:05.128576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:38:05.128576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:38:05.128576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:38:05.129723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:38:05.129723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:38:05.129723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:38:05.129723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:38:05.129723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:38:05.129723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:38:05.129723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:38:05.129723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:38:05.129723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:38:05.129723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:38:05.129723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:38:05.129723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:38:05.129723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:38:05.129723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:38:05.129723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:38:05.129723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:38:05.130745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:38:05.130745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:38:05.130745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:38:05.130745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:38:05.130745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:38:05.130745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:38:05.130745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:38:05.130745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:38:05.130745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:38:05.130745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:38:05.130745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:38:05.130745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:38:05.130745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 629/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:38:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:38:05.137237 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5406441-2bc4-48ed-aeae-12e0a6d5445d None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:05.158646 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:05.238050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5406441-2bc4-48ed-aeae-12e0a6d5445d None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:05.278691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4aec13-3cce-473e-8efe-0b78e7733155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:05.279300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4aec13-3cce-473e-8efe-0b78e7733155 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:05.279602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4aec13-3cce-473e-8efe-0b78e7733155 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:05.279876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4aec13-3cce-473e-8efe-0b78e7733155 None admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:05.280529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4aec13-3cce-473e-8efe-0b78e7733155 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:05.280837 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4aec13-3cce-473e-8efe-0b78e7733155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:05.282225 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4aec13-3cce-473e-8efe-0b78e7733155 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:05.290364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 635/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:38:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:38:05.296472 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65650b01-acde-4032-a565-e02bd0798d45 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:05.363565 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:05.398835 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65650b01-acde-4032-a565-e02bd0798d45 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:05.432624 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa7f96-17e0-41ea-8c2f-0c93d103e39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:05.433255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa7f96-17e0-41ea-8c2f-0c93d103e39f None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:05.433530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa7f96-17e0-41ea-8c2f-0c93d103e39f None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:05.433797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa7f96-17e0-41ea-8c2f-0c93d103e39f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:05.443597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa7f96-17e0-41ea-8c2f-0c93d103e39f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:05.445022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa7f96-17e0-41ea-8c2f-0c93d103e39f None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:05.461202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-5efa7f96-17e0-41ea-8c2f-0c93d103e39f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:38:05.461202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:38:05.461202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:38:05.461202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:38:05.461202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:38:05.461202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:38:05.461202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:38:05.461202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:38:05.461202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:38:05.461202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:38:05.461202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:38:05.461202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:38:05.461202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:38:05.461202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:38:05.461202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:38:05.461202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:38:05.462366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:38:05.462366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:38:05.462366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:38:05.462366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:38:05.462366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:38:05.462366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:38:05.462366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:38:05.462366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:38:05.462366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:38:05.462366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:38:05.462366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:38:05.462366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:38:05.462366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:38:05.462366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:38:05.462366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:38:05.462366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:38:05.462366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:38:05.463982 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:38:05.463982 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:38:05.463982 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:38:05.463982 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 630/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:38:05.469099 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4aec13-3cce-473e-8efe-0b78e7733155 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:05.550278 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:05.569096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4aec13-3cce-473e-8efe-0b78e7733155 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:05.601547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afff6b-b46c-41ac-a85f-301767f56274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:05.602146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afff6b-b46c-41ac-a85f-301767f56274 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:05.602420 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afff6b-b46c-41ac-a85f-301767f56274 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:05.602685 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afff6b-b46c-41ac-a85f-301767f56274 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:05.603331 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afff6b-b46c-41ac-a85f-301767f56274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:05.603657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afff6b-b46c-41ac-a85f-301767f56274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:05.605020 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afff6b-b46c-41ac-a85f-301767f56274 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:05.616078 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 636/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:38:05.623105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa7f96-17e0-41ea-8c2f-0c93d103e39f None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:05.724334 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa7f96-17e0-41ea-8c2f-0c93d103e39f None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:05.745867 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:05.765235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334004a-7f6b-4780-9c82-9281f65f3609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:05.765870 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334004a-7f6b-4780-9c82-9281f65f3609 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:05.766221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334004a-7f6b-4780-9c82-9281f65f3609 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:05.766418 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334004a-7f6b-4780-9c82-9281f65f3609 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:05.773939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334004a-7f6b-4780-9c82-9281f65f3609 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:05.776235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334004a-7f6b-4780-9c82-9281f65f3609 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:05.786541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-4334004a-7f6b-4780-9c82-9281f65f3609 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 19:38:05.786541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:38:05.786541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:38:05.786541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:38:05.786541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:38:05.786541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:38:05.786541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:38:05.786541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:38:05.786541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:38:05.786541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:38:05.786541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:38:05.786541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:38:05.786541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:38:05.786541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:38:05.786541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:38:05.786541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:38:05.787665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:38:05.787665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:38:05.787665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:38:05.787665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:38:05.787665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:38:05.787665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:38:05.787665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:38:05.787665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:38:05.787665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:38:05.787665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:38:05.787665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:38:05.787665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:38:05.787665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:38:05.787665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:38:05.787665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:38:05.787665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:38:05.787665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:38:05.787665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:38:05.788923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:38:05.788923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:38:05.788923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:38:05.788923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:38:05.788923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:38:05.788923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:38:05.788923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:38:05.788923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:38:05.788923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 19:38:05.788923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:38:05.788923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 631/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:38:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:38:05.793855 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afff6b-b46c-41ac-a85f-301767f56274 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:05.893238 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afff6b-b46c-41ac-a85f-301767f56274 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:05.927174 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ad9a8-f1a7-42ce-bcdf-a5c01c367bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:05.927811 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ad9a8-f1a7-42ce-bcdf-a5c01c367bc2 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:05.928088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ad9a8-f1a7-42ce-bcdf-a5c01c367bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:05.928358 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ad9a8-f1a7-42ce-bcdf-a5c01c367bc2 None admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:05.929070 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ad9a8-f1a7-42ce-bcdf-a5c01c367bc2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:05.929377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ad9a8-f1a7-42ce-bcdf-a5c01c367bc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:05.930799 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ad9a8-f1a7-42ce-bcdf-a5c01c367bc2 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:05.940390 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:05.948580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 637/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Wed Sep 14 19:38:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:38:05.954498 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334004a-7f6b-4780-9c82-9281f65f3609 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:06.054432 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334004a-7f6b-4780-9c82-9281f65f3609 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:06.087141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236609b-c0cc-4670-82f1-685f6cbdad51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:06.087879 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236609b-c0cc-4670-82f1-685f6cbdad51 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:06.088272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236609b-c0cc-4670-82f1-685f6cbdad51 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:06.088545 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236609b-c0cc-4670-82f1-685f6cbdad51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:06.102509 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236609b-c0cc-4670-82f1-685f6cbdad51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:06.105602 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236609b-c0cc-4670-82f1-685f6cbdad51 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:06.121478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-d236609b-c0cc-4670-82f1-685f6cbdad51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:38:06.121478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:38:06.121478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:38:06.121478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:38:06.121478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:38:06.121478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:38:06.121478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:38:06.121478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:38:06.121478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:38:06.121478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:38:06.121478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:38:06.121478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:38:06.121478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:38:06.121478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:38:06.121478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:38:06.121478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:38:06.122652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:38:06.122652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:38:06.122652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:38:06.122652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:38:06.122652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:38:06.122652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:38:06.122652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:38:06.122652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:38:06.122652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:38:06.122652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:38:06.122652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:38:06.122652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:38:06.122652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:38:06.122652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:38:06.122652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:38:06.122652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:38:06.122652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:38:06.123788 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:38:06.123788 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:38:06.123788 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:38:06.123788 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 632/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:38:06.128505 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ad9a8-f1a7-42ce-bcdf-a5c01c367bc2 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:06.224808 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ad9a8-f1a7-42ce-bcdf-a5c01c367bc2 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:06.258261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f38285-cd60-43a8-8027-f8ebd540aca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:06.264871 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f38285-cd60-43a8-8027-f8ebd540aca0 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:06.264871 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f38285-cd60-43a8-8027-f8ebd540aca0 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:06.264871 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f38285-cd60-43a8-8027-f8ebd540aca0 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:06.264871 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f38285-cd60-43a8-8027-f8ebd540aca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:06.264871 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f38285-cd60-43a8-8027-f8ebd540aca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:06.264871 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f38285-cd60-43a8-8027-f8ebd540aca0 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:06.273271 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 638/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:38:06.279479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236609b-c0cc-4670-82f1-685f6cbdad51 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:06.310664 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:06.379247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236609b-c0cc-4670-82f1-685f6cbdad51 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:06.413852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725e50a-d589-450b-962b-1763803a7261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:06.414480 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725e50a-d589-450b-962b-1763803a7261 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:06.414763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725e50a-d589-450b-962b-1763803a7261 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:06.415037 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725e50a-d589-450b-962b-1763803a7261 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:06.422205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725e50a-d589-450b-962b-1763803a7261 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:06.423726 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725e50a-d589-450b-962b-1763803a7261 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:06.435052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-0725e50a-d589-450b-962b-1763803a7261 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:38:06.435052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:38:06.435052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:38:06.435052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:38:06.435052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:38:06.435052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:38:06.435052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:38:06.435052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:38:06.435052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:38:06.435052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:38:06.435052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:38:06.435052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:38:06.435052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:38:06.435052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:38:06.435052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:38:06.436164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:38:06.436164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:38:06.436164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:38:06.436164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:38:06.436164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:38:06.436164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:38:06.436164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:38:06.436164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:38:06.436164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:38:06.436164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:38:06.436164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:38:06.436164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:38:06.436164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:38:06.436164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:38:06.436164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:38:06.436164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:38:06.436164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:38:06.437352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:38:06.437352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:38:06.437352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:38:06.437352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:38:06.437352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:38:06.437352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:38:06.437352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:38:06.437352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:38:06.437352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 633/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:38:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:38:06.442042 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f38285-cd60-43a8-8027-f8ebd540aca0 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:06.503171 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:06.543776 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f38285-cd60-43a8-8027-f8ebd540aca0 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:06.575733 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72423a53-5678-4bd6-9c93-9c95d8e06f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:06.576339 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72423a53-5678-4bd6-9c93-9c95d8e06f14 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:06.576617 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72423a53-5678-4bd6-9c93-9c95d8e06f14 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:06.576886 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72423a53-5678-4bd6-9c93-9c95d8e06f14 None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:06.577627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72423a53-5678-4bd6-9c93-9c95d8e06f14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:06.577933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72423a53-5678-4bd6-9c93-9c95d8e06f14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:06.579336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72423a53-5678-4bd6-9c93-9c95d8e06f14 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:06.592260 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 639/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:38:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:38:06.598396 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725e50a-d589-450b-962b-1763803a7261 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:06.689988 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:06.699094 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725e50a-d589-450b-962b-1763803a7261 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:06.733836 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b3bad-83ba-411b-9342-c31d102970de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:06.736172 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b3bad-83ba-411b-9342-c31d102970de None admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:06.736172 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b3bad-83ba-411b-9342-c31d102970de None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:06.736172 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b3bad-83ba-411b-9342-c31d102970de None admin] PATH_INFO: `/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/6942a851a69b446e90a2b138f4482465/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:06.737032 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b3bad-83ba-411b-9342-c31d102970de None admin] RBAC: Authorizing `identity:create_grant(project_id=2e3e0c278ce94ce3a132496923eef365, user_id=6942a851a69b446e90a2b138f4482465, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:06.738457 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b3bad-83ba-411b-9342-c31d102970de None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:06.875492 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 634/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Sep 14 19:38:06 2022] PUT /identity/v3/projects/2e3e0c278ce94ce3a132496923eef365/users/6942a851a69b446e90a2b138f4482465/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:38:09.063923 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87bb4f-4cf5-4d90-9237-90cf31829d9b None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:09.064484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87bb4f-4cf5-4d90-9237-90cf31829d9b None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:09.064484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87bb4f-4cf5-4d90-9237-90cf31829d9b None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:09.065825 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 640/1274] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:38:09.071286 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b840c93-63e6-4425-a87a-0d51f9f9f994 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:09.071716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b840c93-63e6-4425-a87a-0d51f9f9f994 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:09.071901 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b840c93-63e6-4425-a87a-0d51f9f9f994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:09.089892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-7b840c93-63e6-4425-a87a-0d51f9f9f994 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:38:09.091071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-7b840c93-63e6-4425-a87a-0d51f9f9f994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:38:09.167954 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 635/1275] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:38:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:38:09.436153 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87bb4f-4cf5-4d90-9237-90cf31829d9b None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:09.541922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87bb4f-4cf5-4d90-9237-90cf31829d9b None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:09.558959 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:09.575093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ab738-cae0-4693-829f-500d5bd55802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:09.575760 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ab738-cae0-4693-829f-500d5bd55802 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:09.576091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ab738-cae0-4693-829f-500d5bd55802 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:09.576369 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ab738-cae0-4693-829f-500d5bd55802 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:09.586585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ab738-cae0-4693-829f-500d5bd55802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 19:38:09.591344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-d86ab738-cae0-4693-829f-500d5bd55802 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:38:09.591344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:38:09.591344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:38:09.591344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:38:09.591344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:38:09.591344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:38:09.591344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:38:09.591344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:38:09.591344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:38:09.591344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:38:09.591344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:38:09.591344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:38:09.591344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 19:38:09.591344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 19:38:09.591344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 19:38:09.591344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 19:38:09.592525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 19:38:09.592525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 19:38:09.592525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 19:38:09.592525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 19:38:09.592525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:38:09.592525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:38:09.592525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:38:09.592525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:38:09.592525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:38:09.592525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:38:09.592525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:38:09.592525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:38:09.592525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:38:09.592525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:38:09.592525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:38:09.592525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:38:09.593443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:38:09.593443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:38:09.593443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:38:09.593443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:38:09.593443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 19:38:09.593443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 19:38:09.593443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 19:38:09.593443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 19:38:09.593443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 19:38:09.593443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 19:38:09.593443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 19:38:09.593443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:38:09.593443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 641/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Sep 14 19:38:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:38:09.598726 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b840c93-63e6-4425-a87a-0d51f9f9f994 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:09.678918 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:09.696461 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b840c93-63e6-4425-a87a-0d51f9f9f994 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:09.729593 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dabbe1-eada-484e-910b-12482d5dee65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:09.730202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dabbe1-eada-484e-910b-12482d5dee65 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:09.730482 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dabbe1-eada-484e-910b-12482d5dee65 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:09.730756 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dabbe1-eada-484e-910b-12482d5dee65 None admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:09.731418 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dabbe1-eada-484e-910b-12482d5dee65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:09.731750 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dabbe1-eada-484e-910b-12482d5dee65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:09.733162 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dabbe1-eada-484e-910b-12482d5dee65 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:09.741362 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 636/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Sep 14 19:38:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:38:09.747418 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ab738-cae0-4693-829f-500d5bd55802 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:09.847921 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ab738-cae0-4693-829f-500d5bd55802 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:09.880512 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755ef38-f313-4551-b394-4f7ba57cad5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:09.881137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755ef38-f313-4551-b394-4f7ba57cad5b None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:09.881412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755ef38-f313-4551-b394-4f7ba57cad5b None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:09.882181 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755ef38-f313-4551-b394-4f7ba57cad5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:09.891827 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755ef38-f313-4551-b394-4f7ba57cad5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:09.893245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755ef38-f313-4551-b394-4f7ba57cad5b None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:09.907906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-1755ef38-f313-4551-b394-4f7ba57cad5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:38:09.907906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:38:09.907906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:38:09.907906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:38:09.907906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:38:09.907906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:38:09.907906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:38:09.907906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:38:09.907906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:38:09.907906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:38:09.907906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:38:09.907906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:38:09.907906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:38:09.907906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:38:09.907906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:38:09.907906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:38:09.909089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:38:09.909089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:38:09.909089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:38:09.909089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:38:09.909089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:38:09.909089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:38:09.909089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:38:09.909089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:38:09.909089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:38:09.909089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:38:09.909089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:38:09.909089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:38:09.909089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:38:09.909089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:38:09.909089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:38:09.909089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:38:09.909089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:38:09.909992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:38:09.909992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:38:09.909992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:38:09.909992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 642/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:38:09.915458 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dabbe1-eada-484e-910b-12482d5dee65 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:10.017849 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dabbe1-eada-484e-910b-12482d5dee65 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:10.051561 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c032308-e3c9-41fe-88c1-3e52ec9761cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:10.052177 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c032308-e3c9-41fe-88c1-3e52ec9761cb None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:10.052452 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c032308-e3c9-41fe-88c1-3e52ec9761cb None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:10.052721 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c032308-e3c9-41fe-88c1-3e52ec9761cb None admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:10.053358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c032308-e3c9-41fe-88c1-3e52ec9761cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:10.054298 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c032308-e3c9-41fe-88c1-3e52ec9761cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:10.055855 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c032308-e3c9-41fe-88c1-3e52ec9761cb None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:10.067591 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 637/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:38:10.074330 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755ef38-f313-4551-b394-4f7ba57cad5b None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:10.104215 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:10.171233 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755ef38-f313-4551-b394-4f7ba57cad5b None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:10.203909 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ec7bb-7a8e-4871-930f-4f82d6c05797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:10.204528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ec7bb-7a8e-4871-930f-4f82d6c05797 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:10.204803 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ec7bb-7a8e-4871-930f-4f82d6c05797 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:10.205068 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ec7bb-7a8e-4871-930f-4f82d6c05797 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:10.212500 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ec7bb-7a8e-4871-930f-4f82d6c05797 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:10.213911 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ec7bb-7a8e-4871-930f-4f82d6c05797 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:10.226254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-db6ec7bb-7a8e-4871-930f-4f82d6c05797 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 19:38:10.226254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:38:10.226254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:38:10.226254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:38:10.226254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:38:10.226254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:38:10.226254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:38:10.226254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:38:10.226254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:38:10.226254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:38:10.226254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:38:10.226254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:38:10.226254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 19:38:10.226254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 19:38:10.226254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 19:38:10.226254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 19:38:10.227377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:38:10.227377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:38:10.227377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 19:38:10.227377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:38:10.227377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 19:38:10.227377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 19:38:10.227377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:38:10.227377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:38:10.227377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:38:10.227377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:38:10.227377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:38:10.227377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:38:10.227377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:38:10.227377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:38:10.227377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:38:10.227377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:38:10.227377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:38:10.227377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:38:10.228543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:38:10.228543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:38:10.228543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 19:38:10.228543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 19:38:10.228543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 19:38:10.228543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 19:38:10.228543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 19:38:10.228543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 19:38:10.228543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 19:38:10.228543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:38:10.228543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 643/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:38:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:38:10.233406 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c032308-e3c9-41fe-88c1-3e52ec9761cb None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:10.237194 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:10.334015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c032308-e3c9-41fe-88c1-3e52ec9761cb None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:10.371937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f8f92-9f88-406b-b792-e1c73242ed8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:10.371937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f8f92-9f88-406b-b792-e1c73242ed8a None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:10.372212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f8f92-9f88-406b-b792-e1c73242ed8a None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:10.372484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f8f92-9f88-406b-b792-e1c73242ed8a None admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:10.373211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f8f92-9f88-406b-b792-e1c73242ed8a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:10.373514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f8f92-9f88-406b-b792-e1c73242ed8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:10.374926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f8f92-9f88-406b-b792-e1c73242ed8a None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:10.392726 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 638/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Wed Sep 14 19:38:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:38:10.398749 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ec7bb-7a8e-4871-930f-4f82d6c05797 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:10.485553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:10.495098 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ec7bb-7a8e-4871-930f-4f82d6c05797 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:10.526439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8146d-2d92-4a55-bbb1-e885e6b4efea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:10.527034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8146d-2d92-4a55-bbb1-e885e6b4efea None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:10.527309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8146d-2d92-4a55-bbb1-e885e6b4efea None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:10.527607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8146d-2d92-4a55-bbb1-e885e6b4efea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:10.592196 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8146d-2d92-4a55-bbb1-e885e6b4efea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:10.593621 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8146d-2d92-4a55-bbb1-e885e6b4efea None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:10.680893 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:10.690948 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 644/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Sep 14 19:38:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 19:38:10.696938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f8f92-9f88-406b-b792-e1c73242ed8a None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:10.756172 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:10.795693 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f8f92-9f88-406b-b792-e1c73242ed8a None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:10.827257 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204abace-04f6-4575-ae38-8254078f8354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:10.827896 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204abace-04f6-4575-ae38-8254078f8354 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:10.828166 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204abace-04f6-4575-ae38-8254078f8354 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:10.828432 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204abace-04f6-4575-ae38-8254078f8354 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:10.839377 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204abace-04f6-4575-ae38-8254078f8354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:10.840842 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204abace-04f6-4575-ae38-8254078f8354 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:10.856274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-204abace-04f6-4575-ae38-8254078f8354 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:38:10.856274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:38:10.856274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:38:10.856274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:38:10.856274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:38:10.856274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:38:10.856274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:38:10.856274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:38:10.856274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:38:10.856274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:38:10.856274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:38:10.856274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:38:10.856274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 19:38:10.856274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 19:38:10.856274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 19:38:10.856274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 19:38:10.857338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:38:10.857338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:38:10.857338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:38:10.857338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:38:10.857338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:38:10.857338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:38:10.857338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:38:10.857338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:38:10.857338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:38:10.857338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:38:10.857338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:38:10.857338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:38:10.857338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:38:10.857338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:38:10.857338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:38:10.857338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:38:10.857338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 19:38:10.858227 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 19:38:10.858227 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 19:38:10.858227 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:38:10.858227 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 639/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:38:10.863142 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8146d-2d92-4a55-bbb1-e885e6b4efea None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:10.960872 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8146d-2d92-4a55-bbb1-e885e6b4efea None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:10.994171 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78520c-264f-4637-aa8a-d0a1e64c8d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:10.994777 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78520c-264f-4637-aa8a-d0a1e64c8d03 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:10.995054 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78520c-264f-4637-aa8a-d0a1e64c8d03 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:10.995326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78520c-264f-4637-aa8a-d0a1e64c8d03 None admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:10.996025 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78520c-264f-4637-aa8a-d0a1e64c8d03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:10.996327 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78520c-264f-4637-aa8a-d0a1e64c8d03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:10.997716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78520c-264f-4637-aa8a-d0a1e64c8d03 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:11.008955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 645/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Sep 14 19:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:38:11.014610 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204abace-04f6-4575-ae38-8254078f8354 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:11.124297 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204abace-04f6-4575-ae38-8254078f8354 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:11.138209 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:11.158352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6012bb-563f-418e-aded-94439fe257dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:11.158977 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6012bb-563f-418e-aded-94439fe257dc None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:11.159252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6012bb-563f-418e-aded-94439fe257dc None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:11.162786 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6012bb-563f-418e-aded-94439fe257dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:11.166637 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6012bb-563f-418e-aded-94439fe257dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:11.168096 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6012bb-563f-418e-aded-94439fe257dc None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:11.179455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application [None req-fe6012bb-563f-418e-aded-94439fe257dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:38:11.179455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:38:11.179455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:38:11.179455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:38:11.179455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:38:11.179455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:38:11.179455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:38:11.179455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:38:11.179455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:38:11.179455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:38:11.179455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:38:11.179455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:38:11.179455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 19:38:11.179455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 19:38:11.179455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 19:38:11.180556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 19:38:11.180556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:38:11.180556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:38:11.180556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:38:11.180556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:38:11.180556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:38:11.180556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:38:11.180556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:38:11.180556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application with Lock( Sep 14 19:38:11.180556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:38:11.180556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:38:11.180556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:38:11.180556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:38:11.180556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:38:11.180556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:38:11.180556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:38:11.180556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:38:11.181666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 19:38:11.181666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 19:38:11.181666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 19:38:11.181666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 19:38:11.181666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 19:38:11.181666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 19:38:11.181666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 19:38:11.181666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: ERROR keystone.server.flask.application Sep 14 19:38:11.181666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 640/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Sep 14 19:38:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:38:11.186702 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78520c-264f-4637-aa8a-d0a1e64c8d03 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:11.237175 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:11.285432 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78520c-264f-4637-aa8a-d0a1e64c8d03 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:11.316819 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cff50a-e59e-438a-8495-5e9d34f11785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:11.317419 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cff50a-e59e-438a-8495-5e9d34f11785 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:11.317693 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cff50a-e59e-438a-8495-5e9d34f11785 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:11.317961 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cff50a-e59e-438a-8495-5e9d34f11785 None admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:11.319204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cff50a-e59e-438a-8495-5e9d34f11785 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:11.319502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cff50a-e59e-438a-8495-5e9d34f11785 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:11.320939 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cff50a-e59e-438a-8495-5e9d34f11785 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:11.333432 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 646/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Sep 14 19:38:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:38:11.340168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6012bb-563f-418e-aded-94439fe257dc None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:11.441347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6012bb-563f-418e-aded-94439fe257dc None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:11.475457 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb5850-98c5-48cb-b92b-356ae39d2c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:11.476091 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb5850-98c5-48cb-b92b-356ae39d2c37 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:11.476370 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb5850-98c5-48cb-b92b-356ae39d2c37 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:11.476645 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb5850-98c5-48cb-b92b-356ae39d2c37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:11.477370 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb5850-98c5-48cb-b92b-356ae39d2c37 None admin] RBAC: Adding query filter params (role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a, scope.project.id=2e3e0c278ce94ce3a132496923eef365, user.id=6942a851a69b446e90a2b138f4482465) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:11.477706 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb5850-98c5-48cb-b92b-356ae39d2c37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:11.479144 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb5850-98c5-48cb-b92b-356ae39d2c37 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:11.484864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 641/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Sep 14 19:38:11 2022] GET /identity/v3/role_assignments?user.id=6942a851a69b446e90a2b138f4482465&scope.project.id=2e3e0c278ce94ce3a132496923eef365&role.id=9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:38:13.643629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768a5fe-dd37-441d-a67c-6e93bacef6c3 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:13.644167 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768a5fe-dd37-441d-a67c-6e93bacef6c3 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:13.644167 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768a5fe-dd37-441d-a67c-6e93bacef6c3 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:13.645479 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 647/1288] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:38:13.650989 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c673612-065e-47be-90c2-705f6f4c7c59 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:13.651413 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c673612-065e-47be-90c2-705f6f4c7c59 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:13.651562 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c673612-065e-47be-90c2-705f6f4c7c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:13.670468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-9c673612-065e-47be-90c2-705f6f4c7c59 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:38:13.671684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-9c673612-065e-47be-90c2-705f6f4c7c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:38:13.701011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:13.737668 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 642/1289] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:38:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:38:14.012106 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768a5fe-dd37-441d-a67c-6e93bacef6c3 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:14.112464 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768a5fe-dd37-441d-a67c-6e93bacef6c3 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:14.122673 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:14.145650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144a153-8e81-4040-9fec-169982dee71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:14.146268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144a153-8e81-4040-9fec-169982dee71d None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:14.146541 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144a153-8e81-4040-9fec-169982dee71d None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:14.146806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144a153-8e81-4040-9fec-169982dee71d None admin] PATH_INFO: `/v3/services/placement` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:14.147377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144a153-8e81-4040-9fec-169982dee71d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:14.148757 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144a153-8e81-4040-9fec-169982dee71d None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:14.158361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-d144a153-8e81-4040-9fec-169982dee71d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 19:38:14.158361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:38:14.158361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:38:14.158361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:38:14.158361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:38:14.158361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:38:14.158361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:38:14.158361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:38:14.158361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 19:38:14.158361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:38:14.158361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:38:14.158361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:38:14.158361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:38:14.158361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:38:14.158361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:38:14.158361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:38:14.158361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:38:14.159585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:38:14.159585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:38:14.159585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:38:14.159585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:38:14.159585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:38:14.159585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:38:14.159585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:38:14.159585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:38:14.159585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:38:14.159585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:38:14.159585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:38:14.159585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:38:14.159585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:38:14.159585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:38:14.159585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:38:14.159585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:38:14.160793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:38:14.160793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:38:14.160793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:38:14.160793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:38:14.160793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:38:14.160793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:38:14.160793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:38:14.160793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:38:14.160793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:38:14.160793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:38:14.160793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:38:14.160793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:38:14.160793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 19:38:14.160793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:38:14.160793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 648/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Sep 14 19:38:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:38:14.165674 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c673612-065e-47be-90c2-705f6f4c7c59 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:14.263242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c673612-065e-47be-90c2-705f6f4c7c59 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:14.296725 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f585a-1f10-4f10-b00a-6baa0ed65f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:14.297328 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f585a-1f10-4f10-b00a-6baa0ed65f4a None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:14.297609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f585a-1f10-4f10-b00a-6baa0ed65f4a None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:14.297887 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f585a-1f10-4f10-b00a-6baa0ed65f4a None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:14.298515 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f585a-1f10-4f10-b00a-6baa0ed65f4a None admin] RBAC: Adding query filter params (name=placement) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:14.298817 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f585a-1f10-4f10-b00a-6baa0ed65f4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:14.300209 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f585a-1f10-4f10-b00a-6baa0ed65f4a None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:14.305022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 643/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Wed Sep 14 19:38:14 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:38:14.311013 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144a153-8e81-4040-9fec-169982dee71d None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:14.410358 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144a153-8e81-4040-9fec-169982dee71d None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:14.442923 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a764e-3adb-4e94-b409-42d653456af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:14.443521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a764e-3adb-4e94-b409-42d653456af0 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:14.443826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a764e-3adb-4e94-b409-42d653456af0 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:14.444092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a764e-3adb-4e94-b409-42d653456af0 None admin] PATH_INFO: `/v3/services` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:14.444753 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a764e-3adb-4e94-b409-42d653456af0 None admin] RBAC: Adding query filter params (type=placement) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:14.445057 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a764e-3adb-4e94-b409-42d653456af0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:14.446439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a764e-3adb-4e94-b409-42d653456af0 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:14.450879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 649/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Wed Sep 14 19:38:14 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:38:16.568591 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66cab2-05ed-4af8-9c81-b9da922ed421 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:16.569143 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66cab2-05ed-4af8-9c81-b9da922ed421 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:16.569143 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66cab2-05ed-4af8-9c81-b9da922ed421 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:16.570489 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 644/1293] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:38:16.575698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b489b-9737-41ca-9dd1-f2fa755e900e None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:16.576117 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b489b-9737-41ca-9dd1-f2fa755e900e None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:16.576240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b489b-9737-41ca-9dd1-f2fa755e900e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:16.601710 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-535b489b-9737-41ca-9dd1-f2fa755e900e None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:38:16.602907 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-535b489b-9737-41ca-9dd1-f2fa755e900e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:38:16.632771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:16.668928 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 650/1294] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:38:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:38:16.934631 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66cab2-05ed-4af8-9c81-b9da922ed421 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:16.965107 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:17.033102 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66cab2-05ed-4af8-9c81-b9da922ed421 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:17.067335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560979a-2af5-44c6-8810-cac96a40240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:17.067961 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560979a-2af5-44c6-8810-cac96a40240f None admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:17.068234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560979a-2af5-44c6-8810-cac96a40240f None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:17.068501 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560979a-2af5-44c6-8810-cac96a40240f None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:17.069140 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560979a-2af5-44c6-8810-cac96a40240f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:17.070490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560979a-2af5-44c6-8810-cac96a40240f None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:17.179921 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 645/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Sep 14 19:38:16 2022] POST /identity/v3/services => generated 246 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:38:19.363244 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e579c-47cb-4759-a061-d0870e0679ab None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:19.363873 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e579c-47cb-4759-a061-d0870e0679ab None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:19.363873 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e579c-47cb-4759-a061-d0870e0679ab None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:19.365151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 651/1296] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:38:19.370541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead99323-8560-4fe8-a077-5a8f325bc333 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:19.370940 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead99323-8560-4fe8-a077-5a8f325bc333 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:19.371490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead99323-8560-4fe8-a077-5a8f325bc333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:19.390043 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-ead99323-8560-4fe8-a077-5a8f325bc333 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:38:19.391266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ead99323-8560-4fe8-a077-5a8f325bc333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:38:19.461954 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 646/1297] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:38:19 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:38:19.725973 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e579c-47cb-4759-a061-d0870e0679ab None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:19.826807 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e579c-47cb-4759-a061-d0870e0679ab None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:19.861373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b0680-25e1-4e72-8d91-d097e6cc31b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:19.861999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b0680-25e1-4e72-8d91-d097e6cc31b5 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:19.862276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b0680-25e1-4e72-8d91-d097e6cc31b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:19.862547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b0680-25e1-4e72-8d91-d097e6cc31b5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:19.863125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b0680-25e1-4e72-8d91-d097e6cc31b5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:19.864502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b0680-25e1-4e72-8d91-d097e6cc31b5 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:19.873219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-433b0680-25e1-4e72-8d91-d097e6cc31b5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 19:38:19.873219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:38:19.873219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:38:19.873219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:38:19.873219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:38:19.873219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:38:19.873219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:38:19.873219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:38:19.873219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 19:38:19.873219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:38:19.873219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:38:19.873219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:38:19.873219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:38:19.873219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:38:19.873219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:38:19.873219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:38:19.873219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:38:19.876091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:38:19.876091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:38:19.876091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:38:19.876091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:38:19.876091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:38:19.876091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:38:19.876091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:38:19.876091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:38:19.876091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:38:19.876091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:38:19.876091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:38:19.876091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:38:19.876091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:38:19.876091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:38:19.876091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:38:19.876091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:38:19.877301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:38:19.877301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:38:19.877301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:38:19.877301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:38:19.877301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:38:19.877301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:38:19.877301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:38:19.877301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:38:19.877301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:38:19.877301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:38:19.877301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:38:19.877301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:38:19.877301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 19:38:19.877301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:38:19.877301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 652/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Sep 14 19:38:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:38:19.880789 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead99323-8560-4fe8-a077-5a8f325bc333 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:19.898598 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:19.977567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead99323-8560-4fe8-a077-5a8f325bc333 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:20.011112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021624a-1915-499a-926f-418de6c21fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:20.011748 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021624a-1915-499a-926f-418de6c21fa1 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:20.012027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021624a-1915-499a-926f-418de6c21fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:20.012300 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021624a-1915-499a-926f-418de6c21fa1 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:20.016436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021624a-1915-499a-926f-418de6c21fa1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:20.016436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021624a-1915-499a-926f-418de6c21fa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:20.016436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021624a-1915-499a-926f-418de6c21fa1 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:20.019609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 647/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Wed Sep 14 19:38:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:38:20.025685 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b0680-25e1-4e72-8d91-d097e6cc31b5 None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:20.057087 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:20.125644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b0680-25e1-4e72-8d91-d097e6cc31b5 None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:20.159414 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dac2ae-b602-4219-b731-6b40a6cc9db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:20.160055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dac2ae-b602-4219-b731-6b40a6cc9db8 None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:20.160340 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dac2ae-b602-4219-b731-6b40a6cc9db8 None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:20.160613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dac2ae-b602-4219-b731-6b40a6cc9db8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:20.161305 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dac2ae-b602-4219-b731-6b40a6cc9db8 None admin] RBAC: Adding query filter params (interface=public, service_id=544a594938ac4dde938b837b047ac7ea, region_id=RegionOne) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:20.161616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dac2ae-b602-4219-b731-6b40a6cc9db8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:20.162967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dac2ae-b602-4219-b731-6b40a6cc9db8 None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:20.167968 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 653/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Sep 14 19:38:20 2022] GET /identity/v3/endpoints?service_id=544a594938ac4dde938b837b047ac7ea&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:38:20.174762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021624a-1915-499a-926f-418de6c21fa1 None admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:20.256334 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:20.273996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021624a-1915-499a-926f-418de6c21fa1 None admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:20.308413 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a627d1-d07e-455f-b72f-ecd259588ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:20.309049 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a627d1-d07e-455f-b72f-ecd259588ec7 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:20.315555 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a627d1-d07e-455f-b72f-ecd259588ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:20.315555 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a627d1-d07e-455f-b72f-ecd259588ec7 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:20.315555 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a627d1-d07e-455f-b72f-ecd259588ec7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:20.315555 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a627d1-d07e-455f-b72f-ecd259588ec7 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:20.318531 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 648/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Sep 14 19:38:20 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:38:22.477571 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d2afb-1ae4-45fa-be6e-769132723cc6 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:22.478097 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d2afb-1ae4-45fa-be6e-769132723cc6 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:22.478097 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d2afb-1ae4-45fa-be6e-769132723cc6 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:22.479447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 654/1302] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:38:22.484568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a90e5d-947a-47de-9207-49ec7a3117a2 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:22.485009 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a90e5d-947a-47de-9207-49ec7a3117a2 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:22.485117 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a90e5d-947a-47de-9207-49ec7a3117a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:22.503639 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-d3a90e5d-947a-47de-9207-49ec7a3117a2 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:38:22.504809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d3a90e5d-947a-47de-9207-49ec7a3117a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:38:22.571534 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 649/1303] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:38:22 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 19:38:22.843322 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d2afb-1ae4-45fa-be6e-769132723cc6 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:22.941533 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:22.948027 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d2afb-1ae4-45fa-be6e-769132723cc6 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:22.982469 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602822f-19c1-429c-a1f6-54ef311a434a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:22.983836 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602822f-19c1-429c-a1f6-54ef311a434a None admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:22.984113 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602822f-19c1-429c-a1f6-54ef311a434a None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:22.984379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602822f-19c1-429c-a1f6-54ef311a434a None admin] PATH_INFO: `/v3/services/placement` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:22.984955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602822f-19c1-429c-a1f6-54ef311a434a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:22.986300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602822f-19c1-429c-a1f6-54ef311a434a None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:22.995391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application [None req-2602822f-19c1-429c-a1f6-54ef311a434a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 19:38:22.995391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:38:22.995391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 19:38:22.995391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 19:38:22.995391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 19:38:22.995391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 19:38:22.995391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 19:38:22.995391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:38:22.995391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 19:38:22.995391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:38:22.995391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 19:38:22.995391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:38:22.995391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 19:38:22.995391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 19:38:22.995391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 19:38:22.995391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 19:38:22.995391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 19:38:22.996671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 19:38:22.996671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 19:38:22.996671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 19:38:22.996671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 19:38:22.996671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 19:38:22.996671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 19:38:22.996671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 19:38:22.996671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 19:38:22.996671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 19:38:22.996671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 19:38:22.996671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 19:38:22.996671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 19:38:22.996671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 19:38:22.996671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 19:38:22.996671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 19:38:22.996671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 19:38:22.997904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 19:38:22.997904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application with Lock( Sep 14 19:38:22.997904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 19:38:22.997904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self._enter() Sep 14 19:38:22.997904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 19:38:22.997904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 19:38:22.997904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 19:38:22.997904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application return self.creator() Sep 14 19:38:22.997904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 19:38:22.997904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application created_value = creator( Sep 14 19:38:22.997904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 19:38:22.997904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 19:38:22.997904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 19:38:22.997904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: ERROR keystone.server.flask.application Sep 14 19:38:22.997904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 655/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Sep 14 19:38:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 19:38:23.004560 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a90e5d-947a-47de-9207-49ec7a3117a2 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:23.082681 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:23.113801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a90e5d-947a-47de-9207-49ec7a3117a2 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:23.149969 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6206f9-bf96-4325-aa00-7f715a8293a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:23.150824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6206f9-bf96-4325-aa00-7f715a8293a5 None admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:23.150824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6206f9-bf96-4325-aa00-7f715a8293a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:23.151088 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6206f9-bf96-4325-aa00-7f715a8293a5 None admin] PATH_INFO: `/v3/services` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:23.151742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6206f9-bf96-4325-aa00-7f715a8293a5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:38:23.152171 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6206f9-bf96-4325-aa00-7f715a8293a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:23.153651 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6206f9-bf96-4325-aa00-7f715a8293a5 None admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:23.159221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 650/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Wed Sep 14 19:38:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:38:23.165055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602822f-19c1-429c-a1f6-54ef311a434a None admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:38:23.270114 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602822f-19c1-429c-a1f6-54ef311a434a None admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:38:23.304622 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d192a-f551-40a3-b469-cfcd1a6a222e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:38:23.305218 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d192a-f551-40a3-b469-cfcd1a6a222e None admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:38:23.305492 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d192a-f551-40a3-b469-cfcd1a6a222e None admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:38:23.305758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d192a-f551-40a3-b469-cfcd1a6a222e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:38:23.306423 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d192a-f551-40a3-b469-cfcd1a6a222e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:38:23.307799 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d192a-f551-40a3-b469-cfcd1a6a222e None admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:38:23.426716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 656/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:38:23 2022] POST /identity/v3/endpoints => generated 331 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:38:33.231623 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=30 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:38:33.422075 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:45:59.308223 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bb1fe-3592-40e0-8e94-669b31254bef None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:45:59.308753 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bb1fe-3592-40e0-8e94-669b31254bef None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:45:59.308753 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bb1fe-3592-40e0-8e94-669b31254bef None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:45:59.310609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 651/1307] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:45:59.316001 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a229c2-0a95-43c3-b60c-5c5d93261e82 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:45:59.316452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a229c2-0a95-43c3-b60c-5c5d93261e82 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:45:59.316669 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a229c2-0a95-43c3-b60c-5c5d93261e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:45:59.470841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-e2a229c2-0a95-43c3-b60c-5c5d93261e82 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:45:59.472346 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-e2a229c2-0a95-43c3-b60c-5c5d93261e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:45:59.594123 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 657/1308] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:45:59.892873 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a781f9f-bbe9-4f34-83dc-8aa761db781b None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:45:59.893254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a781f9f-bbe9-4f34-83dc-8aa761db781b None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:45:59.893438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a781f9f-bbe9-4f34-83dc-8aa761db781b None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:45:59.894901 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 652/1309] 10.222.0.15 () {54 vars in 965 bytes} [Wed Sep 14 19:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:45:59.901304 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a7a7c-7618-4603-8267-06cfa68f08ab None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:45:59.901694 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a7a7c-7618-4603-8267-06cfa68f08ab None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:45:59.902048 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a7a7c-7618-4603-8267-06cfa68f08ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:45:59.989234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-593a7a7c-7618-4603-8267-06cfa68f08ab None None] MFA Rules not processed for user `221300017882415ca3a7c9192343b956`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:45:59.990760 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-593a7a7c-7618-4603-8267-06cfa68f08ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:00.013477 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:00.080675 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 658/1310] 10.222.0.15 () {58 vars in 1062 bytes} [Wed Sep 14 19:45:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:46:00.091138 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a781f9f-bbe9-4f34-83dc-8aa761db781b None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:46:00.093404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0a781f9f-bbe9-4f34-83dc-8aa761db781b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:00.220402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a781f9f-bbe9-4f34-83dc-8aa761db781b None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:46:00.301204 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ca13f-ed9d-43ff-bfa6-12754bebc8d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:46:00.301818 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ca13f-ed9d-43ff-bfa6-12754bebc8d0 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:00.302094 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ca13f-ed9d-43ff-bfa6-12754bebc8d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:00.302360 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ca13f-ed9d-43ff-bfa6-12754bebc8d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:00.304670 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-922ca13f-ed9d-43ff-bfa6-12754bebc8d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:00.363506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:00.427452 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ca13f-ed9d-43ff-bfa6-12754bebc8d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:46:00.428935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ca13f-ed9d-43ff-bfa6-12754bebc8d0 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:46:00.449683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 653/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:46:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:46:02.905338 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030e662-13f8-404e-8026-750ed8036168 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:02.905869 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030e662-13f8-404e-8026-750ed8036168 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:02.905869 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030e662-13f8-404e-8026-750ed8036168 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:02.907240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 659/1312] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:46:02.912718 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369139a2-a88c-49a5-8de3-6c3c1f52f7dc None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:02.913149 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369139a2-a88c-49a5-8de3-6c3c1f52f7dc None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:02.913400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369139a2-a88c-49a5-8de3-6c3c1f52f7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:02.988096 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-369139a2-a88c-49a5-8de3-6c3c1f52f7dc None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:46:02.989283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-369139a2-a88c-49a5-8de3-6c3c1f52f7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:03.086449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 654/1313] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:46:03.390711 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27e60e-ceba-41e9-9cd1-de46228bcf9a None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:03.391059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27e60e-ceba-41e9-9cd1-de46228bcf9a None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:03.391338 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27e60e-ceba-41e9-9cd1-de46228bcf9a None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:03.392745 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 660/1314] 10.222.0.15 () {54 vars in 965 bytes} [Wed Sep 14 19:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:46:03.398743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842489b-3c07-4375-813e-3ba1570026db None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:03.399032 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842489b-3c07-4375-813e-3ba1570026db None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:03.399304 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842489b-3c07-4375-813e-3ba1570026db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:03.411350 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:03.486644 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-2842489b-3c07-4375-813e-3ba1570026db None None] MFA Rules not processed for user `221300017882415ca3a7c9192343b956`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:46:03.487914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-2842489b-3c07-4375-813e-3ba1570026db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:03.569123 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 655/1315] 10.222.0.15 () {58 vars in 1062 bytes} [Wed Sep 14 19:46:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:46:03.578337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27e60e-ceba-41e9-9cd1-de46228bcf9a None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:46:03.579942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2b27e60e-ceba-41e9-9cd1-de46228bcf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:03.689603 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27e60e-ceba-41e9-9cd1-de46228bcf9a None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:46:03.760512 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:03.762841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7712698-1329-4bb9-a3b8-daad25c0320e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:46:03.763451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7712698-1329-4bb9-a3b8-daad25c0320e service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:03.763755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7712698-1329-4bb9-a3b8-daad25c0320e service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:03.764027 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7712698-1329-4bb9-a3b8-daad25c0320e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:03.765601 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-e7712698-1329-4bb9-a3b8-daad25c0320e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:03.876238 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7712698-1329-4bb9-a3b8-daad25c0320e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:46:03.877691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7712698-1329-4bb9-a3b8-daad25c0320e service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:46:03.895651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 661/1316] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:46:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:46:06.845054 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9578a-4ccd-4cd7-b0a8-af508ffab52d None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:06.845550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9578a-4ccd-4cd7-b0a8-af508ffab52d None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:06.845649 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9578a-4ccd-4cd7-b0a8-af508ffab52d None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:06.847210 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 656/1317] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:46:06.852515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24e3f3-d092-48c0-9513-ba56d8154a17 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:06.853685 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24e3f3-d092-48c0-9513-ba56d8154a17 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:06.853792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24e3f3-d092-48c0-9513-ba56d8154a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:06.918353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-ea24e3f3-d092-48c0-9513-ba56d8154a17 None None] MFA Rules not processed for user `8fbbf46ece0240fd9bd840b4ccefeeaf`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:46:06.919567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ea24e3f3-d092-48c0-9513-ba56d8154a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:06.969920 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:07.015246 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 662/1318] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:46:06 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:46:07.301352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9578a-4ccd-4cd7-b0a8-af508ffab52d None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:46:07.302870 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-80b9578a-4ccd-4cd7-b0a8-af508ffab52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:07.407189 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9578a-4ccd-4cd7-b0a8-af508ffab52d None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:46:07.409972 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:07.480188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa029224-b0ef-4ea1-a1a1-aed623689367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:46:07.480794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa029224-b0ef-4ea1-a1a1-aed623689367 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:07.481067 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa029224-b0ef-4ea1-a1a1-aed623689367 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:07.481334 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa029224-b0ef-4ea1-a1a1-aed623689367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:07.482906 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-aa029224-b0ef-4ea1-a1a1-aed623689367 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:07.592504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa029224-b0ef-4ea1-a1a1-aed623689367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:46:07.593943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa029224-b0ef-4ea1-a1a1-aed623689367 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:46:07.613376 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 657/1319] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:46:07 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:46:10.698487 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253d2c7-c937-4dc1-b57b-1d915e2c2fb6 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:10.699446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253d2c7-c937-4dc1-b57b-1d915e2c2fb6 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:10.699759 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253d2c7-c937-4dc1-b57b-1d915e2c2fb6 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:10.701164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 663/1320] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:46:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:46:10.706761 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541229bd-85cc-447b-ad01-a2dd5f5e82b0 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:10.708012 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541229bd-85cc-447b-ad01-a2dd5f5e82b0 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:10.708012 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541229bd-85cc-447b-ad01-a2dd5f5e82b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:10.755014 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:10.783759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-541229bd-85cc-447b-ad01-a2dd5f5e82b0 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:46:10.784981 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-541229bd-85cc-447b-ad01-a2dd5f5e82b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:10.889299 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 658/1321] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:46:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:46:11.182424 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253d2c7-c937-4dc1-b57b-1d915e2c2fb6 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:46:11.183992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-8253d2c7-c937-4dc1-b57b-1d915e2c2fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:11.284379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253d2c7-c937-4dc1-b57b-1d915e2c2fb6 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:46:11.355691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b30a37-c611-4bc3-b30d-502e01ce6e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:46:11.356296 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b30a37-c611-4bc3-b30d-502e01ce6e4d service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:11.356569 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b30a37-c611-4bc3-b30d-502e01ce6e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:11.356835 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b30a37-c611-4bc3-b30d-502e01ce6e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:11.358402 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-08b30a37-c611-4bc3-b30d-502e01ce6e4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:11.365182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:11.471685 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b30a37-c611-4bc3-b30d-502e01ce6e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:46:11.473321 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b30a37-c611-4bc3-b30d-502e01ce6e4d service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:46:11.491048 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 664/1322] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:46:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:46:14.681121 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62ed08-dbfa-4125-bba5-94135d0d55e3 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:14.681633 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62ed08-dbfa-4125-bba5-94135d0d55e3 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:14.681633 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62ed08-dbfa-4125-bba5-94135d0d55e3 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:14.682927 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 659/1323] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:46:14.688468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a6c77-bdbe-443c-b641-edbb62e4b12d None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:14.688993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a6c77-bdbe-443c-b641-edbb62e4b12d None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:14.689089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a6c77-bdbe-443c-b641-edbb62e4b12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:14.755062 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-8d6a6c77-bdbe-443c-b641-edbb62e4b12d None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:46:14.756321 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-8d6a6c77-bdbe-443c-b641-edbb62e4b12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:14.820830 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:14.864391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 665/1324] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:46:15.157574 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62ed08-dbfa-4125-bba5-94135d0d55e3 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:46:15.159183 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1f62ed08-dbfa-4125-bba5-94135d0d55e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:15.268158 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62ed08-dbfa-4125-bba5-94135d0d55e3 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:46:15.281749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:15.345434 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f091f5a-a94c-4260-ad7f-b6deaf98f5a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:46:15.346057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f091f5a-a94c-4260-ad7f-b6deaf98f5a6 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:15.346335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f091f5a-a94c-4260-ad7f-b6deaf98f5a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:15.346607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f091f5a-a94c-4260-ad7f-b6deaf98f5a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:15.348527 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-2f091f5a-a94c-4260-ad7f-b6deaf98f5a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:15.472393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f091f5a-a94c-4260-ad7f-b6deaf98f5a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:46:15.473824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f091f5a-a94c-4260-ad7f-b6deaf98f5a6 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:46:15.491874 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 660/1325] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:46:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:46:17.722064 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0c758-b0da-4ebc-9a5a-17dc2b616c31 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:17.722844 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0c758-b0da-4ebc-9a5a-17dc2b616c31 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:17.722844 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0c758-b0da-4ebc-9a5a-17dc2b616c31 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:17.724175 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 666/1326] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:46:17.729833 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e0ae3-7b55-4600-adf1-435258c1f511 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:17.731081 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e0ae3-7b55-4600-adf1-435258c1f511 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:17.731081 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e0ae3-7b55-4600-adf1-435258c1f511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:17.782445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:17.800444 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-c67e0ae3-7b55-4600-adf1-435258c1f511 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:46:17.801643 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-c67e0ae3-7b55-4600-adf1-435258c1f511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:17.912065 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 661/1327] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:46:18.198394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0c758-b0da-4ebc-9a5a-17dc2b616c31 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:46:18.200044 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-95a0c758-b0da-4ebc-9a5a-17dc2b616c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:18.302194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0c758-b0da-4ebc-9a5a-17dc2b616c31 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:46:18.384447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b52380-d879-4e5e-b69e-6de128a64d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:46:18.385077 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b52380-d879-4e5e-b69e-6de128a64d41 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:18.385358 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b52380-d879-4e5e-b69e-6de128a64d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:18.385758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b52380-d879-4e5e-b69e-6de128a64d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:18.387363 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-70b52380-d879-4e5e-b69e-6de128a64d41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:18.404439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:18.498789 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b52380-d879-4e5e-b69e-6de128a64d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:46:18.500191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b52380-d879-4e5e-b69e-6de128a64d41 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:46:18.518817 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 667/1328] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:46:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:46:20.840409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695c13c-8732-4668-b25f-3270dbd1eccf None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:20.841518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695c13c-8732-4668-b25f-3270dbd1eccf None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:20.841794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695c13c-8732-4668-b25f-3270dbd1eccf None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:20.843684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 662/1329] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:46:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:46:20.849209 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40134e51-5d5f-47f9-9129-8e26fbb970af None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:20.849649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40134e51-5d5f-47f9-9129-8e26fbb970af None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:20.849762 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40134e51-5d5f-47f9-9129-8e26fbb970af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:20.924928 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-40134e51-5d5f-47f9-9129-8e26fbb970af None None] MFA Rules not processed for user `8fbbf46ece0240fd9bd840b4ccefeeaf`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:46:20.926151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-40134e51-5d5f-47f9-9129-8e26fbb970af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:20.995967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:21.029463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 668/1330] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:46:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:46:21.318397 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695c13c-8732-4668-b25f-3270dbd1eccf None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:46:21.320096 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d695c13c-8732-4668-b25f-3270dbd1eccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:21.432527 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695c13c-8732-4668-b25f-3270dbd1eccf None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:46:21.452632 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:21.507555 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d308bd-489d-4727-9757-25808b9d8b7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:46:21.508174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d308bd-489d-4727-9757-25808b9d8b7f service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:21.508452 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d308bd-489d-4727-9757-25808b9d8b7f service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:21.508778 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d308bd-489d-4727-9757-25808b9d8b7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:21.510543 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-30d308bd-489d-4727-9757-25808b9d8b7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:21.620910 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d308bd-489d-4727-9757-25808b9d8b7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:46:21.622281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d308bd-489d-4727-9757-25808b9d8b7f service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:46:21.640630 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 663/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:46:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:46:24.250776 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c60dcb-9ffa-4e8e-895c-a13be0ffe9c6 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:24.251348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c60dcb-9ffa-4e8e-895c-a13be0ffe9c6 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:24.251348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c60dcb-9ffa-4e8e-895c-a13be0ffe9c6 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:24.252727 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 669/1332] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:46:24.257954 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728351b-0d92-4576-beec-d41916ba5489 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:24.258351 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728351b-0d92-4576-beec-d41916ba5489 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:24.258502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728351b-0d92-4576-beec-d41916ba5489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:24.320928 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:24.323740 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-6728351b-0d92-4576-beec-d41916ba5489 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:46:24.324926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-6728351b-0d92-4576-beec-d41916ba5489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:24.423195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 664/1333] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:46:24.706490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c60dcb-9ffa-4e8e-895c-a13be0ffe9c6 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:46:24.708084 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-39c60dcb-9ffa-4e8e-895c-a13be0ffe9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:24.810683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c60dcb-9ffa-4e8e-895c-a13be0ffe9c6 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:46:24.882021 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54826528-f79e-4128-a859-8f00a79e8f5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:46:24.882627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54826528-f79e-4128-a859-8f00a79e8f5a service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:24.882905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54826528-f79e-4128-a859-8f00a79e8f5a service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:24.883176 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54826528-f79e-4128-a859-8f00a79e8f5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:24.884800 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-54826528-f79e-4128-a859-8f00a79e8f5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:24.910856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:24.991272 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54826528-f79e-4128-a859-8f00a79e8f5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:46:24.992907 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54826528-f79e-4128-a859-8f00a79e8f5a service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:46:25.011580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 670/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:46:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:46:27.212972 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7732a4-c724-45ac-bffe-5bc128ad8d13 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:27.213537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7732a4-c724-45ac-bffe-5bc128ad8d13 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:27.213537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7732a4-c724-45ac-bffe-5bc128ad8d13 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:27.214846 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 665/1335] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:46:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:46:27.220039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad0e9f-dae1-4179-b6e6-46dd981745e8 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:27.220464 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad0e9f-dae1-4179-b6e6-46dd981745e8 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:27.220603 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad0e9f-dae1-4179-b6e6-46dd981745e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:27.287680 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-52ad0e9f-dae1-4179-b6e6-46dd981745e8 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:46:27.288891 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-52ad0e9f-dae1-4179-b6e6-46dd981745e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:27.361907 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:27.384242 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 671/1336] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:46:27.669550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7732a4-c724-45ac-bffe-5bc128ad8d13 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:46:27.671107 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ed7732a4-c724-45ac-bffe-5bc128ad8d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:27.774015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7732a4-c724-45ac-bffe-5bc128ad8d13 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:46:27.807383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:27.856257 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279fdb8-8706-4ceb-8b0f-4d73e541d899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:46:27.856875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279fdb8-8706-4ceb-8b0f-4d73e541d899 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:27.857153 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279fdb8-8706-4ceb-8b0f-4d73e541d899 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:27.857422 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279fdb8-8706-4ceb-8b0f-4d73e541d899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:27.859058 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d279fdb8-8706-4ceb-8b0f-4d73e541d899 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:27.966581 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279fdb8-8706-4ceb-8b0f-4d73e541d899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:46:27.967984 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279fdb8-8706-4ceb-8b0f-4d73e541d899 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:46:27.986351 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 666/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:46:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:46:30.785822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15306312-f36a-4a4f-bdae-39162d165779 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:30.786334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15306312-f36a-4a4f-bdae-39162d165779 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:30.786334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15306312-f36a-4a4f-bdae-39162d165779 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:30.787690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 672/1338] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:46:30.792836 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c6024-6a7a-4c73-85a1-f7c2be4600da None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:30.793899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c6024-6a7a-4c73-85a1-f7c2be4600da None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:30.793899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c6024-6a7a-4c73-85a1-f7c2be4600da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:30.859741 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-e13c6024-6a7a-4c73-85a1-f7c2be4600da None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:46:30.860948 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e13c6024-6a7a-4c73-85a1-f7c2be4600da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:30.869854 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:30.961435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 667/1339] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:46:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:46:31.247829 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15306312-f36a-4a4f-bdae-39162d165779 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:46:31.249439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-15306312-f36a-4a4f-bdae-39162d165779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:31.351760 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15306312-f36a-4a4f-bdae-39162d165779 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:46:31.425165 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff70e7c-9385-48c1-b5b6-64c93d1a40f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:46:31.425777 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff70e7c-9385-48c1-b5b6-64c93d1a40f7 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:31.426053 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff70e7c-9385-48c1-b5b6-64c93d1a40f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:31.426319 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff70e7c-9385-48c1-b5b6-64c93d1a40f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:31.427924 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-bff70e7c-9385-48c1-b5b6-64c93d1a40f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:31.463091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:31.534414 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff70e7c-9385-48c1-b5b6-64c93d1a40f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:46:31.535789 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff70e7c-9385-48c1-b5b6-64c93d1a40f7 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:46:31.554379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 673/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:46:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:46:36.277736 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f324db9-594a-4037-946d-f91a6f72f3f3 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:36.278252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f324db9-594a-4037-946d-f91a6f72f3f3 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:36.278252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f324db9-594a-4037-946d-f91a6f72f3f3 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:36.279585 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 668/1341] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:46:36.285218 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d905c-e37e-4503-858a-75a3409107c9 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:36.285612 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d905c-e37e-4503-858a-75a3409107c9 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:36.285889 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d905c-e37e-4503-858a-75a3409107c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:36.358727 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-ae3d905c-e37e-4503-858a-75a3409107c9 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:46:36.359428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ae3d905c-e37e-4503-858a-75a3409107c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:36.449886 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:36.460984 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 674/1342] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:46:36.768638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f324db9-594a-4037-946d-f91a6f72f3f3 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:46:36.771974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-5f324db9-594a-4037-946d-f91a6f72f3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:36.889807 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f324db9-594a-4037-946d-f91a6f72f3f3 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:46:36.934802 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:36.971317 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3710986-25a4-4eab-8c8e-657c8c59d702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:46:36.971960 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3710986-25a4-4eab-8c8e-657c8c59d702 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:36.972233 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3710986-25a4-4eab-8c8e-657c8c59d702 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:36.972499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3710986-25a4-4eab-8c8e-657c8c59d702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:36.974332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-a3710986-25a4-4eab-8c8e-657c8c59d702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:37.084238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3710986-25a4-4eab-8c8e-657c8c59d702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:46:37.085584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3710986-25a4-4eab-8c8e-657c8c59d702 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:46:37.104411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 669/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:46:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:46:40.212456 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f6dfd-7b5b-40bf-b3c9-712462ac48d8 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:40.213048 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f6dfd-7b5b-40bf-b3c9-712462ac48d8 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:40.213152 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f6dfd-7b5b-40bf-b3c9-712462ac48d8 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:40.214476 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 675/1344] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:46:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:46:40.219674 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172fe68-250b-49c4-bf16-fb4df198aacf None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:40.220111 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172fe68-250b-49c4-bf16-fb4df198aacf None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:40.220220 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172fe68-250b-49c4-bf16-fb4df198aacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:40.286531 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-d172fe68-250b-49c4-bf16-fb4df198aacf None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:46:40.287751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d172fe68-250b-49c4-bf16-fb4df198aacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:40.306860 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:40.388502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 670/1345] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:46:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:46:40.671860 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f6dfd-7b5b-40bf-b3c9-712462ac48d8 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:46:40.673466 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a65f6dfd-7b5b-40bf-b3c9-712462ac48d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:40.784363 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f6dfd-7b5b-40bf-b3c9-712462ac48d8 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:46:40.857634 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939a5d3-6e0f-4d8f-8490-a86b56bcbf04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:46:40.858249 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939a5d3-6e0f-4d8f-8490-a86b56bcbf04 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:40.858524 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939a5d3-6e0f-4d8f-8490-a86b56bcbf04 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:40.858796 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939a5d3-6e0f-4d8f-8490-a86b56bcbf04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:40.860404 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-1939a5d3-6e0f-4d8f-8490-a86b56bcbf04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:40.903005 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:40.976053 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939a5d3-6e0f-4d8f-8490-a86b56bcbf04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:46:40.977565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939a5d3-6e0f-4d8f-8490-a86b56bcbf04 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:46:40.996343 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 676/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:46:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:46:45.370760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd60fa-a186-43f2-8104-564ccf0dc39e None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:45.371315 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd60fa-a186-43f2-8104-564ccf0dc39e None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:45.371590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd60fa-a186-43f2-8104-564ccf0dc39e None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:45.373152 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 671/1347] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:46:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:46:45.379129 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cad885-9e43-4b2a-a203-ef6cb24124fc None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:45.379644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cad885-9e43-4b2a-a203-ef6cb24124fc None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:45.379740 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cad885-9e43-4b2a-a203-ef6cb24124fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:45.453449 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-32cad885-9e43-4b2a-a203-ef6cb24124fc None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:46:45.454792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-32cad885-9e43-4b2a-a203-ef6cb24124fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:45.552754 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:45.554901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 677/1348] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:46:45.844359 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd60fa-a186-43f2-8104-564ccf0dc39e None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:46:45.845944 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-fbdd60fa-a186-43f2-8104-564ccf0dc39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:45.949059 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd60fa-a186-43f2-8104-564ccf0dc39e None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:46:45.997535 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:46.022720 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c4fbe-829f-41e0-9c9c-6e928d02708b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:46:46.023322 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c4fbe-829f-41e0-9c9c-6e928d02708b service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:46.023621 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c4fbe-829f-41e0-9c9c-6e928d02708b service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:46.023890 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c4fbe-829f-41e0-9c9c-6e928d02708b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:46.026137 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-956c4fbe-829f-41e0-9c9c-6e928d02708b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:46.132307 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c4fbe-829f-41e0-9c9c-6e928d02708b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:46:46.134247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c4fbe-829f-41e0-9c9c-6e928d02708b service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:46:46.152752 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 672/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:46:51.174651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f5a5f-6a9c-41da-bd0d-13158b86bd20 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:51.175108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f5a5f-6a9c-41da-bd0d-13158b86bd20 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:51.175203 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f5a5f-6a9c-41da-bd0d-13158b86bd20 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:51.177473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 678/1350] 10.222.0.15 () {54 vars in 921 bytes} [Wed Sep 14 19:46:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:46:51.183180 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81633439-0e26-4277-84d6-322971e1361d None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:51.183688 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81633439-0e26-4277-84d6-322971e1361d None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:51.183976 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81633439-0e26-4277-84d6-322971e1361d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:51.311784 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-81633439-0e26-4277-84d6-322971e1361d None None] MFA Rules not processed for user `6942a851a69b446e90a2b138f4482465`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:46:51.314082 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-81633439-0e26-4277-84d6-322971e1361d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:51.350017 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:51.478394 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 673/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Sep 14 19:46:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:46:55.740861 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dbb44-f8db-4d5c-abb2-d91b80c05d49 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:55.741371 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dbb44-f8db-4d5c-abb2-d91b80c05d49 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:55.741371 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dbb44-f8db-4d5c-abb2-d91b80c05d49 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:55.742808 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 679/1352] 10.222.0.15 () {54 vars in 921 bytes} [Wed Sep 14 19:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:46:55.748642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790ebf3-36c5-4ecf-bcd7-b1a00a86fc4f None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:55.749115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790ebf3-36c5-4ecf-bcd7-b1a00a86fc4f None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:55.749219 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790ebf3-36c5-4ecf-bcd7-b1a00a86fc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:55.828375 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-3790ebf3-36c5-4ecf-bcd7-b1a00a86fc4f None None] MFA Rules not processed for user `6942a851a69b446e90a2b138f4482465`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:46:55.829577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3790ebf3-36c5-4ecf-bcd7-b1a00a86fc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:55.906952 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:55.943212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 674/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Sep 14 19:46:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:46:57.254174 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29621f-a339-430f-acdb-f3112e2ae62e None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:57.254705 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29621f-a339-430f-acdb-f3112e2ae62e None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:57.254705 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29621f-a339-430f-acdb-f3112e2ae62e None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:57.256199 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 680/1354] 10.222.0.15 () {54 vars in 921 bytes} [Wed Sep 14 19:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:46:57.261686 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e954bc7-2627-4cb2-991b-390cbb273ef1 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:46:57.262128 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e954bc7-2627-4cb2-991b-390cbb273ef1 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:46:57.262246 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e954bc7-2627-4cb2-991b-390cbb273ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:46:57.341794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-8e954bc7-2627-4cb2-991b-390cbb273ef1 None None] MFA Rules not processed for user `6942a851a69b446e90a2b138f4482465`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:46:57.343008 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-8e954bc7-2627-4cb2-991b-390cbb273ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:46:57.453334 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 675/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Sep 14 19:46:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:01.114817 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e681ad-bb19-409b-b82a-1685da51e989 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:01.115327 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e681ad-bb19-409b-b82a-1685da51e989 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:01.115535 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e681ad-bb19-409b-b82a-1685da51e989 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:01.117761 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 681/1356] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:01.123753 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375e79c-506d-48d0-8761-4bd8a611e30f None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:01.124224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375e79c-506d-48d0-8761-4bd8a611e30f None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:01.124335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375e79c-506d-48d0-8761-4bd8a611e30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:01.166122 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:01.210959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-5375e79c-506d-48d0-8761-4bd8a611e30f None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:01.213547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-5375e79c-506d-48d0-8761-4bd8a611e30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:01.326565 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 676/1357] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:01.629714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291b53a-d95e-4ff3-a4c1-720f54647457 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:01.630401 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291b53a-d95e-4ff3-a4c1-720f54647457 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:01.630838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291b53a-d95e-4ff3-a4c1-720f54647457 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:01.632410 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 682/1358] 10.222.0.15 () {54 vars in 962 bytes} [Wed Sep 14 19:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:01.644796 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102871d-842f-4b5d-9fc3-db59276cc724 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:01.645240 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102871d-842f-4b5d-9fc3-db59276cc724 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:01.645628 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102871d-842f-4b5d-9fc3-db59276cc724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:01.734691 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-5102871d-842f-4b5d-9fc3-db59276cc724 None None] MFA Rules not processed for user `421f6cc846b342918a177d2794eb3db8`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:01.736093 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-5102871d-842f-4b5d-9fc3-db59276cc724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:01.788557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:01.859583 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 677/1359] 10.222.0.15 () {58 vars in 1059 bytes} [Wed Sep 14 19:47:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:01.868096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291b53a-d95e-4ff3-a4c1-720f54647457 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:47:01.869796 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-3291b53a-d95e-4ff3-a4c1-720f54647457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:02.027866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291b53a-d95e-4ff3-a4c1-720f54647457 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:47:02.104564 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:02.144326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35803eb5-59f9-45c3-9471-c5b64dd8970c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:47:02.145073 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35803eb5-59f9-45c3-9471-c5b64dd8970c service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:02.145455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35803eb5-59f9-45c3-9471-c5b64dd8970c service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:02.145825 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35803eb5-59f9-45c3-9471-c5b64dd8970c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:02.148031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-35803eb5-59f9-45c3-9471-c5b64dd8970c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:02.247398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35803eb5-59f9-45c3-9471-c5b64dd8970c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:47:02.249177 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35803eb5-59f9-45c3-9471-c5b64dd8970c service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:47:02.269868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 683/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:47:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:47:04.659700 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37dd85-79a6-40ca-95b5-5e333a454f6a None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:04.659700 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37dd85-79a6-40ca-95b5-5e333a454f6a None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:04.659700 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37dd85-79a6-40ca-95b5-5e333a454f6a None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:04.659700 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 678/1361] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:04.660507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f554249-c145-49af-b143-5ddde1f39b84 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:04.660507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f554249-c145-49af-b143-5ddde1f39b84 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:04.660507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f554249-c145-49af-b143-5ddde1f39b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:04.734691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-9f554249-c145-49af-b143-5ddde1f39b84 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:04.735845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-9f554249-c145-49af-b143-5ddde1f39b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:04.792546 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:04.862912 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 684/1362] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:05.145943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37dd85-79a6-40ca-95b5-5e333a454f6a None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:47:05.147617 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-4a37dd85-79a6-40ca-95b5-5e333a454f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:05.331759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37dd85-79a6-40ca-95b5-5e333a454f6a None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:47:05.344857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:05.483530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1dceda-4020-4077-8833-9f438c2a09e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:47:05.484186 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dceda-4020-4077-8833-9f438c2a09e3 service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:05.484397 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dceda-4020-4077-8833-9f438c2a09e3 service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:05.484656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dceda-4020-4077-8833-9f438c2a09e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:05.486201 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ec1dceda-4020-4077-8833-9f438c2a09e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:05.594677 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1dceda-4020-4077-8833-9f438c2a09e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:47:05.596304 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1dceda-4020-4077-8833-9f438c2a09e3 service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:47:05.614775 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 679/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:47:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:47:08.395644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93a97b-a30d-4df7-9b64-8cf52398de38 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:08.396214 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93a97b-a30d-4df7-9b64-8cf52398de38 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:08.396214 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93a97b-a30d-4df7-9b64-8cf52398de38 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:08.397726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 685/1364] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:08.403349 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd690da-6c93-4134-821e-c94b0e1c1493 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:08.403840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd690da-6c93-4134-821e-c94b0e1c1493 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:08.403936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd690da-6c93-4134-821e-c94b0e1c1493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:08.425038 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:08.480544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-3bd690da-6c93-4134-821e-c94b0e1c1493 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:08.481789 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3bd690da-6c93-4134-821e-c94b0e1c1493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:08.591578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 680/1365] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:08.929848 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71617240-a733-4acd-a415-48d67024670d None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:08.930135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71617240-a733-4acd-a415-48d67024670d None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:08.931269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71617240-a733-4acd-a415-48d67024670d None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:08.932981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 686/1366] 10.222.0.15 () {54 vars in 962 bytes} [Wed Sep 14 19:47:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:08.939726 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a268e3f-a9b5-4fe6-b9b1-2791e09b9d86 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:08.940225 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a268e3f-a9b5-4fe6-b9b1-2791e09b9d86 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:08.940661 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a268e3f-a9b5-4fe6-b9b1-2791e09b9d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:09.049800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-4a268e3f-a9b5-4fe6-b9b1-2791e09b9d86 None None] MFA Rules not processed for user `421f6cc846b342918a177d2794eb3db8`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:09.051992 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-4a268e3f-a9b5-4fe6-b9b1-2791e09b9d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:09.096181 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:09.187476 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 681/1367] 10.222.0.15 () {58 vars in 1059 bytes} [Wed Sep 14 19:47:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:47:09.196564 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71617240-a733-4acd-a415-48d67024670d None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:47:09.198210 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-71617240-a733-4acd-a415-48d67024670d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:09.388145 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71617240-a733-4acd-a415-48d67024670d None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:47:09.410966 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:09.480202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869692a6-1fdb-406a-b0a2-ac864ed2a9a8 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:09.481268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869692a6-1fdb-406a-b0a2-ac864ed2a9a8 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:09.481915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869692a6-1fdb-406a-b0a2-ac864ed2a9a8 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:09.483894 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 682/1368] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:47:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:09.489363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02758ca2-16bf-4a11-9460-d71d6e32e050 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:09.489971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02758ca2-16bf-4a11-9460-d71d6e32e050 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:09.490250 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02758ca2-16bf-4a11-9460-d71d6e32e050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:09.522048 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477a422-be6d-4702-973e-32c1e624a69e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:47:09.523069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477a422-be6d-4702-973e-32c1e624a69e service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:09.523590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477a422-be6d-4702-973e-32c1e624a69e service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:09.524403 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477a422-be6d-4702-973e-32c1e624a69e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:09.526487 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-3477a422-be6d-4702-973e-32c1e624a69e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:09.564703 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-02758ca2-16bf-4a11-9460-d71d6e32e050 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:09.565925 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-02758ca2-16bf-4a11-9460-d71d6e32e050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:09.635321 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477a422-be6d-4702-973e-32c1e624a69e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:47:09.637105 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477a422-be6d-4702-973e-32c1e624a69e service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:47:09.659856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 687/1369] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:47:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:47:09.675645 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:09.687575 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 683/1370] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:47:10.056594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e4f7c-8969-49c3-8948-2f1f020cd0ca None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:10.057263 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e4f7c-8969-49c3-8948-2f1f020cd0ca None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:10.057670 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e4f7c-8969-49c3-8948-2f1f020cd0ca None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:10.059403 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 688/1371] 10.222.0.15 () {54 vars in 964 bytes} [Wed Sep 14 19:47:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:10.064971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f17b04-ff1b-4df9-9e65-e9566de8567a None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:10.065395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f17b04-ff1b-4df9-9e65-e9566de8567a None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:10.065780 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f17b04-ff1b-4df9-9e65-e9566de8567a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:10.158102 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-27f17b04-ff1b-4df9-9e65-e9566de8567a None None] MFA Rules not processed for user `fe18c9b67d814fbba4614cf7491e136e`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:10.159717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-27f17b04-ff1b-4df9-9e65-e9566de8567a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:10.244626 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 684/1372] 10.222.0.15 () {58 vars in 1061 bytes} [Wed Sep 14 19:47:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:10.252410 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e4f7c-8969-49c3-8948-2f1f020cd0ca None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:47:10.253960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-0d1e4f7c-8969-49c3-8948-2f1f020cd0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:10.289485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:10.379743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e4f7c-8969-49c3-8948-2f1f020cd0ca None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:47:10.459719 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3272969-da19-4b4a-b48f-60fbda749e92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:47:10.460427 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3272969-da19-4b4a-b48f-60fbda749e92 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:10.460681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3272969-da19-4b4a-b48f-60fbda749e92 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:10.460872 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3272969-da19-4b4a-b48f-60fbda749e92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:10.462634 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-e3272969-da19-4b4a-b48f-60fbda749e92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:10.545835 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:10.586279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3272969-da19-4b4a-b48f-60fbda749e92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:47:10.588114 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3272969-da19-4b4a-b48f-60fbda749e92 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:47:10.608623 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 689/1373] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:47:12.178757 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b149ce-01c1-4f2d-b337-8e4c3baf2683 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:12.179381 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b149ce-01c1-4f2d-b337-8e4c3baf2683 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:12.179381 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b149ce-01c1-4f2d-b337-8e4c3baf2683 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:12.181120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 685/1374] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:12.188835 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceece7-1d8e-4000-bb14-e56a0ae1559d None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:12.189372 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceece7-1d8e-4000-bb14-e56a0ae1559d None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:12.189372 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceece7-1d8e-4000-bb14-e56a0ae1559d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:12.286965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-74ceece7-1d8e-4000-bb14-e56a0ae1559d None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:12.288248 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-74ceece7-1d8e-4000-bb14-e56a0ae1559d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:12.454556 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 690/1375] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:12.815741 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b149ce-01c1-4f2d-b337-8e4c3baf2683 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:47:12.817952 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-43b149ce-01c1-4f2d-b337-8e4c3baf2683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:12.965952 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:13.078622 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b149ce-01c1-4f2d-b337-8e4c3baf2683 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:47:13.213230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc47369-7b82-4c8b-ab76-4be0fd487579 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:47:13.213883 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc47369-7b82-4c8b-ab76-4be0fd487579 service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:13.214104 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc47369-7b82-4c8b-ab76-4be0fd487579 service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:13.214373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc47369-7b82-4c8b-ab76-4be0fd487579 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:13.216005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0fc47369-7b82-4c8b-ab76-4be0fd487579 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:13.271826 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:13.316619 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc47369-7b82-4c8b-ab76-4be0fd487579 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:47:13.318242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc47369-7b82-4c8b-ab76-4be0fd487579 service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:47:13.338841 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 686/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:47:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:47:15.758937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4615427-8473-495b-9d81-98b8623c20d4 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:15.760110 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4615427-8473-495b-9d81-98b8623c20d4 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:15.760625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4615427-8473-495b-9d81-98b8623c20d4 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:15.762182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 691/1377] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:47:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:15.768032 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429640ed-3b2c-4ccf-9e7f-33a9fb8c304d None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:15.768496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429640ed-3b2c-4ccf-9e7f-33a9fb8c304d None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:15.768496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429640ed-3b2c-4ccf-9e7f-33a9fb8c304d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:15.847790 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-429640ed-3b2c-4ccf-9e7f-33a9fb8c304d None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:15.849814 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-429640ed-3b2c-4ccf-9e7f-33a9fb8c304d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:15.956393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 687/1378] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:16.250097 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4615427-8473-495b-9d81-98b8623c20d4 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:47:16.251611 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c4615427-8473-495b-9d81-98b8623c20d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:16.294912 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:16.419925 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4615427-8473-495b-9d81-98b8623c20d4 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:47:16.537686 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:16.543228 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0f218-fd63-4878-8fc7-c9324f2b0c39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:47:16.543929 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0f218-fd63-4878-8fc7-c9324f2b0c39 service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:16.544330 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0f218-fd63-4878-8fc7-c9324f2b0c39 service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:16.544603 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0f218-fd63-4878-8fc7-c9324f2b0c39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:16.546243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-fae0f218-fd63-4878-8fc7-c9324f2b0c39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:16.649798 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0f218-fd63-4878-8fc7-c9324f2b0c39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:47:16.651293 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0f218-fd63-4878-8fc7-c9324f2b0c39 service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:47:16.674910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 692/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:47:19.020756 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4ab11-85c6-47b1-97aa-18d246eea7bc None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:19.021269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4ab11-85c6-47b1-97aa-18d246eea7bc None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:19.021382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4ab11-85c6-47b1-97aa-18d246eea7bc None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:19.023131 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 688/1380] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:47:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:19.031276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230c202-b61e-4802-9cdd-7569f808835b None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:19.031795 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230c202-b61e-4802-9cdd-7569f808835b None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:19.031904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230c202-b61e-4802-9cdd-7569f808835b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:19.101153 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-7230c202-b61e-4802-9cdd-7569f808835b None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:19.102576 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-7230c202-b61e-4802-9cdd-7569f808835b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:19.170399 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:19.204170 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 693/1381] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:19.503665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4ab11-85c6-47b1-97aa-18d246eea7bc None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:47:19.505254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-51c4ab11-85c6-47b1-97aa-18d246eea7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:19.535294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:19.678170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4ab11-85c6-47b1-97aa-18d246eea7bc None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:47:19.801753 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:19.819659 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec7cf9-1b43-4fa2-ab6e-2c4228fcdcf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:47:19.820269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec7cf9-1b43-4fa2-ab6e-2c4228fcdcf1 service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:19.820544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec7cf9-1b43-4fa2-ab6e-2c4228fcdcf1 service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:19.820828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec7cf9-1b43-4fa2-ab6e-2c4228fcdcf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:19.822443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-8eec7cf9-1b43-4fa2-ab6e-2c4228fcdcf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:19.941050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec7cf9-1b43-4fa2-ab6e-2c4228fcdcf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:47:19.943341 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec7cf9-1b43-4fa2-ab6e-2c4228fcdcf1 service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:47:19.971557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 689/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:47:22.889229 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ca440-4ebe-4883-9a94-e8a5a00396f9 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:22.889739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ca440-4ebe-4883-9a94-e8a5a00396f9 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:22.889854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ca440-4ebe-4883-9a94-e8a5a00396f9 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:22.891134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 694/1383] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:22.898791 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f58851-8bd0-4c67-9566-09ac3168b60c None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:22.904021 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f58851-8bd0-4c67-9566-09ac3168b60c None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:22.904021 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f58851-8bd0-4c67-9566-09ac3168b60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:22.981235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-84f58851-8bd0-4c67-9566-09ac3168b60c None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:22.983061 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-84f58851-8bd0-4c67-9566-09ac3168b60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:23.047804 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:23.100957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 690/1384] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:23.521804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ca440-4ebe-4883-9a94-e8a5a00396f9 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:47:23.523310 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-3b1ca440-4ebe-4883-9a94-e8a5a00396f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:23.692299 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ca440-4ebe-4883-9a94-e8a5a00396f9 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:47:23.756131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:23.831735 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce60cf3-5305-4d5a-bd20-a4a975ee979d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:47:23.832512 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce60cf3-5305-4d5a-bd20-a4a975ee979d service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:23.833136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce60cf3-5305-4d5a-bd20-a4a975ee979d service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:23.833495 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce60cf3-5305-4d5a-bd20-a4a975ee979d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:23.835567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-bce60cf3-5305-4d5a-bd20-a4a975ee979d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:23.940754 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce60cf3-5305-4d5a-bd20-a4a975ee979d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:47:23.942418 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce60cf3-5305-4d5a-bd20-a4a975ee979d service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:47:23.962223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 695/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:47:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:47:26.199724 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcbd41-682a-4a53-87f7-839f045b0434 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:26.200255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcbd41-682a-4a53-87f7-839f045b0434 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:26.200255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcbd41-682a-4a53-87f7-839f045b0434 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:26.201642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 691/1386] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:26.206842 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb22a5-aeeb-4c34-8d7d-0aa19b98aa21 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:26.207324 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb22a5-aeeb-4c34-8d7d-0aa19b98aa21 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:26.207408 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb22a5-aeeb-4c34-8d7d-0aa19b98aa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:26.273534 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-b5eb22a5-aeeb-4c34-8d7d-0aa19b98aa21 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:26.275462 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-b5eb22a5-aeeb-4c34-8d7d-0aa19b98aa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:26.283600 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:26.379230 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 696/1387] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:26.583809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1196413-8efa-469e-a5c6-ea3a37cad98e None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:26.584205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1196413-8efa-469e-a5c6-ea3a37cad98e None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:26.584568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1196413-8efa-469e-a5c6-ea3a37cad98e None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:26.586013 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 692/1388] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:26.591443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2262d9-330f-49df-924d-bb0e035e5c18 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:26.591759 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2262d9-330f-49df-924d-bb0e035e5c18 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:26.592036 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2262d9-330f-49df-924d-bb0e035e5c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:26.659116 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-af2262d9-330f-49df-924d-bb0e035e5c18 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:26.660210 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-af2262d9-330f-49df-924d-bb0e035e5c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:26.666615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1196413-8efa-469e-a5c6-ea3a37cad98e None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:47:26.668692 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b1196413-8efa-469e-a5c6-ea3a37cad98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:26.750799 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:26.762501 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 697/1389] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:26.817988 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1196413-8efa-469e-a5c6-ea3a37cad98e None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:47:26.863916 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:26.936013 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9a7c9-9cba-4325-b732-ef191d463cd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:47:26.936554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9a7c9-9cba-4325-b732-ef191d463cd8 service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:26.936830 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9a7c9-9cba-4325-b732-ef191d463cd8 service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:26.937103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9a7c9-9cba-4325-b732-ef191d463cd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:26.938725 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-83a9a7c9-9cba-4325-b732-ef191d463cd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:27.033381 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9a7c9-9cba-4325-b732-ef191d463cd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:47:27.035028 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9a7c9-9cba-4325-b732-ef191d463cd8 service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:47:27.059854 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 693/1390] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:47:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:47:27.080520 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81a8aa-1c7a-4577-aecd-4fcd0d3ba607 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:27.080812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81a8aa-1c7a-4577-aecd-4fcd0d3ba607 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:27.081088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81a8aa-1c7a-4577-aecd-4fcd0d3ba607 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:27.082450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 698/1391] 10.222.0.15 () {54 vars in 962 bytes} [Wed Sep 14 19:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:27.087946 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05d0ef-06b2-45de-8b31-b4c38d7c8d12 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:27.088281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05d0ef-06b2-45de-8b31-b4c38d7c8d12 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:27.088560 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05d0ef-06b2-45de-8b31-b4c38d7c8d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:27.150531 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:27.171161 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-7c05d0ef-06b2-45de-8b31-b4c38d7c8d12 None None] MFA Rules not processed for user `a2faa7ffc99948478ec7b81842139078`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:27.178421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-7c05d0ef-06b2-45de-8b31-b4c38d7c8d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:27.251127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 694/1392] 10.222.0.15 () {58 vars in 1059 bytes} [Wed Sep 14 19:47:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:27.260179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81a8aa-1c7a-4577-aecd-4fcd0d3ba607 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:47:27.261682 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-9a81a8aa-1c7a-4577-aecd-4fcd0d3ba607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:27.363931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81a8aa-1c7a-4577-aecd-4fcd0d3ba607 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:47:27.436703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0d2c7-bfec-4415-a203-445417362d2e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2faa7ffc99948478ec7b81842139078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:47:27.437316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0d2c7-bfec-4415-a203-445417362d2e service glance] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:27.437588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0d2c7-bfec-4415-a203-445417362d2e service glance] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:27.437854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0d2c7-bfec-4415-a203-445417362d2e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:27.447633 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-18a0d2c7-bfec-4415-a203-445417362d2e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:27.490758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:27.569864 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0d2c7-bfec-4415-a203-445417362d2e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:47:27.572104 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0d2c7-bfec-4415-a203-445417362d2e service glance] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:47:27.594507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 699/1393] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:47:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:47:28.535965 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe3525-3805-4ae7-b490-223b86c82262 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:28.541303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe3525-3805-4ae7-b490-223b86c82262 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:28.541303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe3525-3805-4ae7-b490-223b86c82262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:28.605817 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-f0fe3525-3805-4ae7-b490-223b86c82262 None None] MFA Rules not processed for user `15fbda6263b44352b3ac560372bef725`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:28.607026 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f0fe3525-3805-4ae7-b490-223b86c82262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:28.697174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 695/1394] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Sep 14 19:47:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:28.742060 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608ab3c-97bc-497b-8c4b-bbf8875a3fbe None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:28.742547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608ab3c-97bc-497b-8c4b-bbf8875a3fbe None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:28.742636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608ab3c-97bc-497b-8c4b-bbf8875a3fbe None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:28.744238 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 700/1395] 10.222.0.15 () {54 vars in 943 bytes} [Wed Sep 14 19:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:28.750655 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f96dcc-4b3e-462d-a206-370176bdd8ed None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:28.750966 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f96dcc-4b3e-462d-a206-370176bdd8ed None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:28.751385 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f96dcc-4b3e-462d-a206-370176bdd8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:28.761999 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:28.830316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-83f96dcc-4b3e-462d-a206-370176bdd8ed None None] MFA Rules not processed for user `ee56bf9af257486e94e6ff1b33086f23`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:28.831511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-83f96dcc-4b3e-462d-a206-370176bdd8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:28.937269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 696/1396] 10.222.0.15 () {58 vars in 1040 bytes} [Wed Sep 14 19:47:28 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:28.946212 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608ab3c-97bc-497b-8c4b-bbf8875a3fbe None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:47:28.947802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2608ab3c-97bc-497b-8c4b-bbf8875a3fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:29.092827 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608ab3c-97bc-497b-8c4b-bbf8875a3fbe None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:47:29.106962 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:29.197272 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73ac46-7dc1-420a-a2f3-8f99f07b86b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee56bf9af257486e94e6ff1b33086f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:47:29.197935 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73ac46-7dc1-420a-a2f3-8f99f07b86b3 service swift] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:29.198156 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73ac46-7dc1-420a-a2f3-8f99f07b86b3 service swift] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:29.198425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73ac46-7dc1-420a-a2f3-8f99f07b86b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:29.200073 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-fd73ac46-7dc1-420a-a2f3-8f99f07b86b3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:29.282500 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73ac46-7dc1-420a-a2f3-8f99f07b86b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:47:29.284133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73ac46-7dc1-420a-a2f3-8f99f07b86b3 service swift] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:47:29.292119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 701/1397] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Sep 14 19:47:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 19:47:29.596735 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4570b7f-7b85-4b19-8a9d-f8d5b29509f6 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:29.597292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4570b7f-7b85-4b19-8a9d-f8d5b29509f6 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:29.597292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4570b7f-7b85-4b19-8a9d-f8d5b29509f6 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:29.598660 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 697/1398] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:29.604912 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adb77a-c170-436e-86bc-e79b6555b676 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:29.605945 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adb77a-c170-436e-86bc-e79b6555b676 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:29.605945 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adb77a-c170-436e-86bc-e79b6555b676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:29.670950 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:29.681691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-52adb77a-c170-436e-86bc-e79b6555b676 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:29.682937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-52adb77a-c170-436e-86bc-e79b6555b676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:29.802165 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 702/1399] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:30.090119 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4570b7f-7b85-4b19-8a9d-f8d5b29509f6 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:47:30.091704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-a4570b7f-7b85-4b19-8a9d-f8d5b29509f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:30.175471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:30.260936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4570b7f-7b85-4b19-8a9d-f8d5b29509f6 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:47:30.400905 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d650bb9-87e0-42f5-ab9b-dba2cd76c0c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:47:30.401626 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d650bb9-87e0-42f5-ab9b-dba2cd76c0c0 service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:30.401975 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d650bb9-87e0-42f5-ab9b-dba2cd76c0c0 service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:30.402315 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d650bb9-87e0-42f5-ab9b-dba2cd76c0c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:30.404033 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-9d650bb9-87e0-42f5-ab9b-dba2cd76c0c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:30.441226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:30.512514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d650bb9-87e0-42f5-ab9b-dba2cd76c0c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:47:30.514464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d650bb9-87e0-42f5-ab9b-dba2cd76c0c0 service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:47:30.534618 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 698/1400] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:47:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:47:32.893439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77f1fc-9440-4203-9df3-8cce67bb0a44 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:32.894004 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77f1fc-9440-4203-9df3-8cce67bb0a44 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:32.894004 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77f1fc-9440-4203-9df3-8cce67bb0a44 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:32.895344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 703/1401] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:32.901315 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440f3d2-427e-4759-b8f2-fbdd6af66786 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:32.901793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440f3d2-427e-4759-b8f2-fbdd6af66786 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:32.901935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440f3d2-427e-4759-b8f2-fbdd6af66786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:32.976834 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-4440f3d2-427e-4759-b8f2-fbdd6af66786 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:32.978123 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-4440f3d2-427e-4759-b8f2-fbdd6af66786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:33.105595 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 699/1402] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:33.417203 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77f1fc-9440-4203-9df3-8cce67bb0a44 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:47:33.418874 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-7b77f1fc-9440-4203-9df3-8cce67bb0a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:33.573145 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:33.607872 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77f1fc-9440-4203-9df3-8cce67bb0a44 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:47:33.754186 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88193216-afde-49e9-ba6a-1ade6165cfe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:47:33.754720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88193216-afde-49e9-ba6a-1ade6165cfe3 service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:33.754994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88193216-afde-49e9-ba6a-1ade6165cfe3 service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:33.755261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88193216-afde-49e9-ba6a-1ade6165cfe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:33.756885 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-88193216-afde-49e9-ba6a-1ade6165cfe3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:33.857538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88193216-afde-49e9-ba6a-1ade6165cfe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:47:33.889368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88193216-afde-49e9-ba6a-1ade6165cfe3 service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:47:33.889368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 704/1403] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:47:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:47:34.235796 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:36.751579 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113a714-1a73-47cf-8698-f4a60e05fe7c None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:36.752123 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113a714-1a73-47cf-8698-f4a60e05fe7c None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:36.752123 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113a714-1a73-47cf-8698-f4a60e05fe7c None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:36.753407 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 700/1404] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:36.758928 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1303fe-e6b4-49b2-8829-2e5f0e64e958 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:36.759494 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1303fe-e6b4-49b2-8829-2e5f0e64e958 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:36.759494 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1303fe-e6b4-49b2-8829-2e5f0e64e958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:36.830200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-7a1303fe-e6b4-49b2-8829-2e5f0e64e958 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:36.831411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-7a1303fe-e6b4-49b2-8829-2e5f0e64e958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:36.939826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 705/1405] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:37.244366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113a714-1a73-47cf-8698-f4a60e05fe7c None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:47:37.246015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d113a714-1a73-47cf-8698-f4a60e05fe7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:37.250021 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:37.431823 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113a714-1a73-47cf-8698-f4a60e05fe7c None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:47:37.514404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:37.552705 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4a25b-6d57-48bb-8405-0c305200183a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:47:37.553482 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4a25b-6d57-48bb-8405-0c305200183a service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:37.553833 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4a25b-6d57-48bb-8405-0c305200183a service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:37.554116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4a25b-6d57-48bb-8405-0c305200183a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:37.556298 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d9d4a25b-6d57-48bb-8405-0c305200183a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:37.660745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4a25b-6d57-48bb-8405-0c305200183a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:47:37.662644 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4a25b-6d57-48bb-8405-0c305200183a service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:47:37.684175 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 701/1406] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:47:40.097144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833ae5e-dd77-44b9-b359-f400fb17d45b None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:40.097144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833ae5e-dd77-44b9-b359-f400fb17d45b None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:40.097144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833ae5e-dd77-44b9-b359-f400fb17d45b None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:40.098032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 706/1407] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:40.103220 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670e163-0f72-47be-aaf7-7f4db9111bf4 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:40.103711 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670e163-0f72-47be-aaf7-7f4db9111bf4 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:40.103798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670e163-0f72-47be-aaf7-7f4db9111bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:40.179812 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-4670e163-0f72-47be-aaf7-7f4db9111bf4 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:40.181151 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-4670e163-0f72-47be-aaf7-7f4db9111bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:40.226060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:40.293406 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 702/1408] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:40.589213 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833ae5e-dd77-44b9-b359-f400fb17d45b None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:47:40.590749 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f833ae5e-dd77-44b9-b359-f400fb17d45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:40.662028 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:40.747610 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833ae5e-dd77-44b9-b359-f400fb17d45b None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:47:40.895243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1aaee-7c49-4696-8810-557be466b2bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:47:40.896225 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1aaee-7c49-4696-8810-557be466b2bb service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:40.896686 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1aaee-7c49-4696-8810-557be466b2bb service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:40.896957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1aaee-7c49-4696-8810-557be466b2bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:40.898683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-73a1aaee-7c49-4696-8810-557be466b2bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:40.928431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:41.001498 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1aaee-7c49-4696-8810-557be466b2bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:47:41.003121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1aaee-7c49-4696-8810-557be466b2bb service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:47:41.022954 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 707/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:47:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:47:50.289001 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=25 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:51.020447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=34 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:53.765957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01622c-2f21-4167-b625-2713ecdb0afb None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:53.766532 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01622c-2f21-4167-b625-2713ecdb0afb None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:53.766532 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01622c-2f21-4167-b625-2713ecdb0afb None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:53.767901 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 703/1410] 10.222.0.15 () {54 vars in 918 bytes} [Wed Sep 14 19:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:53.772994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bf01b-0c51-48a5-ab8d-8b200b75655c None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:53.773406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bf01b-0c51-48a5-ab8d-8b200b75655c None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:53.773551 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bf01b-0c51-48a5-ab8d-8b200b75655c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:53.849414 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-a65bf01b-0c51-48a5-ab8d-8b200b75655c None None] MFA Rules not processed for user `6942a851a69b446e90a2b138f4482465`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:53.850898 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a65bf01b-0c51-48a5-ab8d-8b200b75655c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:53.954821 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 708/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Wed Sep 14 19:47:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:53.969166 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8e058-7df1-44a3-88cc-f24814cc00bd None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:53.969455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8e058-7df1-44a3-88cc-f24814cc00bd None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:53.969733 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8e058-7df1-44a3-88cc-f24814cc00bd None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:53.971118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 704/1412] 10.222.0.15 () {54 vars in 918 bytes} [Wed Sep 14 19:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:53.976059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5c848-d31b-4e1e-8efe-851c722699d9 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:53.976343 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5c848-d31b-4e1e-8efe-851c722699d9 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:53.976614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5c848-d31b-4e1e-8efe-851c722699d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:54.048768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:54.051644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-d8e5c848-d31b-4e1e-8efe-851c722699d9 None None] MFA Rules not processed for user `421f6cc846b342918a177d2794eb3db8`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:54.052843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-d8e5c848-d31b-4e1e-8efe-851c722699d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:54.168518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 709/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Wed Sep 14 19:47:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:56.782125 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4de8f-ada9-4abd-b4a6-86ee3f6cd446 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:56.782660 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4de8f-ada9-4abd-b4a6-86ee3f6cd446 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:56.782660 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4de8f-ada9-4abd-b4a6-86ee3f6cd446 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:56.783971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 19:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:56.789316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb53f44-1cd0-4402-a0f7-4095ac0e9073 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:56.790248 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb53f44-1cd0-4402-a0f7-4095ac0e9073 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:56.790652 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb53f44-1cd0-4402-a0f7-4095ac0e9073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:56.858200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-9cb53f44-1cd0-4402-a0f7-4095ac0e9073 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:56.859417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-9cb53f44-1cd0-4402-a0f7-4095ac0e9073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:56.915846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:56.957483 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 19:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:57.251899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4de8f-ada9-4abd-b4a6-86ee3f6cd446 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:47:57.253420 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-44f4de8f-ada9-4abd-b4a6-86ee3f6cd446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:57.402358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4de8f-ada9-4abd-b4a6-86ee3f6cd446 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:47:57.475855 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:57.516433 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cae145-2411-477e-bf41-bb2fd0dd0e88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:47:57.517051 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cae145-2411-477e-bf41-bb2fd0dd0e88 service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:57.517331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cae145-2411-477e-bf41-bb2fd0dd0e88 service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:57.517604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cae145-2411-477e-bf41-bb2fd0dd0e88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:57.519207 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-04cae145-2411-477e-bf41-bb2fd0dd0e88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:57.611680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cae145-2411-477e-bf41-bb2fd0dd0e88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:47:57.613265 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cae145-2411-477e-bf41-bb2fd0dd0e88 service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:47:57.631932 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 706/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:47:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:47:58.770745 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14694e-8c68-4c53-a64f-ad10f847e2f6 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:58.771276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14694e-8c68-4c53-a64f-ad10f847e2f6 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:58.771276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14694e-8c68-4c53-a64f-ad10f847e2f6 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:58.772559 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 19:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:47:58.778866 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca09114-40fc-4ca3-a7c0-d1323bcf4a5c None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:58.779291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca09114-40fc-4ca3-a7c0-d1323bcf4a5c None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:58.779440 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca09114-40fc-4ca3-a7c0-d1323bcf4a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:58.859391 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-6ca09114-40fc-4ca3-a7c0-d1323bcf4a5c None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:47:58.860641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-6ca09114-40fc-4ca3-a7c0-d1323bcf4a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:58.887741 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:58.956440 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 19:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:47:59.107161 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14694e-8c68-4c53-a64f-ad10f847e2f6 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:47:59.108739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-cd14694e-8c68-4c53-a64f-ad10f847e2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:59.256629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14694e-8c68-4c53-a64f-ad10f847e2f6 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:47:59.297355 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:59.370434 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477c8dc-6328-48bf-9a72-3c3269012158 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:47:59.370970 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477c8dc-6328-48bf-9a72-3c3269012158 service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:47:59.371246 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477c8dc-6328-48bf-9a72-3c3269012158 service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:47:59.371514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477c8dc-6328-48bf-9a72-3c3269012158 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:47:59.373155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-e477c8dc-6328-48bf-9a72-3c3269012158 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:47:59.463773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477c8dc-6328-48bf-9a72-3c3269012158 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:47:59.465370 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477c8dc-6328-48bf-9a72-3c3269012158 service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:47:59.483238 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 712/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:47:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:48:00.609102 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296127e6-4aa0-4ec7-8456-2ebb6dd32345 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:00.609662 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296127e6-4aa0-4ec7-8456-2ebb6dd32345 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:00.609662 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296127e6-4aa0-4ec7-8456-2ebb6dd32345 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:00.610990 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 19:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:48:00.617445 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360fdf6-c11e-44b7-a642-aa43ca8fef0e None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:00.618434 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360fdf6-c11e-44b7-a642-aa43ca8fef0e None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:00.618663 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360fdf6-c11e-44b7-a642-aa43ca8fef0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:00.672746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:00.694048 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-5360fdf6-c11e-44b7-a642-aa43ca8fef0e None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:48:00.695250 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-5360fdf6-c11e-44b7-a642-aa43ca8fef0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:00.791039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 19:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:48:00.943588 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296127e6-4aa0-4ec7-8456-2ebb6dd32345 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:48:00.945119 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-296127e6-4aa0-4ec7-8456-2ebb6dd32345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:01.092865 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296127e6-4aa0-4ec7-8456-2ebb6dd32345 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:48:01.105324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:01.207093 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e3eb7-949a-4194-9644-39fb3a8d1ee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:48:01.207697 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e3eb7-949a-4194-9644-39fb3a8d1ee0 service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:01.207968 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e3eb7-949a-4194-9644-39fb3a8d1ee0 service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:01.208236 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e3eb7-949a-4194-9644-39fb3a8d1ee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:01.209910 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ab8e3eb7-949a-4194-9644-39fb3a8d1ee0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:01.308517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e3eb7-949a-4194-9644-39fb3a8d1ee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:48:01.310159 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e3eb7-949a-4194-9644-39fb3a8d1ee0 service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:48:01.328540 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 709/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:48:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:48:02.440234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b726725-a297-4ec1-aa25-c52624a578da None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:02.440790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b726725-a297-4ec1-aa25-c52624a578da None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:02.440790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b726725-a297-4ec1-aa25-c52624a578da None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:02.442133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 19:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:48:02.448578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea18463-9489-43cc-b31d-186605ebf1a3 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:02.449033 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea18463-9489-43cc-b31d-186605ebf1a3 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:02.449132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea18463-9489-43cc-b31d-186605ebf1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:02.468961 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:02.526215 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-8ea18463-9489-43cc-b31d-186605ebf1a3 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:48:02.527430 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-8ea18463-9489-43cc-b31d-186605ebf1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:02.624727 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 19:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:48:02.773726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b726725-a297-4ec1-aa25-c52624a578da None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:48:02.775407 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2b726725-a297-4ec1-aa25-c52624a578da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:02.885844 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:02.923360 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b726725-a297-4ec1-aa25-c52624a578da None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:48:03.043711 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e29b8f-24ab-4381-9e87-34f185499b27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:48:03.044321 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e29b8f-24ab-4381-9e87-34f185499b27 service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:03.044593 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e29b8f-24ab-4381-9e87-34f185499b27 service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:03.044857 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e29b8f-24ab-4381-9e87-34f185499b27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:03.046432 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a2e29b8f-24ab-4381-9e87-34f185499b27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:03.127868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:03.141843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e29b8f-24ab-4381-9e87-34f185499b27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:48:03.142773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e29b8f-24ab-4381-9e87-34f185499b27 service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:48:03.161555 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 715/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:48:04.278934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b7f24-e3be-40c9-abd0-6f067e70ed8d None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:04.279509 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b7f24-e3be-40c9-abd0-6f067e70ed8d None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:04.279509 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b7f24-e3be-40c9-abd0-6f067e70ed8d None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:04.280880 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 19:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:48:04.287375 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a006f1b-e029-47e3-9a6a-9fa232fd70cd None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:04.287835 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a006f1b-e029-47e3-9a6a-9fa232fd70cd None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:04.287968 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a006f1b-e029-47e3-9a6a-9fa232fd70cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:04.363341 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-7a006f1b-e029-47e3-9a6a-9fa232fd70cd None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:48:04.364574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-7a006f1b-e029-47e3-9a6a-9fa232fd70cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:04.460363 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 19:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:48:04.615704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b7f24-e3be-40c9-abd0-6f067e70ed8d None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:48:04.617218 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-089b7f24-e3be-40c9-abd0-6f067e70ed8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:04.704136 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:04.768136 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b7f24-e3be-40c9-abd0-6f067e70ed8d None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:48:04.882925 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ecf83f-1a85-4a3f-b2db-79ec57fc1cd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:48:04.883583 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecf83f-1a85-4a3f-b2db-79ec57fc1cd1 service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:04.883866 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecf83f-1a85-4a3f-b2db-79ec57fc1cd1 service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:04.884229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecf83f-1a85-4a3f-b2db-79ec57fc1cd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:04.885711 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-74ecf83f-1a85-4a3f-b2db-79ec57fc1cd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:04.934327 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:04.974807 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ecf83f-1a85-4a3f-b2db-79ec57fc1cd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:48:04.976718 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ecf83f-1a85-4a3f-b2db-79ec57fc1cd1 service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:48:04.995533 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 712/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:48:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:48:06.106603 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c7127-8d2d-482b-9b8f-a94f11ac83b6 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:06.107212 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c7127-8d2d-482b-9b8f-a94f11ac83b6 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:06.107212 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c7127-8d2d-482b-9b8f-a94f11ac83b6 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:06.108511 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 19:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:48:06.114588 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9de44-a238-4da7-aa8c-fd0da0d200c3 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:06.115015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9de44-a238-4da7-aa8c-fd0da0d200c3 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:06.115143 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9de44-a238-4da7-aa8c-fd0da0d200c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:06.192091 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-c4d9de44-a238-4da7-aa8c-fd0da0d200c3 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:48:06.193300 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-c4d9de44-a238-4da7-aa8c-fd0da0d200c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:06.290880 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 19:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:48:06.440416 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c7127-8d2d-482b-9b8f-a94f11ac83b6 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:48:06.441957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ee0c7127-8d2d-482b-9b8f-a94f11ac83b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:06.490426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:06.584981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c7127-8d2d-482b-9b8f-a94f11ac83b6 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:48:06.697418 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473441a-c579-4610-99d0-e57e9c9b2d76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:48:06.697966 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473441a-c579-4610-99d0-e57e9c9b2d76 service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:06.698245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473441a-c579-4610-99d0-e57e9c9b2d76 service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:06.698516 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473441a-c579-4610-99d0-e57e9c9b2d76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:06.700148 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-e473441a-c579-4610-99d0-e57e9c9b2d76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:06.707095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:06.791940 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473441a-c579-4610-99d0-e57e9c9b2d76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:48:06.793539 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473441a-c579-4610-99d0-e57e9c9b2d76 service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:48:06.811192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 718/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:48:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:48:07.953558 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860683e4-48f8-4983-b479-d0abead1b4f1 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:07.954159 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860683e4-48f8-4983-b479-d0abead1b4f1 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:07.954159 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860683e4-48f8-4983-b479-d0abead1b4f1 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:07.955524 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 19:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:48:07.962024 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ce3d8-3df8-48e9-ae71-88713be3f144 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:07.962540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ce3d8-3df8-48e9-ae71-88713be3f144 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:07.962660 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ce3d8-3df8-48e9-ae71-88713be3f144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:08.037751 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-a32ce3d8-3df8-48e9-ae71-88713be3f144 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:48:08.038992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a32ce3d8-3df8-48e9-ae71-88713be3f144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:08.107239 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:08.136102 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 19:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:48:08.289088 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860683e4-48f8-4983-b479-d0abead1b4f1 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:48:08.291121 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-860683e4-48f8-4983-b479-d0abead1b4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:08.309149 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:08.442409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860683e4-48f8-4983-b479-d0abead1b4f1 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:48:08.529318 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:08.556352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09102b8-9047-48f8-896b-04b074bf3361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:48:08.556898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09102b8-9047-48f8-896b-04b074bf3361 service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:08.557174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09102b8-9047-48f8-896b-04b074bf3361 service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:08.557446 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09102b8-9047-48f8-896b-04b074bf3361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:08.559046 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e09102b8-9047-48f8-896b-04b074bf3361 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:08.660602 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09102b8-9047-48f8-896b-04b074bf3361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:48:08.662183 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09102b8-9047-48f8-896b-04b074bf3361 service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:48:08.681281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 715/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:48:09.802983 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e716ded-f42e-4ba1-b6c8-aab7e1f98540 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:09.803523 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e716ded-f42e-4ba1-b6c8-aab7e1f98540 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:09.803523 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e716ded-f42e-4ba1-b6c8-aab7e1f98540 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:09.804940 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 19:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:48:09.811358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bb1d0-d8fa-41ff-8703-b1c4f8f48a43 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:09.811849 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bb1d0-d8fa-41ff-8703-b1c4f8f48a43 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:09.811953 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bb1d0-d8fa-41ff-8703-b1c4f8f48a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:09.888032 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-158bb1d0-d8fa-41ff-8703-b1c4f8f48a43 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:48:09.889253 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-158bb1d0-d8fa-41ff-8703-b1c4f8f48a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:09.931073 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:09.987261 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 19:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:48:10.137532 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e716ded-f42e-4ba1-b6c8-aab7e1f98540 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:48:10.139076 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-6e716ded-f42e-4ba1-b6c8-aab7e1f98540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:10.282692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e716ded-f42e-4ba1-b6c8-aab7e1f98540 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:48:10.344937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:10.405620 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2e6a2-1e82-43bd-a7c5-3cd9cb0f199d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:48:10.406157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2e6a2-1e82-43bd-a7c5-3cd9cb0f199d service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:10.406436 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2e6a2-1e82-43bd-a7c5-3cd9cb0f199d service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:10.406706 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2e6a2-1e82-43bd-a7c5-3cd9cb0f199d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:10.408345 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-bee2e6a2-1e82-43bd-a7c5-3cd9cb0f199d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:10.496529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2e6a2-1e82-43bd-a7c5-3cd9cb0f199d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:48:10.498136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2e6a2-1e82-43bd-a7c5-3cd9cb0f199d service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:48:10.516817 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 721/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:48:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:48:11.663583 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc6a7c-9941-48a7-83e7-0957369cd8a0 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:11.664166 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc6a7c-9941-48a7-83e7-0957369cd8a0 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:11.664166 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc6a7c-9941-48a7-83e7-0957369cd8a0 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:11.666079 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 19:48:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:48:11.672609 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131ffc7-25a2-4c27-8145-15e1884a5f75 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:11.673097 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131ffc7-25a2-4c27-8145-15e1884a5f75 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:11.673194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131ffc7-25a2-4c27-8145-15e1884a5f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:11.756605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-0131ffc7-25a2-4c27-8145-15e1884a5f75 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:48:11.757817 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-0131ffc7-25a2-4c27-8145-15e1884a5f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:11.759875 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:11.854325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 19:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:48:12.005425 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc6a7c-9941-48a7-83e7-0957369cd8a0 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:48:12.006958 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b8fc6a7c-9941-48a7-83e7-0957369cd8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:12.153020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc6a7c-9941-48a7-83e7-0957369cd8a0 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:48:12.180206 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:12.266676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b02674-aff3-417d-8eb5-eb051a6b76fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:48:12.267335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b02674-aff3-417d-8eb5-eb051a6b76fc service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:12.267638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b02674-aff3-417d-8eb5-eb051a6b76fc service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:12.267912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b02674-aff3-417d-8eb5-eb051a6b76fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:12.269502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-53b02674-aff3-417d-8eb5-eb051a6b76fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:12.366154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b02674-aff3-417d-8eb5-eb051a6b76fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:48:12.367823 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b02674-aff3-417d-8eb5-eb051a6b76fc service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:48:12.386730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 718/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:48:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:48:14.517688 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6872ca-d26a-4166-ae09-6d591f391888 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:14.518266 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6872ca-d26a-4166-ae09-6d591f391888 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:14.518266 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6872ca-d26a-4166-ae09-6d591f391888 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:14.519638 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 19:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:48:14.527085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5ab8c-92fc-4683-8913-144d89cbc3b0 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:14.527603 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5ab8c-92fc-4683-8913-144d89cbc3b0 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:14.527728 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5ab8c-92fc-4683-8913-144d89cbc3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:14.584956 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:14.618954 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-43b5ab8c-92fc-4683-8913-144d89cbc3b0 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:48:14.620216 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-43b5ab8c-92fc-4683-8913-144d89cbc3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:14.748765 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 19:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:48:15.048871 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6872ca-d26a-4166-ae09-6d591f391888 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:48:15.050413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-cc6872ca-d26a-4166-ae09-6d591f391888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:15.154602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6872ca-d26a-4166-ae09-6d591f391888 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:48:15.186992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:15.230675 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13030b6c-31a2-4954-ab2f-3134665e63c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:48:15.231290 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13030b6c-31a2-4954-ab2f-3134665e63c1 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:15.231587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13030b6c-31a2-4954-ab2f-3134665e63c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:15.231861 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13030b6c-31a2-4954-ab2f-3134665e63c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:15.233450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-13030b6c-31a2-4954-ab2f-3134665e63c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:15.464317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13030b6c-31a2-4954-ab2f-3134665e63c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:48:15.465746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13030b6c-31a2-4954-ab2f-3134665e63c1 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:48:15.483430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 724/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:48:17.798475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112b9df-d2f5-42f3-bfd8-7a8dceb8b700 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:17.799001 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112b9df-d2f5-42f3-bfd8-7a8dceb8b700 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:17.799001 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112b9df-d2f5-42f3-bfd8-7a8dceb8b700 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:17.800348 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 19:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:48:17.806615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c809dd-2744-4367-8828-f66eb725bd83 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:17.807026 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c809dd-2744-4367-8828-f66eb725bd83 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:17.807150 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c809dd-2744-4367-8828-f66eb725bd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:17.871439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-33c809dd-2744-4367-8828-f66eb725bd83 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:48:17.872660 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-33c809dd-2744-4367-8828-f66eb725bd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:17.885228 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:17.968202 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 19:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:48:18.256158 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112b9df-d2f5-42f3-bfd8-7a8dceb8b700 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:48:18.257688 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e112b9df-d2f5-42f3-bfd8-7a8dceb8b700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:18.359814 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112b9df-d2f5-42f3-bfd8-7a8dceb8b700 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:48:18.373269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:18.436058 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a975947-8100-4ff2-8669-160e54b98531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:48:18.436666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a975947-8100-4ff2-8669-160e54b98531 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:18.436938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a975947-8100-4ff2-8669-160e54b98531 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:18.437203 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a975947-8100-4ff2-8669-160e54b98531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:18.438780 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0a975947-8100-4ff2-8669-160e54b98531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:18.548054 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a975947-8100-4ff2-8669-160e54b98531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:48:18.549406 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a975947-8100-4ff2-8669-160e54b98531 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:48:18.567615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 721/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:48:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:48:21.073621 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003928c-d401-4fae-b59a-efd884eb52c2 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:21.074189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003928c-d401-4fae-b59a-efd884eb52c2 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:21.074189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003928c-d401-4fae-b59a-efd884eb52c2 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:21.075500 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 19:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:48:21.080843 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0eea6-2358-41df-a2b1-46824b66672d None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:21.081261 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0eea6-2358-41df-a2b1-46824b66672d None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:21.081421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0eea6-2358-41df-a2b1-46824b66672d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:21.129749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:21.148699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-e3d0eea6-2358-41df-a2b1-46824b66672d None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:48:21.150579 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e3d0eea6-2358-41df-a2b1-46824b66672d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:21.247012 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 19:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:48:21.535868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003928c-d401-4fae-b59a-efd884eb52c2 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:48:21.537398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2003928c-d401-4fae-b59a-efd884eb52c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:21.641663 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003928c-d401-4fae-b59a-efd884eb52c2 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:48:21.681334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:21.715220 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1cd5f-ced1-4f23-a034-f95c3ee28257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:48:21.715861 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1cd5f-ced1-4f23-a034-f95c3ee28257 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:21.716143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1cd5f-ced1-4f23-a034-f95c3ee28257 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:21.716415 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1cd5f-ced1-4f23-a034-f95c3ee28257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:21.718049 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-46e1cd5f-ced1-4f23-a034-f95c3ee28257 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:21.832601 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1cd5f-ced1-4f23-a034-f95c3ee28257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:48:21.833949 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1cd5f-ced1-4f23-a034-f95c3ee28257 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:48:21.852742 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 727/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:48:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:48:24.140490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc920bc3-2ff7-4bae-a5d5-a1053dc2dbfa None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:24.141107 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc920bc3-2ff7-4bae-a5d5-a1053dc2dbfa None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:24.141107 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc920bc3-2ff7-4bae-a5d5-a1053dc2dbfa None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:24.142368 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 19:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:48:24.147556 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049ce0b-e935-4710-b780-95b4e42579f0 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:24.147969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049ce0b-e935-4710-b780-95b4e42579f0 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:24.148107 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049ce0b-e935-4710-b780-95b4e42579f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:24.215109 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-2049ce0b-e935-4710-b780-95b4e42579f0 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:48:24.216349 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2049ce0b-e935-4710-b780-95b4e42579f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:24.237197 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:24.313591 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 19:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:48:24.603061 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc920bc3-2ff7-4bae-a5d5-a1053dc2dbfa None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:48:24.604645 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-dc920bc3-2ff7-4bae-a5d5-a1053dc2dbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:24.708424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc920bc3-2ff7-4bae-a5d5-a1053dc2dbfa None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:48:24.729408 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:24.782824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cd24d-882a-48ca-9349-0241cec138b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:48:24.783425 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cd24d-882a-48ca-9349-0241cec138b4 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:24.783742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cd24d-882a-48ca-9349-0241cec138b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:24.784005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cd24d-882a-48ca-9349-0241cec138b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:24.785577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-371cd24d-882a-48ca-9349-0241cec138b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:24.895140 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cd24d-882a-48ca-9349-0241cec138b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:48:24.896625 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cd24d-882a-48ca-9349-0241cec138b4 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:48:24.915074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 724/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:48:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:48:27.110094 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94d789-8504-48ec-bb8e-f9190eab3181 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:27.110660 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94d789-8504-48ec-bb8e-f9190eab3181 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:27.110660 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94d789-8504-48ec-bb8e-f9190eab3181 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:27.112004 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 19:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:48:27.117403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d478a-267d-430a-919a-e35a293c3c4f None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:27.117850 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d478a-267d-430a-919a-e35a293c3c4f None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:27.118155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d478a-267d-430a-919a-e35a293c3c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:27.182618 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:27.187004 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-796d478a-267d-430a-919a-e35a293c3c4f None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:48:27.188252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-796d478a-267d-430a-919a-e35a293c3c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:27.284270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 19:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:48:27.571014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94d789-8504-48ec-bb8e-f9190eab3181 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:48:27.572562 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ce94d789-8504-48ec-bb8e-f9190eab3181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:27.679506 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94d789-8504-48ec-bb8e-f9190eab3181 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:48:27.728882 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:27.752262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762f18a-0144-40bb-9a44-b85908bd5d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:48:27.752871 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762f18a-0144-40bb-9a44-b85908bd5d18 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:27.753149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762f18a-0144-40bb-9a44-b85908bd5d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:27.753418 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762f18a-0144-40bb-9a44-b85908bd5d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:27.754999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-1762f18a-0144-40bb-9a44-b85908bd5d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:27.864927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762f18a-0144-40bb-9a44-b85908bd5d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:48:27.866362 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762f18a-0144-40bb-9a44-b85908bd5d18 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:48:27.884747 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 730/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:48:30.145324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4609320-5b3c-4c96-93a1-4e9c3ce7958c None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:30.145880 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4609320-5b3c-4c96-93a1-4e9c3ce7958c None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:30.145880 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4609320-5b3c-4c96-93a1-4e9c3ce7958c None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:30.147212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 19:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:48:30.152808 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104dbde-3557-4701-882e-3a6a1f5c534f None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:30.153251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104dbde-3557-4701-882e-3a6a1f5c534f None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:30.153346 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104dbde-3557-4701-882e-3a6a1f5c534f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:30.219287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-6104dbde-3557-4701-882e-3a6a1f5c534f None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:48:30.220525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-6104dbde-3557-4701-882e-3a6a1f5c534f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:30.250574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:30.317729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 19:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:48:30.610896 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4609320-5b3c-4c96-93a1-4e9c3ce7958c None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:48:30.612690 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f4609320-5b3c-4c96-93a1-4e9c3ce7958c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:30.716319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4609320-5b3c-4c96-93a1-4e9c3ce7958c None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:48:30.745573 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:30.790941 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2079b8d-4029-43a9-8845-3bd71d5fe8d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:48:30.791571 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2079b8d-4029-43a9-8845-3bd71d5fe8d4 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:30.791858 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2079b8d-4029-43a9-8845-3bd71d5fe8d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:30.792131 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2079b8d-4029-43a9-8845-3bd71d5fe8d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:30.793735 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f2079b8d-4029-43a9-8845-3bd71d5fe8d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:30.904669 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2079b8d-4029-43a9-8845-3bd71d5fe8d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:48:30.906132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2079b8d-4029-43a9-8845-3bd71d5fe8d4 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:48:30.925928 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 727/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:48:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:48:33.132543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5196943-d93a-44ea-8aab-45b008d195a1 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:33.133125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5196943-d93a-44ea-8aab-45b008d195a1 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:33.133125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5196943-d93a-44ea-8aab-45b008d195a1 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:33.135180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 19:48:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:48:33.140567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bb3d7-4f95-42e3-85eb-30ad23cfed80 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:33.141005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bb3d7-4f95-42e3-85eb-30ad23cfed80 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:33.141119 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bb3d7-4f95-42e3-85eb-30ad23cfed80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:33.205699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-687bb3d7-4f95-42e3-85eb-30ad23cfed80 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:48:33.206899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-687bb3d7-4f95-42e3-85eb-30ad23cfed80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:33.215755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:33.308607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 19:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:48:33.601768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5196943-d93a-44ea-8aab-45b008d195a1 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:48:33.604134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-b5196943-d93a-44ea-8aab-45b008d195a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:33.704017 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5196943-d93a-44ea-8aab-45b008d195a1 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:48:33.758385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:33.776675 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327115b-0106-4da6-a99c-8d7570acf2d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:48:33.777287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327115b-0106-4da6-a99c-8d7570acf2d8 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:33.777561 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327115b-0106-4da6-a99c-8d7570acf2d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:33.777827 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327115b-0106-4da6-a99c-8d7570acf2d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:33.779390 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4327115b-0106-4da6-a99c-8d7570acf2d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:33.887987 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327115b-0106-4da6-a99c-8d7570acf2d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:48:33.889323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327115b-0106-4da6-a99c-8d7570acf2d8 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:48:33.907759 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 733/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:48:36.159581 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6b4f7-b3f9-4525-890b-e381693f0446 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:36.160232 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6b4f7-b3f9-4525-890b-e381693f0446 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:36.160232 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6b4f7-b3f9-4525-890b-e381693f0446 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:36.161471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 19:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:48:36.167359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0003e11-a136-438b-a1aa-4404cc8c9dc2 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:36.167832 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0003e11-a136-438b-a1aa-4404cc8c9dc2 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:36.167936 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0003e11-a136-438b-a1aa-4404cc8c9dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:36.234153 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-f0003e11-a136-438b-a1aa-4404cc8c9dc2 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:48:36.235360 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f0003e11-a136-438b-a1aa-4404cc8c9dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:36.274207 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:36.332719 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 19:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:48:36.614938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6b4f7-b3f9-4525-890b-e381693f0446 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:48:36.616536 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-19d6b4f7-b3f9-4525-890b-e381693f0446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:36.721061 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6b4f7-b3f9-4525-890b-e381693f0446 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:48:36.760143 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:36.795806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae07b55-223b-4a05-87ea-8f83a9413bb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:48:36.796415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae07b55-223b-4a05-87ea-8f83a9413bb0 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:36.796712 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae07b55-223b-4a05-87ea-8f83a9413bb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:36.796984 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae07b55-223b-4a05-87ea-8f83a9413bb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:36.798568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1ae07b55-223b-4a05-87ea-8f83a9413bb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:36.908187 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae07b55-223b-4a05-87ea-8f83a9413bb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:48:36.909611 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae07b55-223b-4a05-87ea-8f83a9413bb0 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:48:36.927755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 730/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:48:39.108738 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e03ac-6354-4a09-99c5-33715fd4fcb6 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:39.109271 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e03ac-6354-4a09-99c5-33715fd4fcb6 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:39.109353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e03ac-6354-4a09-99c5-33715fd4fcb6 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:39.110697 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 19:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:48:39.115971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c4602-4783-4e1b-ba87-819eaec2e1c7 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:39.116363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c4602-4783-4e1b-ba87-819eaec2e1c7 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:39.116526 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c4602-4783-4e1b-ba87-819eaec2e1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:39.301146 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-7e9c4602-4783-4e1b-ba87-819eaec2e1c7 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:48:39.302281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-7e9c4602-4783-4e1b-ba87-819eaec2e1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:39.321267 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:39.405688 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 19:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:48:39.695320 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e03ac-6354-4a09-99c5-33715fd4fcb6 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:48:39.696953 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-962e03ac-6354-4a09-99c5-33715fd4fcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:39.801499 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e03ac-6354-4a09-99c5-33715fd4fcb6 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:48:39.868850 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:39.875132 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc51a7-9691-42d6-9cf1-b1bf02c12c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:48:39.877274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc51a7-9691-42d6-9cf1-b1bf02c12c5a service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:39.877274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc51a7-9691-42d6-9cf1-b1bf02c12c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:39.877274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc51a7-9691-42d6-9cf1-b1bf02c12c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:39.877870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-49fc51a7-9691-42d6-9cf1-b1bf02c12c5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:39.989136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc51a7-9691-42d6-9cf1-b1bf02c12c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:48:39.990491 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc51a7-9691-42d6-9cf1-b1bf02c12c5a service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:48:40.011016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 736/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:48:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:48:42.167265 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b66ee1-57ba-4c82-bb3f-d9930aa2a8de None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:42.167868 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b66ee1-57ba-4c82-bb3f-d9930aa2a8de None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:42.167868 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b66ee1-57ba-4c82-bb3f-d9930aa2a8de None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:42.169149 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 19:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:48:42.174710 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b9585-350e-4947-af30-acd2c337e6a7 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:42.175113 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b9585-350e-4947-af30-acd2c337e6a7 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:42.175261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b9585-350e-4947-af30-acd2c337e6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:42.241228 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-896b9585-350e-4947-af30-acd2c337e6a7 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:48:42.242350 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-896b9585-350e-4947-af30-acd2c337e6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:42.288838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:42.336025 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 19:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:48:42.616840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b66ee1-57ba-4c82-bb3f-d9930aa2a8de None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:48:42.618917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-28b66ee1-57ba-4c82-bb3f-d9930aa2a8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:42.728258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b66ee1-57ba-4c82-bb3f-d9930aa2a8de None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:48:42.777696 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:42.803112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682e063-c35f-4a21-9b5b-aba3f286c5af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:48:42.803753 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682e063-c35f-4a21-9b5b-aba3f286c5af service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:48:42.804031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682e063-c35f-4a21-9b5b-aba3f286c5af service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:48:42.804375 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682e063-c35f-4a21-9b5b-aba3f286c5af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:48:42.807692 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-c682e063-c35f-4a21-9b5b-aba3f286c5af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:48:42.920109 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682e063-c35f-4a21-9b5b-aba3f286c5af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:48:42.921587 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682e063-c35f-4a21-9b5b-aba3f286c5af service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:48:42.940464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 733/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:48:52.334737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=22 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:48:52.938199 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=66 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:49:03.068472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31e6fc-9068-4b83-a131-5f8a066e1d1c None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:03.069049 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31e6fc-9068-4b83-a131-5f8a066e1d1c None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:03.069049 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31e6fc-9068-4b83-a131-5f8a066e1d1c None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:03.070413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 738/1471] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:49:03.076367 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7ffbe-9f46-4fa9-8211-1ca5a8a828d1 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:03.076820 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7ffbe-9f46-4fa9-8211-1ca5a8a828d1 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:03.076924 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7ffbe-9f46-4fa9-8211-1ca5a8a828d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:03.141882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-42a7ffbe-9f46-4fa9-8211-1ca5a8a828d1 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:49:03.143081 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-42a7ffbe-9f46-4fa9-8211-1ca5a8a828d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:49:03.237424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 734/1472] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:49:03.541832 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e2b67-58e9-4be9-a325-226b42b077d8 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:03.542118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e2b67-58e9-4be9-a325-226b42b077d8 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:03.542391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e2b67-58e9-4be9-a325-226b42b077d8 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:03.543754 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 739/1473] 10.222.0.15 () {54 vars in 962 bytes} [Wed Sep 14 19:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:49:03.548745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb4e85-c30c-42b4-a38d-4433e1d3cc02 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:03.549026 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb4e85-c30c-42b4-a38d-4433e1d3cc02 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:03.549298 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb4e85-c30c-42b4-a38d-4433e1d3cc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:03.627649 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-dffb4e85-c30c-42b4-a38d-4433e1d3cc02 None None] MFA Rules not processed for user `a2faa7ffc99948478ec7b81842139078`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:49:03.628861 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-dffb4e85-c30c-42b4-a38d-4433e1d3cc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:49:03.649825 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:49:03.704449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 735/1474] 10.222.0.15 () {58 vars in 1059 bytes} [Wed Sep 14 19:49:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:49:03.712626 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e2b67-58e9-4be9-a325-226b42b077d8 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:49:03.714172 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ef0e2b67-58e9-4be9-a325-226b42b077d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:49:03.816863 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e2b67-58e9-4be9-a325-226b42b077d8 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:49:03.890960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5067e-bbe0-479b-9660-d4d13f077653 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2faa7ffc99948478ec7b81842139078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:49:03.891594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5067e-bbe0-479b-9660-d4d13f077653 service glance] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:03.891875 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5067e-bbe0-479b-9660-d4d13f077653 service glance] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:03.892148 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5067e-bbe0-479b-9660-d4d13f077653 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:03.893837 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-05d5067e-bbe0-479b-9660-d4d13f077653 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:49:03.947782 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:49:04.003462 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5067e-bbe0-479b-9660-d4d13f077653 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:49:04.004995 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5067e-bbe0-479b-9660-d4d13f077653 service glance] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:49:04.022970 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 740/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:49:06.245468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0d888-81c6-4be0-9b3f-96d44c61a107 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:06.246043 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0d888-81c6-4be0-9b3f-96d44c61a107 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:06.246043 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0d888-81c6-4be0-9b3f-96d44c61a107 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:06.247341 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 736/1476] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:49:06.252578 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d3b5b-ce6d-4178-8420-ddef93304c2b None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:06.253006 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d3b5b-ce6d-4178-8420-ddef93304c2b None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:06.253151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d3b5b-ce6d-4178-8420-ddef93304c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:06.318284 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-d07d3b5b-ce6d-4178-8420-ddef93304c2b None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:49:06.319503 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-d07d3b5b-ce6d-4178-8420-ddef93304c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:49:06.418351 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 741/1477] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:49:06.693835 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0d888-81c6-4be0-9b3f-96d44c61a107 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:49:06.695391 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f8c0d888-81c6-4be0-9b3f-96d44c61a107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:49:06.830231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0d888-81c6-4be0-9b3f-96d44c61a107 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:49:06.880293 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:49:06.924146 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c30fe2-de58-4d50-a5ce-fc2e2b212a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:49:06.924755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c30fe2-de58-4d50-a5ce-fc2e2b212a02 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:06.925051 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c30fe2-de58-4d50-a5ce-fc2e2b212a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:06.925308 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c30fe2-de58-4d50-a5ce-fc2e2b212a02 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:06.925936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c30fe2-de58-4d50-a5ce-fc2e2b212a02 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:49:06.927683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: WARNING py.warnings [None req-09c30fe2-de58-4d50-a5ce-fc2e2b212a02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:49:06.927683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: warnings.warn(msg) Sep 14 19:49:06.927683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: Sep 14 19:49:06.928804 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c30fe2-de58-4d50-a5ce-fc2e2b212a02 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:49:06.948210 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 737/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Sep 14 19:49:06 2022] GET /identity/v3/projects => generated 2553 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:49:09.161368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc13a48-1cf5-4f5f-95c8-3671c2dc8856 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:09.161936 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc13a48-1cf5-4f5f-95c8-3671c2dc8856 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:09.161936 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc13a48-1cf5-4f5f-95c8-3671c2dc8856 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:09.163272 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 742/1479] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:49:09.169535 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad5c25-5f0f-4258-b752-67362b676e31 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:09.169974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad5c25-5f0f-4258-b752-67362b676e31 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:09.170080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad5c25-5f0f-4258-b752-67362b676e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:09.235507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-e4ad5c25-5f0f-4258-b752-67362b676e31 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:49:09.236750 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e4ad5c25-5f0f-4258-b752-67362b676e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:49:09.331910 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 738/1480] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:49:09.637119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc13a48-1cf5-4f5f-95c8-3671c2dc8856 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:49:09.638663 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4fc13a48-1cf5-4f5f-95c8-3671c2dc8856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:49:09.648378 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:49:09.786694 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc13a48-1cf5-4f5f-95c8-3671c2dc8856 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:49:09.866442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:49:09.899089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b22c18-2e12-4638-8a42-8d5a7b9930fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:49:09.899652 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b22c18-2e12-4638-8a42-8d5a7b9930fa service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:09.899927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b22c18-2e12-4638-8a42-8d5a7b9930fa service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:09.900192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b22c18-2e12-4638-8a42-8d5a7b9930fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:09.901758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-96b22c18-2e12-4638-8a42-8d5a7b9930fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:49:09.989413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b22c18-2e12-4638-8a42-8d5a7b9930fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:49:09.990976 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b22c18-2e12-4638-8a42-8d5a7b9930fa service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:49:10.008808 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 743/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:49:12.342782 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9c82d-4774-4fc1-8d38-ecf003acfdac None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:12.343348 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9c82d-4774-4fc1-8d38-ecf003acfdac None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:12.343348 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9c82d-4774-4fc1-8d38-ecf003acfdac None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:12.344681 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 739/1482] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:49:12.349903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e57f40-0db0-478b-b94d-734ecbadcf09 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:12.350317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e57f40-0db0-478b-b94d-734ecbadcf09 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:12.350452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e57f40-0db0-478b-b94d-734ecbadcf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:12.417359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-28e57f40-0db0-478b-b94d-734ecbadcf09 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:49:12.418553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-28e57f40-0db0-478b-b94d-734ecbadcf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:49:12.464574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:49:12.514700 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 744/1483] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:49:12.811925 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9c82d-4774-4fc1-8d38-ecf003acfdac None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:49:12.813455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-bfc9c82d-4774-4fc1-8d38-ecf003acfdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:49:12.838049 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:49:12.920885 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9c82d-4774-4fc1-8d38-ecf003acfdac None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:49:12.994830 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf91b8-7b0a-4db3-a830-145b5303e1c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:49:12.995440 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf91b8-7b0a-4db3-a830-145b5303e1c9 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:12.995733 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf91b8-7b0a-4db3-a830-145b5303e1c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:12.996001 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf91b8-7b0a-4db3-a830-145b5303e1c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:12.997581 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0aaf91b8-7b0a-4db3-a830-145b5303e1c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:49:13.073325 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:49:13.108712 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf91b8-7b0a-4db3-a830-145b5303e1c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:49:13.110150 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf91b8-7b0a-4db3-a830-145b5303e1c9 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:49:13.128922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 740/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:49:15.549716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b31e05-e57a-484e-b1e5-181e0593e592 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:15.550276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b31e05-e57a-484e-b1e5-181e0593e592 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:15.550276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b31e05-e57a-484e-b1e5-181e0593e592 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:15.551615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 745/1485] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:49:15.557702 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7a635-379b-4ef2-891d-9cfec6494e4d None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:15.558142 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7a635-379b-4ef2-891d-9cfec6494e4d None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:15.558252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7a635-379b-4ef2-891d-9cfec6494e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:15.626710 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-f3e7a635-379b-4ef2-891d-9cfec6494e4d None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:49:15.627865 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f3e7a635-379b-4ef2-891d-9cfec6494e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:49:15.726593 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 741/1486] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:49:16.028348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b31e05-e57a-484e-b1e5-181e0593e592 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:49:16.029906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-40b31e05-e57a-484e-b1e5-181e0593e592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:49:16.137336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b31e05-e57a-484e-b1e5-181e0593e592 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:49:16.214381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6ef32-19c4-4bf7-8754-bd12566fd8b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:49:16.215151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:49:16.215741 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6ef32-19c4-4bf7-8754-bd12566fd8b3 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:16.216188 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6ef32-19c4-4bf7-8754-bd12566fd8b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:16.216638 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6ef32-19c4-4bf7-8754-bd12566fd8b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:16.218426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-53a6ef32-19c4-4bf7-8754-bd12566fd8b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:49:16.333620 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6ef32-19c4-4bf7-8754-bd12566fd8b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:49:16.334994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6ef32-19c4-4bf7-8754-bd12566fd8b3 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:49:16.355161 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 746/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:49:18.610714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f8dce-b311-4e1a-bb51-8dde21d1637b None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:18.611289 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f8dce-b311-4e1a-bb51-8dde21d1637b None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:18.611289 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f8dce-b311-4e1a-bb51-8dde21d1637b None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:18.612669 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 742/1488] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:49:18.618446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83f370-cf8d-409a-a3e9-afdeac50f31f None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:18.618870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83f370-cf8d-409a-a3e9-afdeac50f31f None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:18.619002 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83f370-cf8d-409a-a3e9-afdeac50f31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:18.684043 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-9a83f370-cf8d-409a-a3e9-afdeac50f31f None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:49:18.685181 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-9a83f370-cf8d-409a-a3e9-afdeac50f31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:49:18.737608 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:49:18.781409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 747/1489] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:49:19.072486 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f8dce-b311-4e1a-bb51-8dde21d1637b None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:49:19.074022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d65f8dce-b311-4e1a-bb51-8dde21d1637b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:49:19.110385 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:49:19.186096 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f8dce-b311-4e1a-bb51-8dde21d1637b None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:49:19.259397 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18f651-c836-4549-bb7b-43dfe63640f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:49:19.260038 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18f651-c836-4549-bb7b-43dfe63640f1 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:19.260311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18f651-c836-4549-bb7b-43dfe63640f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:19.260579 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18f651-c836-4549-bb7b-43dfe63640f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:19.262168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-9e18f651-c836-4549-bb7b-43dfe63640f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:49:19.343133 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:49:19.372760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18f651-c836-4549-bb7b-43dfe63640f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:49:19.374204 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18f651-c836-4549-bb7b-43dfe63640f1 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:49:19.392596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 743/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:49:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:49:21.926199 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9c02b-7445-40ec-9578-0c173a60a77d None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:21.926662 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9c02b-7445-40ec-9578-0c173a60a77d None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:21.926761 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9c02b-7445-40ec-9578-0c173a60a77d None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:21.928118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 748/1491] 10.222.0.15 () {54 vars in 927 bytes} [Wed Sep 14 19:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:49:21.933783 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eafd28-92c7-4de3-90b3-b1fb95f8d4ee None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:21.934238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eafd28-92c7-4de3-90b3-b1fb95f8d4ee None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:21.934332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eafd28-92c7-4de3-90b3-b1fb95f8d4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:22.003678 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-b1eafd28-92c7-4de3-90b3-b1fb95f8d4ee None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:49:22.004891 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b1eafd28-92c7-4de3-90b3-b1fb95f8d4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:49:22.102820 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 744/1492] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Sep 14 19:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:49:22.392975 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9c02b-7445-40ec-9578-0c173a60a77d None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:49:22.394586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-45f9c02b-7445-40ec-9578-0c173a60a77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:49:22.501736 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9c02b-7445-40ec-9578-0c173a60a77d None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:49:22.574912 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768beb0-6386-424a-bf5c-1ead9d83caef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:49:22.575447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768beb0-6386-424a-bf5c-1ead9d83caef service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:49:22.575758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768beb0-6386-424a-bf5c-1ead9d83caef service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:49:22.576035 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768beb0-6386-424a-bf5c-1ead9d83caef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:49:22.577625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-9768beb0-6386-424a-bf5c-1ead9d83caef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:49:22.586009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:49:22.689554 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768beb0-6386-424a-bf5c-1ead9d83caef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:49:22.690995 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768beb0-6386-424a-bf5c-1ead9d83caef service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:49:22.709365 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 749/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:49:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:49:32.101268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=82 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:49:32.707068 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=50 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:52:05.151531 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d8374-fc32-4740-a960-d99ac69647c3 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:52:05.152134 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d8374-fc32-4740-a960-d99ac69647c3 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:52:05.152134 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d8374-fc32-4740-a960-d99ac69647c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:52:05.233959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-642d8374-fc32-4740-a960-d99ac69647c3 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:52:05.235418 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-642d8374-fc32-4740-a960-d99ac69647c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:52:05.336981 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 745/1494] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:52:05.344935 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e7cb0-f5de-4eff-8496-80c5f8779ffd None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:52:05.345404 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e7cb0-f5de-4eff-8496-80c5f8779ffd None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:52:05.345509 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e7cb0-f5de-4eff-8496-80c5f8779ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:52:05.368249 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-d99e7cb0-f5de-4eff-8496-80c5f8779ffd None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:52:05.369457 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-d99e7cb0-f5de-4eff-8496-80c5f8779ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:52:05.378004 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 750/1495] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:52:05.382602 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d8374-fc32-4740-a960-d99ac69647c3 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:52:05.392272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d8374-fc32-4740-a960-d99ac69647c3 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:52:05.396875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7a2ff-e1b9-4c36-a133-c949f5dfda25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:52:05.397470 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7a2ff-e1b9-4c36-a133-c949f5dfda25 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:52:05.397743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7a2ff-e1b9-4c36-a133-c949f5dfda25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:52:05.398010 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7a2ff-e1b9-4c36-a133-c949f5dfda25 admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:52:05.398646 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7a2ff-e1b9-4c36-a133-c949f5dfda25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:52:05.398946 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7a2ff-e1b9-4c36-a133-c949f5dfda25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:52:05.400018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: WARNING py.warnings [None req-90d7a2ff-e1b9-4c36-a133-c949f5dfda25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:52:05.400018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: warnings.warn(msg) Sep 14 19:52:05.400018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: Sep 14 19:52:05.400926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7a2ff-e1b9-4c36-a133-c949f5dfda25 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:52:05.412697 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 746/1496] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:52:05.420897 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e7cb0-f5de-4eff-8496-80c5f8779ffd None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:52:05.430811 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e7cb0-f5de-4eff-8496-80c5f8779ffd None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:52:05.435378 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee662e9f-5b82-40ca-b2f1-bf1a3f6c46d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:52:05.436035 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee662e9f-5b82-40ca-b2f1-bf1a3f6c46d0 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:52:05.436315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee662e9f-5b82-40ca-b2f1-bf1a3f6c46d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:52:05.436587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee662e9f-5b82-40ca-b2f1-bf1a3f6c46d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:52:05.437221 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee662e9f-5b82-40ca-b2f1-bf1a3f6c46d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:52:05.439022 dv-cinder-839768-8-smb devstack@keystone.service[93545]: WARNING py.warnings [None req-ee662e9f-5b82-40ca-b2f1-bf1a3f6c46d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:52:05.439022 dv-cinder-839768-8-smb devstack@keystone.service[93545]: warnings.warn(msg) Sep 14 19:52:05.439022 dv-cinder-839768-8-smb devstack@keystone.service[93545]: Sep 14 19:52:05.440242 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee662e9f-5b82-40ca-b2f1-bf1a3f6c46d0 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:52:05.582954 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 751/1497] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:52:05 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:52:05.588068 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7a2ff-e1b9-4c36-a133-c949f5dfda25 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:52:05.597893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7a2ff-e1b9-4c36-a133-c949f5dfda25 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:52:05.647907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:52:05.654671 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a632cde-f842-4386-9f96-250ac7869edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:52:05.659998 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a632cde-f842-4386-9f96-250ac7869edf admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:52:05.659998 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a632cde-f842-4386-9f96-250ac7869edf admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:52:05.659998 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a632cde-f842-4386-9f96-250ac7869edf admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:52:05.659998 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a632cde-f842-4386-9f96-250ac7869edf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:52:05.659998 dv-cinder-839768-8-smb devstack@keystone.service[93544]: WARNING py.warnings [None req-3a632cde-f842-4386-9f96-250ac7869edf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:52:05.659998 dv-cinder-839768-8-smb devstack@keystone.service[93544]: warnings.warn(msg) Sep 14 19:52:05.659998 dv-cinder-839768-8-smb devstack@keystone.service[93544]: Sep 14 19:52:05.660553 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a632cde-f842-4386-9f96-250ac7869edf admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:52:05.741506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 747/1498] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:52:05 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:52:05.745614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee662e9f-5b82-40ca-b2f1-bf1a3f6c46d0 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:52:05.755783 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee662e9f-5b82-40ca-b2f1-bf1a3f6c46d0 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:52:05.760636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b1133-7438-4337-8d68-7774a2d73944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:52:05.761244 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b1133-7438-4337-8d68-7774a2d73944 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:52:05.761521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b1133-7438-4337-8d68-7774a2d73944 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:52:05.761794 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b1133-7438-4337-8d68-7774a2d73944 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:52:05.762501 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b1133-7438-4337-8d68-7774a2d73944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:52:05.763519 dv-cinder-839768-8-smb devstack@keystone.service[93545]: WARNING py.warnings [None req-138b1133-7438-4337-8d68-7774a2d73944 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:52:05.763519 dv-cinder-839768-8-smb devstack@keystone.service[93545]: warnings.warn(msg) Sep 14 19:52:05.763519 dv-cinder-839768-8-smb devstack@keystone.service[93545]: Sep 14 19:52:05.764436 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b1133-7438-4337-8d68-7774a2d73944 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:52:05.778098 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 752/1499] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:52:05.782064 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a632cde-f842-4386-9f96-250ac7869edf admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:52:05.793117 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a632cde-f842-4386-9f96-250ac7869edf admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:52:05.797666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e10c72-33ce-4d12-8606-76d9060b6c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:52:05.798294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e10c72-33ce-4d12-8606-76d9060b6c13 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:52:05.798571 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e10c72-33ce-4d12-8606-76d9060b6c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:52:05.798842 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e10c72-33ce-4d12-8606-76d9060b6c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:52:05.799480 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e10c72-33ce-4d12-8606-76d9060b6c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:52:05.800511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: WARNING py.warnings [None req-f0e10c72-33ce-4d12-8606-76d9060b6c13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:52:05.800511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: warnings.warn(msg) Sep 14 19:52:05.800511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: Sep 14 19:52:05.801386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e10c72-33ce-4d12-8606-76d9060b6c13 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:52:05.816210 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 748/1500] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:52:05.820553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b1133-7438-4337-8d68-7774a2d73944 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:52:05.830496 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b1133-7438-4337-8d68-7774a2d73944 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:52:05.835647 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac04bc7-120c-4712-bce3-b0cd4b87c718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:52:05.836288 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac04bc7-120c-4712-bce3-b0cd4b87c718 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:52:05.836568 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac04bc7-120c-4712-bce3-b0cd4b87c718 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:52:05.836843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac04bc7-120c-4712-bce3-b0cd4b87c718 admin admin] PATH_INFO: `/v3/projects/38f721c97b95492495ec6dc0800973f9/users/da6f65d2272441f08f17202a4ce644aa/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:52:05.851681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac04bc7-120c-4712-bce3-b0cd4b87c718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f721c97b95492495ec6dc0800973f9, user_id=da6f65d2272441f08f17202a4ce644aa, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:52:05.852649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: WARNING py.warnings [None req-fac04bc7-120c-4712-bce3-b0cd4b87c718 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:52:05.852649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: warnings.warn(msg) Sep 14 19:52:05.852649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: Sep 14 19:52:05.854588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac04bc7-120c-4712-bce3-b0cd4b87c718 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:52:05.913641 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 753/1501] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:52:05 2022] PUT /identity/v3/projects/38f721c97b95492495ec6dc0800973f9/users/da6f65d2272441f08f17202a4ce644aa/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:52:05.926009 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539c570-d51e-4aea-996f-78e210aabb58 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:52:05.926291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539c570-d51e-4aea-996f-78e210aabb58 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:52:05.926564 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539c570-d51e-4aea-996f-78e210aabb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:52:05.954852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-e539c570-d51e-4aea-996f-78e210aabb58 None None] MFA Rules not processed for user `da6f65d2272441f08f17202a4ce644aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:52:05.956077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e539c570-d51e-4aea-996f-78e210aabb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:52:06.019456 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 749/1502] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:52:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:52:06.033444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ab79d-93bd-440e-bf37-011e59305085 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:52:06.033728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ab79d-93bd-440e-bf37-011e59305085 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:52:06.034011 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ab79d-93bd-440e-bf37-011e59305085 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:52:06.035364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 754/1503] 10.222.0.15 () {54 vars in 964 bytes} [Wed Sep 14 19:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:52:06.040316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249f41a-b697-4c88-ac53-d9c632d31a98 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:52:06.043533 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249f41a-b697-4c88-ac53-d9c632d31a98 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:52:06.043533 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249f41a-b697-4c88-ac53-d9c632d31a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:52:06.101969 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-3249f41a-b697-4c88-ac53-d9c632d31a98 None None] MFA Rules not processed for user `fe18c9b67d814fbba4614cf7491e136e`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:52:06.103095 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3249f41a-b697-4c88-ac53-d9c632d31a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:52:06.177242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 750/1504] 10.222.0.15 () {58 vars in 1061 bytes} [Wed Sep 14 19:52:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:52:06.184982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ab79d-93bd-440e-bf37-011e59305085 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:52:06.196063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ab79d-93bd-440e-bf37-011e59305085 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:52:06.199623 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751a668-cc6e-4d44-b9a3-7e032db12c40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:52:06.203512 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751a668-cc6e-4d44-b9a3-7e032db12c40 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:52:06.203512 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751a668-cc6e-4d44-b9a3-7e032db12c40 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:52:06.203512 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751a668-cc6e-4d44-b9a3-7e032db12c40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:52:06.208933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751a668-cc6e-4d44-b9a3-7e032db12c40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:52:06.211375 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751a668-cc6e-4d44-b9a3-7e032db12c40 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:52:06.220656 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 755/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:52:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:52:06.265673 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8497e0-a3a5-43ee-8321-41977d0de935 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:52:06.265959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8497e0-a3a5-43ee-8321-41977d0de935 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:52:06.266238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8497e0-a3a5-43ee-8321-41977d0de935 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:52:06.267491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 751/1506] 10.222.0.15 () {52 vars in 830 bytes} [Wed Sep 14 19:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:52:06.271187 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751a668-cc6e-4d44-b9a3-7e032db12c40 service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:52:06.333921 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751a668-cc6e-4d44-b9a3-7e032db12c40 service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:52:06.338577 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685be82c-65c2-4f53-a9da-475d2a3fc62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:52:06.339206 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685be82c-65c2-4f53-a9da-475d2a3fc62b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:52:06.339479 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685be82c-65c2-4f53-a9da-475d2a3fc62b admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:52:06.339776 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685be82c-65c2-4f53-a9da-475d2a3fc62b admin admin] PATH_INFO: `/v3/users/da6f65d2272441f08f17202a4ce644aa` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:52:06.340901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685be82c-65c2-4f53-a9da-475d2a3fc62b admin admin] RBAC: Authorizing `identity:delete_user(user_id=da6f65d2272441f08f17202a4ce644aa)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:52:06.341901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: WARNING py.warnings [None req-685be82c-65c2-4f53-a9da-475d2a3fc62b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:52:06.341901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: warnings.warn(msg) Sep 14 19:52:06.341901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: Sep 14 19:52:06.343094 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685be82c-65c2-4f53-a9da-475d2a3fc62b admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:52:06.529624 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-685be82c-65c2-4f53-a9da-475d2a3fc62b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da6f65d2272441f08f17202a4ce644aa'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:52:06.587447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-685be82c-65c2-4f53-a9da-475d2a3fc62b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da6f65d2272441f08f17202a4ce644aa'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:52:06.588140 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-685be82c-65c2-4f53-a9da-475d2a3fc62b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da6f65d2272441f08f17202a4ce644aa'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:52:06.612375 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-685be82c-65c2-4f53-a9da-475d2a3fc62b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da6f65d2272441f08f17202a4ce644aa'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:52:06.623160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:52:06.627644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-685be82c-65c2-4f53-a9da-475d2a3fc62b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da6f65d2272441f08f17202a4ce644aa'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:52:06.634371 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 756/1507] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:52:06 2022] DELETE /identity/v3/users/da6f65d2272441f08f17202a4ce644aa => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:52:06.639052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e175d7-8fee-4102-9d32-337829c9c149 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:52:06.639340 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e175d7-8fee-4102-9d32-337829c9c149 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:52:06.639658 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e175d7-8fee-4102-9d32-337829c9c149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:52:06.658852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-31e175d7-8fee-4102-9d32-337829c9c149 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:52:06.660106 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-31e175d7-8fee-4102-9d32-337829c9c149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:52:06.669740 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:52:06.719020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 752/1508] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:52:06.729503 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685be82c-65c2-4f53-a9da-475d2a3fc62b admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:52:06.731404 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-685be82c-65c2-4f53-a9da-475d2a3fc62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:52:06.808607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685be82c-65c2-4f53-a9da-475d2a3fc62b admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:52:06.812376 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7714c-97f6-41c3-9d74-a3fa60e091a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:52:06.812993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7714c-97f6-41c3-9d74-a3fa60e091a0 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:52:06.813275 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7714c-97f6-41c3-9d74-a3fa60e091a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:52:06.813550 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7714c-97f6-41c3-9d74-a3fa60e091a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:52:06.822560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7714c-97f6-41c3-9d74-a3fa60e091a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:52:06.824034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7714c-97f6-41c3-9d74-a3fa60e091a0 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:52:06.833501 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 757/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:52:07.360746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e175d7-8fee-4102-9d32-337829c9c149 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:52:07.362255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-31e175d7-8fee-4102-9d32-337829c9c149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:52:07.375016 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e175d7-8fee-4102-9d32-337829c9c149 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:52:07.381889 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4966cd0-a9c7-4268-bb95-154d792f08f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:52:07.385208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4966cd0-a9c7-4268-bb95-154d792f08f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:52:07.385208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4966cd0-a9c7-4268-bb95-154d792f08f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:52:07.385208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4966cd0-a9c7-4268-bb95-154d792f08f0 admin admin] PATH_INFO: `/v3/projects/38f721c97b95492495ec6dc0800973f9` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:52:07.385208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4966cd0-a9c7-4268-bb95-154d792f08f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38f721c97b95492495ec6dc0800973f9)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:52:07.385208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: WARNING py.warnings [None req-c4966cd0-a9c7-4268-bb95-154d792f08f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:52:07.385208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: warnings.warn(msg) Sep 14 19:52:07.385208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: Sep 14 19:52:07.386398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4966cd0-a9c7-4268-bb95-154d792f08f0 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:52:07.535231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c4966cd0-a9c7-4268-bb95-154d792f08f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38f721c97b95492495ec6dc0800973f9', 'request_id': 'req-c4966cd0-a9c7-4268-bb95-154d792f08f0'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:52:07.598276 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c4966cd0-a9c7-4268-bb95-154d792f08f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38f721c97b95492495ec6dc0800973f9', 'request_id': 'req-c4966cd0-a9c7-4268-bb95-154d792f08f0'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:52:07.605198 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c4966cd0-a9c7-4268-bb95-154d792f08f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38f721c97b95492495ec6dc0800973f9', 'request_id': 'req-c4966cd0-a9c7-4268-bb95-154d792f08f0'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:52:07.623630 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c4966cd0-a9c7-4268-bb95-154d792f08f0 admin admin] The token cache is being invalidate because project 38f721c97b95492495ec6dc0800973f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:52:07.623946 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c4966cd0-a9c7-4268-bb95-154d792f08f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:52:07.624581 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c4966cd0-a9c7-4268-bb95-154d792f08f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:52:07.626227 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 753/1510] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:52:07 2022] DELETE /identity/v3/projects/38f721c97b95492495ec6dc0800973f9 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:52:16.829357 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=38 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:52:17.620730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:53:43.066547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038cbac-1c98-4f1f-a92b-d81bc87ba1d6 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:53:43.067009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038cbac-1c98-4f1f-a92b-d81bc87ba1d6 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:53:43.067115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038cbac-1c98-4f1f-a92b-d81bc87ba1d6 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:53:43.068509 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 19:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:53:43.073468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbf1a8-419e-407b-b19d-1acfe311a953 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:53:43.073903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbf1a8-419e-407b-b19d-1acfe311a953 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:53:43.074029 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbf1a8-419e-407b-b19d-1acfe311a953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:53:43.095343 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-0ddbf1a8-419e-407b-b19d-1acfe311a953 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:53:43.096606 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0ddbf1a8-419e-407b-b19d-1acfe311a953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:53:43.153997 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 19:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:53:43.308877 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038cbac-1c98-4f1f-a92b-d81bc87ba1d6 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:53:43.313609 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-7038cbac-1c98-4f1f-a92b-d81bc87ba1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:53:43.417234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038cbac-1c98-4f1f-a92b-d81bc87ba1d6 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:53:43.422752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc885f2-c2b3-49e8-93b1-c4d39a71aaee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:53:43.423357 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc885f2-c2b3-49e8-93b1-c4d39a71aaee service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:53:43.423660 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc885f2-c2b3-49e8-93b1-c4d39a71aaee service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:53:43.423931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc885f2-c2b3-49e8-93b1-c4d39a71aaee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:53:43.432728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc885f2-c2b3-49e8-93b1-c4d39a71aaee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:53:43.434320 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc885f2-c2b3-49e8-93b1-c4d39a71aaee service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:53:43.444090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 759/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:53:44.518713 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ba2ad-7988-47d7-beb4-d687eb4cbb37 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:53:44.519341 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ba2ad-7988-47d7-beb4-d687eb4cbb37 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:53:44.519341 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ba2ad-7988-47d7-beb4-d687eb4cbb37 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:53:44.520614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 19:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:53:44.527173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13334dce-fd9c-4064-ba55-386392485074 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:53:44.527668 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13334dce-fd9c-4064-ba55-386392485074 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:53:44.527781 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13334dce-fd9c-4064-ba55-386392485074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:53:44.547184 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-13334dce-fd9c-4064-ba55-386392485074 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:53:44.548418 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-13334dce-fd9c-4064-ba55-386392485074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:53:44.556837 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 19:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:53:44.714382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ba2ad-7988-47d7-beb4-d687eb4cbb37 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:53:44.729804 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ba2ad-7988-47d7-beb4-d687eb4cbb37 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:53:44.735080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913b771-764d-4b9c-8481-53ab91d18fb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:53:44.736156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913b771-764d-4b9c-8481-53ab91d18fb3 service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:53:44.736156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913b771-764d-4b9c-8481-53ab91d18fb3 service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:53:44.736452 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913b771-764d-4b9c-8481-53ab91d18fb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:53:44.744840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913b771-764d-4b9c-8481-53ab91d18fb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:53:44.746435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913b771-764d-4b9c-8481-53ab91d18fb3 service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:53:44.755718 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 756/1516] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:53:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:53:44.882574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea85f0-f1d3-45d0-99ea-501ba9fdc65a None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:53:44.882849 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea85f0-f1d3-45d0-99ea-501ba9fdc65a None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:53:44.883119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea85f0-f1d3-45d0-99ea-501ba9fdc65a None None] PATH_INFO: `/v3` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:53:44.884446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 761/1517] 10.222.0.33 () {54 vars in 925 bytes} [Wed Sep 14 19:53:44 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:53:44.913685 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc0ce9-7360-4f1d-a110-e858603138e3 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:53:44.913971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc0ce9-7360-4f1d-a110-e858603138e3 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:53:44.914334 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc0ce9-7360-4f1d-a110-e858603138e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:53:44.964643 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-1cbc0ce9-7360-4f1d-a110-e858603138e3 None None] MFA Rules not processed for user `6942a851a69b446e90a2b138f4482465`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:53:44.965782 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1cbc0ce9-7360-4f1d-a110-e858603138e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:53:45.039791 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 757/1518] 10.222.0.33 () {58 vars in 1015 bytes} [Wed Sep 14 19:53:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:53:48.877093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b34cd-1061-45d7-907e-067f8a91e681 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:53:48.877615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b34cd-1061-45d7-907e-067f8a91e681 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:53:48.877722 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b34cd-1061-45d7-907e-067f8a91e681 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:53:48.878961 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 762/1519] 10.222.0.15 () {54 vars in 961 bytes} [Wed Sep 14 19:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:53:48.884659 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2b60a-8e18-4a52-b535-092c6b2e26b1 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:53:48.885118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2b60a-8e18-4a52-b535-092c6b2e26b1 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:53:48.885221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2b60a-8e18-4a52-b535-092c6b2e26b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:53:48.904552 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-27c2b60a-8e18-4a52-b535-092c6b2e26b1 None None] MFA Rules not processed for user `6942a851a69b446e90a2b138f4482465`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:53:48.905754 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-27c2b60a-8e18-4a52-b535-092c6b2e26b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:53:48.914296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 758/1520] 10.222.0.15 () {58 vars in 1058 bytes} [Wed Sep 14 19:53:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:53:48.921804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b34cd-1061-45d7-907e-067f8a91e681 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:53:48.935817 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b34cd-1061-45d7-907e-067f8a91e681 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:53:48.940803 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdfa5b-4ee3-4121-8038-1d13ae1d74ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6942a851a69b446e90a2b138f4482465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:53:48.941397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdfa5b-4ee3-4121-8038-1d13ae1d74ce service placement] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:53:48.941681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdfa5b-4ee3-4121-8038-1d13ae1d74ce service placement] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:53:48.941956 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdfa5b-4ee3-4121-8038-1d13ae1d74ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:53:48.950998 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfdfa5b-4ee3-4121-8038-1d13ae1d74ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:53:48.952621 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfdfa5b-4ee3-4121-8038-1d13ae1d74ce service placement] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:53:48.962380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 763/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:53:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:53:56.244669 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6824f-3c01-48ed-b8e0-88552820f581 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:53:56.245242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6824f-3c01-48ed-b8e0-88552820f581 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:53:56.245242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6824f-3c01-48ed-b8e0-88552820f581 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:53:56.246734 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 19:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:53:56.252795 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f66833-f43b-48ce-88e3-3ea1fbf705b2 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:53:56.253222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f66833-f43b-48ce-88e3-3ea1fbf705b2 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:53:56.253337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f66833-f43b-48ce-88e3-3ea1fbf705b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:53:56.273471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-18f66833-f43b-48ce-88e3-3ea1fbf705b2 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:53:56.274588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-18f66833-f43b-48ce-88e3-3ea1fbf705b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:53:56.282392 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 19:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:53:56.444293 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6824f-3c01-48ed-b8e0-88552820f581 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:53:56.458645 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6824f-3c01-48ed-b8e0-88552820f581 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:53:56.464767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a8f9b-63a0-4003-9cfd-ced24cc04abd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:53:56.465364 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8f9b-63a0-4003-9cfd-ced24cc04abd service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:53:56.465641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8f9b-63a0-4003-9cfd-ced24cc04abd service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:53:56.465917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8f9b-63a0-4003-9cfd-ced24cc04abd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:53:56.474047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a8f9b-63a0-4003-9cfd-ced24cc04abd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:53:56.476343 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a8f9b-63a0-4003-9cfd-ced24cc04abd service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:53:56.486162 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 760/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:53:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:53:57.603611 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbc6c4-167f-4c41-a7fc-a29aeb12db3e None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:53:57.604174 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbc6c4-167f-4c41-a7fc-a29aeb12db3e None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:53:57.604174 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbc6c4-167f-4c41-a7fc-a29aeb12db3e None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:53:57.605496 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 19:53:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:53:57.611682 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc6150-b792-487b-82f4-c078b631c2a6 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:53:57.612068 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc6150-b792-487b-82f4-c078b631c2a6 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:53:57.612234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc6150-b792-487b-82f4-c078b631c2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:53:57.632233 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-fecc6150-b792-487b-82f4-c078b631c2a6 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:53:57.633368 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-fecc6150-b792-487b-82f4-c078b631c2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:53:57.641189 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 19:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:53:57.796957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbc6c4-167f-4c41-a7fc-a29aeb12db3e None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:53:57.812267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbc6c4-167f-4c41-a7fc-a29aeb12db3e None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:53:57.817701 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14516ed5-5bc1-4890-8d3d-5e733b3491ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:53:57.818299 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14516ed5-5bc1-4890-8d3d-5e733b3491ef service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:53:57.818577 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14516ed5-5bc1-4890-8d3d-5e733b3491ef service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:53:57.818848 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14516ed5-5bc1-4890-8d3d-5e733b3491ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:53:57.827293 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14516ed5-5bc1-4890-8d3d-5e733b3491ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:53:57.828885 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14516ed5-5bc1-4890-8d3d-5e733b3491ef service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:53:57.839092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 766/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:53:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:54:01.938221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681eab4-c58e-411c-b771-51ab31879140 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:54:01.938751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681eab4-c58e-411c-b771-51ab31879140 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:54:01.938751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681eab4-c58e-411c-b771-51ab31879140 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:54:01.940057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 19:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:54:01.946057 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072efdd-404f-4d0a-9db3-c0875c03d364 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:54:01.947928 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072efdd-404f-4d0a-9db3-c0875c03d364 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:54:01.947928 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072efdd-404f-4d0a-9db3-c0875c03d364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:54:01.966702 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-f072efdd-404f-4d0a-9db3-c0875c03d364 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:54:01.967914 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f072efdd-404f-4d0a-9db3-c0875c03d364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:54:01.976045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 19:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:54:02.273320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681eab4-c58e-411c-b771-51ab31879140 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:54:02.275163 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e681eab4-c58e-411c-b771-51ab31879140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:54:02.302944 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:54:02.333733 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681eab4-c58e-411c-b771-51ab31879140 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:54:02.337398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2624de-ee90-42b3-8bde-343a9cbb8391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:54:02.338014 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2624de-ee90-42b3-8bde-343a9cbb8391 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:54:02.338294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2624de-ee90-42b3-8bde-343a9cbb8391 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:54:02.338568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2624de-ee90-42b3-8bde-343a9cbb8391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:54:02.347368 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2624de-ee90-42b3-8bde-343a9cbb8391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:54:02.348843 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2624de-ee90-42b3-8bde-343a9cbb8391 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:54:02.358538 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 763/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:54:04.513107 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959be2ec-24ed-4d14-8b62-d8d52e8140f4 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:54:04.513669 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959be2ec-24ed-4d14-8b62-d8d52e8140f4 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:54:04.513669 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959be2ec-24ed-4d14-8b62-d8d52e8140f4 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:54:04.515011 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 19:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:54:04.520101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e121fde-e41f-4e93-984d-551f3efa45fa None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:54:04.520483 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e121fde-e41f-4e93-984d-551f3efa45fa None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:54:04.520648 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e121fde-e41f-4e93-984d-551f3efa45fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:54:04.540906 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-4e121fde-e41f-4e93-984d-551f3efa45fa None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:54:04.542114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-4e121fde-e41f-4e93-984d-551f3efa45fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:54:04.549999 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 19:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:54:04.844795 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959be2ec-24ed-4d14-8b62-d8d52e8140f4 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:54:04.846679 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-959be2ec-24ed-4d14-8b62-d8d52e8140f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:54:04.861442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959be2ec-24ed-4d14-8b62-d8d52e8140f4 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:54:04.865035 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc0b84-132f-4676-87b5-cc60e6c31e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:54:04.865719 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc0b84-132f-4676-87b5-cc60e6c31e2a service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:54:04.865991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc0b84-132f-4676-87b5-cc60e6c31e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:54:04.866259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc0b84-132f-4676-87b5-cc60e6c31e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:54:04.875395 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc0b84-132f-4676-87b5-cc60e6c31e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:54:04.876843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc0b84-132f-4676-87b5-cc60e6c31e2a service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:54:04.886432 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 769/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:54:09.004422 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ca172-0f02-4fa7-9e26-b58b942fecf5 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:54:09.004972 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ca172-0f02-4fa7-9e26-b58b942fecf5 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:54:09.004972 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ca172-0f02-4fa7-9e26-b58b942fecf5 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:54:09.006306 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 19:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:54:09.012752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da5409-6570-42e2-8f8c-fcecbde37651 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:54:09.013171 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da5409-6570-42e2-8f8c-fcecbde37651 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:54:09.013303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da5409-6570-42e2-8f8c-fcecbde37651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:54:09.020830 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=74 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:54:09.033725 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-a4da5409-6570-42e2-8f8c-fcecbde37651 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:54:09.034900 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a4da5409-6570-42e2-8f8c-fcecbde37651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:54:09.042964 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 19:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:54:09.344279 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ca172-0f02-4fa7-9e26-b58b942fecf5 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:54:09.346002 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ff3ca172-0f02-4fa7-9e26-b58b942fecf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:54:09.405014 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ca172-0f02-4fa7-9e26-b58b942fecf5 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:54:09.408566 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cd183-2cb6-43ca-bd73-bf8c96d4ce6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:54:09.409178 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cd183-2cb6-43ca-bd73-bf8c96d4ce6b service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:54:09.409460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cd183-2cb6-43ca-bd73-bf8c96d4ce6b service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:54:09.409736 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cd183-2cb6-43ca-bd73-bf8c96d4ce6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:54:09.419652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7cd183-2cb6-43ca-bd73-bf8c96d4ce6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:54:09.421096 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7cd183-2cb6-43ca-bd73-bf8c96d4ce6b service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:54:09.431199 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 766/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:54:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:54:11.570398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926e3c1-c4d7-4fba-bbc6-5aee0e0d62f8 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:54:11.570968 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926e3c1-c4d7-4fba-bbc6-5aee0e0d62f8 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:54:11.570968 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926e3c1-c4d7-4fba-bbc6-5aee0e0d62f8 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:54:11.572361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 19:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:54:11.577624 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f831202-b81a-4bfe-8da0-b0b15adf58c5 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:54:11.578029 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f831202-b81a-4bfe-8da0-b0b15adf58c5 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:54:11.578162 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f831202-b81a-4bfe-8da0-b0b15adf58c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:54:11.598383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-8f831202-b81a-4bfe-8da0-b0b15adf58c5 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:54:11.599716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-8f831202-b81a-4bfe-8da0-b0b15adf58c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:54:11.608879 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 19:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:54:11.920882 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926e3c1-c4d7-4fba-bbc6-5aee0e0d62f8 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:54:11.922599 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-7926e3c1-c4d7-4fba-bbc6-5aee0e0d62f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:54:11.935769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926e3c1-c4d7-4fba-bbc6-5aee0e0d62f8 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:54:11.939237 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93ecad-1a05-42f2-8242-b52bf150d29f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:54:11.939880 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93ecad-1a05-42f2-8242-b52bf150d29f service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:54:11.940208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93ecad-1a05-42f2-8242-b52bf150d29f service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:54:11.940482 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93ecad-1a05-42f2-8242-b52bf150d29f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:54:11.949924 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93ecad-1a05-42f2-8242-b52bf150d29f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:54:11.951350 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93ecad-1a05-42f2-8242-b52bf150d29f service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:54:11.962044 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 772/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:54:21.592727 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=47 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:54:21.957099 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=8 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:41.780677 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a14c7-d4ca-443e-b297-728a46889450 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:41.781370 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a14c7-d4ca-443e-b297-728a46889450 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:41.781370 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a14c7-d4ca-443e-b297-728a46889450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:41.804984 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-bf1a14c7-d4ca-443e-b297-728a46889450 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:41.806269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-bf1a14c7-d4ca-443e-b297-728a46889450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:41.815814 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 768/1540] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:41.824931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d40fd3-dbd2-49ea-9cf0-50dd4ddeb417 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:41.826218 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d40fd3-dbd2-49ea-9cf0-50dd4ddeb417 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:41.826218 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d40fd3-dbd2-49ea-9cf0-50dd4ddeb417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:41.858719 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-25d40fd3-dbd2-49ea-9cf0-50dd4ddeb417 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:41.860661 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-25d40fd3-dbd2-49ea-9cf0-50dd4ddeb417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:41.876249 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 773/1541] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:41.881532 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a14c7-d4ca-443e-b297-728a46889450 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:41.898154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a14c7-d4ca-443e-b297-728a46889450 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:41.912946 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082f163-7a96-401c-abb8-1532c8c212ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:41.913748 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082f163-7a96-401c-abb8-1532c8c212ef admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:41.914026 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082f163-7a96-401c-abb8-1532c8c212ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:41.914298 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082f163-7a96-401c-abb8-1532c8c212ef admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:41.914970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082f163-7a96-401c-abb8-1532c8c212ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:55:41.915271 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082f163-7a96-401c-abb8-1532c8c212ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:41.917113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082f163-7a96-401c-abb8-1532c8c212ef admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:41.932408 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 769/1542] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:55:41.933905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aaf97c-e215-4052-a260-674d6e708f13 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:41.934440 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aaf97c-e215-4052-a260-674d6e708f13 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:41.934912 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aaf97c-e215-4052-a260-674d6e708f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:41.951869 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082f163-7a96-401c-abb8-1532c8c212ef admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:41.973803 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-98aaf97c-e215-4052-a260-674d6e708f13 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:41.975968 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082f163-7a96-401c-abb8-1532c8c212ef admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:41.986838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-98aaf97c-e215-4052-a260-674d6e708f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:41.987008 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db54e86-f91c-4a4c-b494-cb473e715a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:41.987008 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db54e86-f91c-4a4c-b494-cb473e715a98 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:41.987008 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db54e86-f91c-4a4c-b494-cb473e715a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:41.987008 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db54e86-f91c-4a4c-b494-cb473e715a98 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:41.987372 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db54e86-f91c-4a4c-b494-cb473e715a98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:41.987372 dv-cinder-839768-8-smb devstack@keystone.service[93544]: WARNING py.warnings [None req-3db54e86-f91c-4a4c-b494-cb473e715a98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:55:41.987372 dv-cinder-839768-8-smb devstack@keystone.service[93544]: warnings.warn(msg) Sep 14 19:55:41.987372 dv-cinder-839768-8-smb devstack@keystone.service[93544]: Sep 14 19:55:41.988515 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db54e86-f91c-4a4c-b494-cb473e715a98 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:41.992115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 774/1543] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:55:42.000900 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e04d54-a8f8-4312-8179-b46e115b935d None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.001498 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e04d54-a8f8-4312-8179-b46e115b935d None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.001968 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e04d54-a8f8-4312-8179-b46e115b935d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.032266 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-52e04d54-a8f8-4312-8179-b46e115b935d None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:42.033922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-52e04d54-a8f8-4312-8179-b46e115b935d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:42.050776 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 775/1544] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:42.067488 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e04d54-a8f8-4312-8179-b46e115b935d None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:42.078174 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e04d54-a8f8-4312-8179-b46e115b935d None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:42.095142 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93982ef9-98fb-4271-bc20-b50a92db1710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:42.096797 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93982ef9-98fb-4271-bc20-b50a92db1710 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.097286 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93982ef9-98fb-4271-bc20-b50a92db1710 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.097756 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93982ef9-98fb-4271-bc20-b50a92db1710 admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.098593 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93982ef9-98fb-4271-bc20-b50a92db1710 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:55:42.099198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93982ef9-98fb-4271-bc20-b50a92db1710 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:42.100567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: WARNING py.warnings [None req-93982ef9-98fb-4271-bc20-b50a92db1710 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:55:42.100567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: warnings.warn(msg) Sep 14 19:55:42.100567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: Sep 14 19:55:42.106409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93982ef9-98fb-4271-bc20-b50a92db1710 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:42.120605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 776/1545] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:55:42.129722 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93982ef9-98fb-4271-bc20-b50a92db1710 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:42.141213 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93982ef9-98fb-4271-bc20-b50a92db1710 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:42.152964 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee250599-54e0-45fc-84c6-b59b6f3e78d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:42.155354 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee250599-54e0-45fc-84c6-b59b6f3e78d6 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.155354 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee250599-54e0-45fc-84c6-b59b6f3e78d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.155354 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee250599-54e0-45fc-84c6-b59b6f3e78d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.155980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee250599-54e0-45fc-84c6-b59b6f3e78d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:42.158261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee250599-54e0-45fc-84c6-b59b6f3e78d6 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:42.166672 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 770/1546] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:55:41 2022] POST /identity/v3/projects => generated 405 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:55:42.171213 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db54e86-f91c-4a4c-b494-cb473e715a98 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:42.281527 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db54e86-f91c-4a4c-b494-cb473e715a98 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:42.295556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53428239-f659-415a-8270-dc6db6738e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:42.295556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53428239-f659-415a-8270-dc6db6738e51 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.295556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53428239-f659-415a-8270-dc6db6738e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.295556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53428239-f659-415a-8270-dc6db6738e51 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.296033 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53428239-f659-415a-8270-dc6db6738e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:42.296033 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53428239-f659-415a-8270-dc6db6738e51 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:42.331615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 777/1547] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:55:42 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:55:42.334132 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050da53-9af1-4dba-8746-ee564ed339fc None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.334783 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050da53-9af1-4dba-8746-ee564ed339fc None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.339821 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050da53-9af1-4dba-8746-ee564ed339fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.369882 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-9050da53-9af1-4dba-8746-ee564ed339fc None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:42.370106 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-9050da53-9af1-4dba-8746-ee564ed339fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:42.460148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 771/1548] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:55:42 2022] POST /identity/v3/users => generated 303 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:55:42.461016 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53428239-f659-415a-8270-dc6db6738e51 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:42.465151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 778/1549] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:42.466661 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f19025-42c9-49a9-ae39-105520fe13ab None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.466954 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f19025-42c9-49a9-ae39-105520fe13ab None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.467231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f19025-42c9-49a9-ae39-105520fe13ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.483185 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53428239-f659-415a-8270-dc6db6738e51 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:42.500240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-34f19025-42c9-49a9-ae39-105520fe13ab None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:42.501448 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-34f19025-42c9-49a9-ae39-105520fe13ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:42.503585 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0efb6-e191-4334-bc5b-2028b6598c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:42.504208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0efb6-e191-4334-bc5b-2028b6598c7e admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.504483 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0efb6-e191-4334-bc5b-2028b6598c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.504744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0efb6-e191-4334-bc5b-2028b6598c7e admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.505903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0efb6-e191-4334-bc5b-2028b6598c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:42.507987 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0efb6-e191-4334-bc5b-2028b6598c7e admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:42.524216 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 779/1550] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:42.525065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f19025-42c9-49a9-ae39-105520fe13ab None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:42.538724 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f19025-42c9-49a9-ae39-105520fe13ab None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:42.544446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb159f-9910-4623-abd8-6e19f324bf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:42.545318 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb159f-9910-4623-abd8-6e19f324bf59 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.545658 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb159f-9910-4623-abd8-6e19f324bf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.545882 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb159f-9910-4623-abd8-6e19f324bf59 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.546584 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb159f-9910-4623-abd8-6e19f324bf59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:42.548247 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb159f-9910-4623-abd8-6e19f324bf59 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:42.562235 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 780/1551] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:42.563675 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba898266-0c85-44d7-b253-874eb207511d None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.564127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba898266-0c85-44d7-b253-874eb207511d None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.564430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba898266-0c85-44d7-b253-874eb207511d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.587284 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-ba898266-0c85-44d7-b253-874eb207511d None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:42.588548 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ba898266-0c85-44d7-b253-874eb207511d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:42.601103 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 781/1552] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:42.602926 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a53c80-3903-4bb2-92b1-9b21a2ebf559 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.603217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a53c80-3903-4bb2-92b1-9b21a2ebf559 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.603494 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a53c80-3903-4bb2-92b1-9b21a2ebf559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.625195 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-65a53c80-3903-4bb2-92b1-9b21a2ebf559 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:42.626505 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-65a53c80-3903-4bb2-92b1-9b21a2ebf559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:42.635683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 782/1553] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:42.637067 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6fa44-a990-4f02-bd23-c502b56a4831 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.637344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6fa44-a990-4f02-bd23-c502b56a4831 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.637612 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6fa44-a990-4f02-bd23-c502b56a4831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.638300 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 772/1554] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:55:42 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:42.641581 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0efb6-e191-4334-bc5b-2028b6598c7e admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:42.657437 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0efb6-e191-4334-bc5b-2028b6598c7e admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:42.664254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fd7f1-1b6e-4862-bdbc-4df629c4325b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:42.664875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fd7f1-1b6e-4862-bdbc-4df629c4325b admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.665145 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fd7f1-1b6e-4862-bdbc-4df629c4325b admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.665644 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fd7f1-1b6e-4862-bdbc-4df629c4325b admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.666085 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-9dd6fa44-a990-4f02-bd23-c502b56a4831 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:42.666343 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fd7f1-1b6e-4862-bdbc-4df629c4325b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:42.667449 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-9dd6fa44-a990-4f02-bd23-c502b56a4831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:42.668269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fd7f1-1b6e-4862-bdbc-4df629c4325b admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:42.676043 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 783/1555] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:42.677723 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23126b2d-db9c-45a9-91b7-7504903cecf7 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.678098 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23126b2d-db9c-45a9-91b7-7504903cecf7 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.678494 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23126b2d-db9c-45a9-91b7-7504903cecf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.680116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 773/1556] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:42.680960 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fd7f1-1b6e-4862-bdbc-4df629c4325b admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:42.690662 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fd7f1-1b6e-4862-bdbc-4df629c4325b admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:42.695926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744d181-f854-488a-b267-7ffba0ea9c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:42.696520 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744d181-f854-488a-b267-7ffba0ea9c48 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.696801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744d181-f854-488a-b267-7ffba0ea9c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.697103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744d181-f854-488a-b267-7ffba0ea9c48 admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.697731 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744d181-f854-488a-b267-7ffba0ea9c48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:55:42.698030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744d181-f854-488a-b267-7ffba0ea9c48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:42.699624 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744d181-f854-488a-b267-7ffba0ea9c48 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:42.701151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-23126b2d-db9c-45a9-91b7-7504903cecf7 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:42.702851 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-23126b2d-db9c-45a9-91b7-7504903cecf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:42.718721 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 774/1557] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:55:42.718932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 784/1558] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:42.718932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23126b2d-db9c-45a9-91b7-7504903cecf7 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:42.719134 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28423e14-92d8-47a0-9285-32b5d6e458a3 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.719134 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28423e14-92d8-47a0-9285-32b5d6e458a3 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.719134 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28423e14-92d8-47a0-9285-32b5d6e458a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.726444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23126b2d-db9c-45a9-91b7-7504903cecf7 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:42.731424 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5975b-0f8d-4ed4-8d0e-dec76c6e53b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:42.732083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5975b-0f8d-4ed4-8d0e-dec76c6e53b5 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.732380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5975b-0f8d-4ed4-8d0e-dec76c6e53b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.732645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5975b-0f8d-4ed4-8d0e-dec76c6e53b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.733286 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5975b-0f8d-4ed4-8d0e-dec76c6e53b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:42.734879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5975b-0f8d-4ed4-8d0e-dec76c6e53b5 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:42.735692 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-28423e14-92d8-47a0-9285-32b5d6e458a3 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:42.736889 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-28423e14-92d8-47a0-9285-32b5d6e458a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:42.744767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 775/1559] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:42.747966 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 785/1560] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:42.747966 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704687b2-8d4c-4445-9162-90b8913567a8 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.747966 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704687b2-8d4c-4445-9162-90b8913567a8 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.747966 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704687b2-8d4c-4445-9162-90b8913567a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.749499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce555f7-c257-4bf5-9df3-c1e0e61906e5 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.749891 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce555f7-c257-4bf5-9df3-c1e0e61906e5 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.750362 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce555f7-c257-4bf5-9df3-c1e0e61906e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.767841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-704687b2-8d4c-4445-9162-90b8913567a8 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:42.769054 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-704687b2-8d4c-4445-9162-90b8913567a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:42.770374 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-5ce555f7-c257-4bf5-9df3-c1e0e61906e5 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:42.771652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-5ce555f7-c257-4bf5-9df3-c1e0e61906e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:42.777050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 786/1561] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:42.777884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704687b2-8d4c-4445-9162-90b8913567a8 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:42.779986 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 776/1562] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:42.783687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce555f7-c257-4bf5-9df3-c1e0e61906e5 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:42.791520 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704687b2-8d4c-4445-9162-90b8913567a8 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:42.793355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce555f7-c257-4bf5-9df3-c1e0e61906e5 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:42.796449 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c2cab-2545-4bbf-8ae9-1491056b827a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:42.797000 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c2cab-2545-4bbf-8ae9-1491056b827a admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.797287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c2cab-2545-4bbf-8ae9-1491056b827a admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.797558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c2cab-2545-4bbf-8ae9-1491056b827a admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.797968 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74297ef4-1a5e-451c-92ee-130858a4edc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:42.798200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c2cab-2545-4bbf-8ae9-1491056b827a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:55:42.798505 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c2cab-2545-4bbf-8ae9-1491056b827a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:42.798630 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74297ef4-1a5e-451c-92ee-130858a4edc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.798890 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74297ef4-1a5e-451c-92ee-130858a4edc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.799164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74297ef4-1a5e-451c-92ee-130858a4edc9 admin admin] PATH_INFO: `/v3/projects/425c0d41bb054c00893a9b9dc7a0fa10/users/254e2c96e6b34d4da8ea9d68e503851f/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.800139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c2cab-2545-4bbf-8ae9-1491056b827a admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:42.812803 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 787/1563] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:55:42.813659 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c2cab-2545-4bbf-8ae9-1491056b827a admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:42.815042 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74297ef4-1a5e-451c-92ee-130858a4edc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=425c0d41bb054c00893a9b9dc7a0fa10, user_id=254e2c96e6b34d4da8ea9d68e503851f, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:42.816120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: WARNING py.warnings [None req-74297ef4-1a5e-451c-92ee-130858a4edc9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:55:42.816120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: warnings.warn(msg) Sep 14 19:55:42.816120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: Sep 14 19:55:42.818254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74297ef4-1a5e-451c-92ee-130858a4edc9 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:42.823845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c2cab-2545-4bbf-8ae9-1491056b827a admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:42.828462 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee52eba-46fb-4392-b738-a6238fb05c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:42.832201 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee52eba-46fb-4392-b738-a6238fb05c1c admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.832201 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee52eba-46fb-4392-b738-a6238fb05c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.832201 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee52eba-46fb-4392-b738-a6238fb05c1c admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.832201 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee52eba-46fb-4392-b738-a6238fb05c1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:42.832201 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee52eba-46fb-4392-b738-a6238fb05c1c admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:42.910947 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 777/1564] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:55:42 2022] PUT /identity/v3/projects/425c0d41bb054c00893a9b9dc7a0fa10/users/254e2c96e6b34d4da8ea9d68e503851f/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:42.912405 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6a47c-21f8-4ba9-acf6-8b7d9ff673f8 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.912694 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6a47c-21f8-4ba9-acf6-8b7d9ff673f8 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:42.912970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6a47c-21f8-4ba9-acf6-8b7d9ff673f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:42.933851 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 788/1565] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:55:42 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:42.933851 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee52eba-46fb-4392-b738-a6238fb05c1c admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:42.934166 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-b1d6a47c-21f8-4ba9-acf6-8b7d9ff673f8 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:42.934358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b1d6a47c-21f8-4ba9-acf6-8b7d9ff673f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:42.944963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:42.962031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:42.998001 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 778/1566] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:42.998681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee52eba-46fb-4392-b738-a6238fb05c1c admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:42.999441 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8806c5d-a234-4693-b28d-0f7864221d2f None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:42.999819 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8806c5d-a234-4693-b28d-0f7864221d2f None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:43.000160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8806c5d-a234-4693-b28d-0f7864221d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:43.003619 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2fb44-e28f-465f-a41e-dfc6d11c5b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:43.004239 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2fb44-e28f-465f-a41e-dfc6d11c5b5a admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:43.004523 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2fb44-e28f-465f-a41e-dfc6d11c5b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:43.004798 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2fb44-e28f-465f-a41e-dfc6d11c5b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:43.005730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2fb44-e28f-465f-a41e-dfc6d11c5b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:43.007752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2fb44-e28f-465f-a41e-dfc6d11c5b5a admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:43.017723 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 789/1567] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:43.018536 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2fb44-e28f-465f-a41e-dfc6d11c5b5a admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:43.019891 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-f8806c5d-a234-4693-b28d-0f7864221d2f None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:43.021589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f8806c5d-a234-4693-b28d-0f7864221d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:43.028950 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2fb44-e28f-465f-a41e-dfc6d11c5b5a admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:43.029576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 779/1568] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:43.033395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0812f-2300-462d-b542-94151571c7ef None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:43.033395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0812f-2300-462d-b542-94151571c7ef None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:43.033395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0812f-2300-462d-b542-94151571c7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:43.038992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5453628-9881-4334-be4f-3803c3f941ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:43.039647 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5453628-9881-4334-be4f-3803c3f941ff admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:43.039932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5453628-9881-4334-be4f-3803c3f941ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:43.040208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5453628-9881-4334-be4f-3803c3f941ff admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:43.040888 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5453628-9881-4334-be4f-3803c3f941ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:55:43.041197 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5453628-9881-4334-be4f-3803c3f941ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:43.042866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5453628-9881-4334-be4f-3803c3f941ff admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:43.069128 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-b8e0812f-2300-462d-b542-94151571c7ef None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:43.069128 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b8e0812f-2300-462d-b542-94151571c7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:43.069435 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 790/1569] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:55:43.069435 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5453628-9881-4334-be4f-3803c3f941ff admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:43.069609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 780/1570] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:43.069609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e5420-1f7c-41d8-b4af-513fbdb11ffd None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:43.069609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e5420-1f7c-41d8-b4af-513fbdb11ffd None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:43.069609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e5420-1f7c-41d8-b4af-513fbdb11ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:43.074168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5453628-9881-4334-be4f-3803c3f941ff admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:43.078972 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4384052-129f-4f17-8f45-fa98047e76f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:43.079711 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4384052-129f-4f17-8f45-fa98047e76f6 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:43.079996 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4384052-129f-4f17-8f45-fa98047e76f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:43.080292 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4384052-129f-4f17-8f45-fa98047e76f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:43.080920 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4384052-129f-4f17-8f45-fa98047e76f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:43.082907 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4384052-129f-4f17-8f45-fa98047e76f6 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:43.091861 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-382e5420-1f7c-41d8-b4af-513fbdb11ffd None None] MFA Rules not processed for user `254e2c96e6b34d4da8ea9d68e503851f`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:43.093134 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-382e5420-1f7c-41d8-b4af-513fbdb11ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:43.158488 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 781/1571] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:43 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:43.159453 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e5420-1f7c-41d8-b4af-513fbdb11ffd None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:43.170275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e5420-1f7c-41d8-b4af-513fbdb11ffd None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:43.174757 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df21cbf-e741-4f30-af38-f9775e3e7a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:43.176860 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df21cbf-e741-4f30-af38-f9775e3e7a9e admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:43.176860 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df21cbf-e741-4f30-af38-f9775e3e7a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:43.176860 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df21cbf-e741-4f30-af38-f9775e3e7a9e admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:43.176860 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df21cbf-e741-4f30-af38-f9775e3e7a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:43.178973 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df21cbf-e741-4f30-af38-f9775e3e7a9e admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:43.248986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 791/1572] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:55:43 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:43.249961 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4384052-129f-4f17-8f45-fa98047e76f6 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:43.277425 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 782/1573] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:55:43 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:43.280187 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df21cbf-e741-4f30-af38-f9775e3e7a9e admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:43.289225 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df21cbf-e741-4f30-af38-f9775e3e7a9e admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:43.311631 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4384052-129f-4f17-8f45-fa98047e76f6 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:43.316434 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b99c8-ad20-4df2-bc2b-808c29124853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:43.317125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b99c8-ad20-4df2-bc2b-808c29124853 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:43.317476 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b99c8-ad20-4df2-bc2b-808c29124853 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:43.318324 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b99c8-ad20-4df2-bc2b-808c29124853 admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:43.319048 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b99c8-ad20-4df2-bc2b-808c29124853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:55:43.319472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b99c8-ad20-4df2-bc2b-808c29124853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:43.321108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b99c8-ad20-4df2-bc2b-808c29124853 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:43.332647 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 792/1574] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:55:43.334078 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b99c8-ad20-4df2-bc2b-808c29124853 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:43.343474 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b99c8-ad20-4df2-bc2b-808c29124853 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:43.346300 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be21edc-3de1-49bc-b492-acf41379850c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:43.346976 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be21edc-3de1-49bc-b492-acf41379850c admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:43.347260 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be21edc-3de1-49bc-b492-acf41379850c admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:43.347562 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be21edc-3de1-49bc-b492-acf41379850c admin admin] PATH_INFO: `/v3/projects/bfa9a250b42e48bdae315e3b29708591/users/3e1585a0ee9641e98358a7c25e5d2b15/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:43.348136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7557b-ed21-4370-b122-db6f7e46f3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:43.348728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7557b-ed21-4370-b122-db6f7e46f3dc admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:43.349116 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7557b-ed21-4370-b122-db6f7e46f3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:43.349386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7557b-ed21-4370-b122-db6f7e46f3dc admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:43.350015 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7557b-ed21-4370-b122-db6f7e46f3dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:55:43.350317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7557b-ed21-4370-b122-db6f7e46f3dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:43.352181 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7557b-ed21-4370-b122-db6f7e46f3dc admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:43.363585 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be21edc-3de1-49bc-b492-acf41379850c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa9a250b42e48bdae315e3b29708591, user_id=3e1585a0ee9641e98358a7c25e5d2b15, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:43.372632 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 793/1575] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:55:43.372632 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7557b-ed21-4370-b122-db6f7e46f3dc admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:43.372870 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be21edc-3de1-49bc-b492-acf41379850c admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:43.385273 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7557b-ed21-4370-b122-db6f7e46f3dc admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:43.389947 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa9608-5d09-4e03-a47e-fc83089cbc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:43.390556 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa9608-5d09-4e03-a47e-fc83089cbc5e admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:43.390975 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa9608-5d09-4e03-a47e-fc83089cbc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:43.391251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa9608-5d09-4e03-a47e-fc83089cbc5e admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:43.391930 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa9608-5d09-4e03-a47e-fc83089cbc5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:55:43.392234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa9608-5d09-4e03-a47e-fc83089cbc5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:43.393815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa9608-5d09-4e03-a47e-fc83089cbc5e admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:43.406027 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 794/1576] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:55:43.406817 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa9608-5d09-4e03-a47e-fc83089cbc5e admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:43.416298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa9608-5d09-4e03-a47e-fc83089cbc5e admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:43.420896 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90193a-d942-4839-a663-9765cb860dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:43.421620 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90193a-d942-4839-a663-9765cb860dfe admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:43.422007 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90193a-d942-4839-a663-9765cb860dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:43.422343 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90193a-d942-4839-a663-9765cb860dfe admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:43.422955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90193a-d942-4839-a663-9765cb860dfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:43.424825 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90193a-d942-4839-a663-9765cb860dfe admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:43.458154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 783/1577] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:55:43 2022] PUT /identity/v3/projects/bfa9a250b42e48bdae315e3b29708591/users/3e1585a0ee9641e98358a7c25e5d2b15/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:43.459718 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be21edc-3de1-49bc-b492-acf41379850c admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:43.473275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:43.522068 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be21edc-3de1-49bc-b492-acf41379850c admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:43.526693 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61f9fa-2980-464a-90b3-43bcdea30c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:43.527297 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61f9fa-2980-464a-90b3-43bcdea30c6f admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:43.527602 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61f9fa-2980-464a-90b3-43bcdea30c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:43.527875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61f9fa-2980-464a-90b3-43bcdea30c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:43.528499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61f9fa-2980-464a-90b3-43bcdea30c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:43.530393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61f9fa-2980-464a-90b3-43bcdea30c6f admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:43.540699 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 795/1578] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:55:43 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:43.541630 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90193a-d942-4839-a663-9765cb860dfe admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:43.559765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:43.603634 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90193a-d942-4839-a663-9765cb860dfe admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:43.608315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c497495-2db9-4e84-9532-6423d37676e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:43.608920 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c497495-2db9-4e84-9532-6423d37676e1 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:43.609197 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c497495-2db9-4e84-9532-6423d37676e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:43.609467 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c497495-2db9-4e84-9532-6423d37676e1 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:43.610093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c497495-2db9-4e84-9532-6423d37676e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:43.611104 dv-cinder-839768-8-smb devstack@keystone.service[93545]: WARNING py.warnings [None req-1c497495-2db9-4e84-9532-6423d37676e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:55:43.611104 dv-cinder-839768-8-smb devstack@keystone.service[93545]: warnings.warn(msg) Sep 14 19:55:43.611104 dv-cinder-839768-8-smb devstack@keystone.service[93545]: Sep 14 19:55:43.612339 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c497495-2db9-4e84-9532-6423d37676e1 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:43.621313 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 784/1579] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:55:43 2022] POST /identity/v3/projects => generated 405 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:43.622255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61f9fa-2980-464a-90b3-43bcdea30c6f admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:43.693425 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61f9fa-2980-464a-90b3-43bcdea30c6f admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:43.697539 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 796/1580] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:55:43 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:43.697539 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c497495-2db9-4e84-9532-6423d37676e1 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:43.699869 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804120a-0992-41d9-863a-4d2fcdb22d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:43.700496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804120a-0992-41d9-863a-4d2fcdb22d97 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:43.700775 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804120a-0992-41d9-863a-4d2fcdb22d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:43.701045 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804120a-0992-41d9-863a-4d2fcdb22d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:43.701695 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804120a-0992-41d9-863a-4d2fcdb22d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:43.703299 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804120a-0992-41d9-863a-4d2fcdb22d97 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:43.705413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c497495-2db9-4e84-9532-6423d37676e1 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:43.710681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992c546-0fda-4fdf-925e-881221af085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:43.711292 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992c546-0fda-4fdf-925e-881221af085f admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:43.711588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992c546-0fda-4fdf-925e-881221af085f admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:43.711891 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992c546-0fda-4fdf-925e-881221af085f admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:43.712516 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992c546-0fda-4fdf-925e-881221af085f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:43.714301 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 785/1581] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:43.714422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992c546-0fda-4fdf-925e-881221af085f admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:43.716682 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804120a-0992-41d9-863a-4d2fcdb22d97 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:43.729416 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804120a-0992-41d9-863a-4d2fcdb22d97 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:43.734142 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d84d1-8551-4405-b27d-e6e2a74385ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:43.734742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d84d1-8551-4405-b27d-e6e2a74385ca admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:43.735019 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d84d1-8551-4405-b27d-e6e2a74385ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:43.735290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d84d1-8551-4405-b27d-e6e2a74385ca admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:43.735943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d84d1-8551-4405-b27d-e6e2a74385ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:43.737908 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d84d1-8551-4405-b27d-e6e2a74385ca admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:43.820096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 797/1582] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:55:43 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:43.821127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992c546-0fda-4fdf-925e-881221af085f admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:43.880752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992c546-0fda-4fdf-925e-881221af085f admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:43.885538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac591cf-7106-48e3-821a-a6110f636dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:43.886154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac591cf-7106-48e3-821a-a6110f636dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:43.886435 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac591cf-7106-48e3-821a-a6110f636dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:43.890107 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac591cf-7106-48e3-821a-a6110f636dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:43.890107 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac591cf-7106-48e3-821a-a6110f636dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:43.890107 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac591cf-7106-48e3-821a-a6110f636dd1 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:43.946951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 786/1583] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:55:43 2022] POST /identity/v3/projects => generated 389 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:43.948281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3752b-6a39-493c-b6ad-e3db5db9e96e None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:43.948563 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3752b-6a39-493c-b6ad-e3db5db9e96e None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:43.948836 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3752b-6a39-493c-b6ad-e3db5db9e96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:43.975914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-57b3752b-6a39-493c-b6ad-e3db5db9e96e None None] MFA Rules not processed for user `3e1585a0ee9641e98358a7c25e5d2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:43.977370 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-57b3752b-6a39-493c-b6ad-e3db5db9e96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:44.018455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 798/1584] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:55:43 2022] POST /identity/v3/projects => generated 367 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:44.018455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac591cf-7106-48e3-821a-a6110f636dd1 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:44.041005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:44.045237 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 787/1585] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:44.045535 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3752b-6a39-493c-b6ad-e3db5db9e96e None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:44.081678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac591cf-7106-48e3-821a-a6110f636dd1 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:44.087276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1143a9c-3860-4c6e-b05d-3031236b842e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:44.087922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1143a9c-3860-4c6e-b05d-3031236b842e admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:44.088202 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1143a9c-3860-4c6e-b05d-3031236b842e admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:44.088476 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1143a9c-3860-4c6e-b05d-3031236b842e admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:44.089118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1143a9c-3860-4c6e-b05d-3031236b842e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:44.091037 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1143a9c-3860-4c6e-b05d-3031236b842e admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:44.107869 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3752b-6a39-493c-b6ad-e3db5db9e96e None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:44.112454 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9639aaa-3816-4e5f-a083-99d4d290e059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:44.113058 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9639aaa-3816-4e5f-a083-99d4d290e059 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:44.113330 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9639aaa-3816-4e5f-a083-99d4d290e059 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:44.113595 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9639aaa-3816-4e5f-a083-99d4d290e059 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:44.114217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9639aaa-3816-4e5f-a083-99d4d290e059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:44.116451 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9639aaa-3816-4e5f-a083-99d4d290e059 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:44.220121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:44.226234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 799/1586] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:55:44 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:44.227285 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1143a9c-3860-4c6e-b05d-3031236b842e admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:44.237619 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1143a9c-3860-4c6e-b05d-3031236b842e admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:44.243222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e142c0d-5840-427b-aaf1-684e672c9a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:44.243854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e142c0d-5840-427b-aaf1-684e672c9a9e admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:44.244135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e142c0d-5840-427b-aaf1-684e672c9a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:44.244405 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e142c0d-5840-427b-aaf1-684e672c9a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:44.245191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e142c0d-5840-427b-aaf1-684e672c9a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:44.246773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e142c0d-5840-427b-aaf1-684e672c9a9e admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:44.252310 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 788/1587] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:55:44 2022] POST /identity/v3/users => generated 309 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:44.252310 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9639aaa-3816-4e5f-a083-99d4d290e059 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:44.259189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 800/1588] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:44.260021 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e142c0d-5840-427b-aaf1-684e672c9a9e admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:44.263105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9639aaa-3816-4e5f-a083-99d4d290e059 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:44.268205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e6ffa-60a1-4aaa-bb28-4c5133887499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:44.268817 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e6ffa-60a1-4aaa-bb28-4c5133887499 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:44.269094 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e6ffa-60a1-4aaa-bb28-4c5133887499 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:44.269362 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e6ffa-60a1-4aaa-bb28-4c5133887499 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:44.270009 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e6ffa-60a1-4aaa-bb28-4c5133887499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:44.270154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e142c0d-5840-427b-aaf1-684e672c9a9e admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:44.272230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e6ffa-60a1-4aaa-bb28-4c5133887499 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:44.276152 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f943c-7cef-47c2-be46-1d98ddb4e600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:44.276914 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f943c-7cef-47c2-be46-1d98ddb4e600 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:44.277192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f943c-7cef-47c2-be46-1d98ddb4e600 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:44.277462 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f943c-7cef-47c2-be46-1d98ddb4e600 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:44.278085 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f943c-7cef-47c2-be46-1d98ddb4e600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:44.280051 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f943c-7cef-47c2-be46-1d98ddb4e600 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:44.284872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 789/1589] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:44.284872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e6ffa-60a1-4aaa-bb28-4c5133887499 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:44.292633 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e6ffa-60a1-4aaa-bb28-4c5133887499 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:44.297230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c41f1-bdec-48b8-9411-a60309cb26f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:44.297819 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c41f1-bdec-48b8-9411-a60309cb26f4 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:44.298094 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c41f1-bdec-48b8-9411-a60309cb26f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:44.298364 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c41f1-bdec-48b8-9411-a60309cb26f4 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:44.298980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c41f1-bdec-48b8-9411-a60309cb26f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:44.300903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c41f1-bdec-48b8-9411-a60309cb26f4 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:44.373896 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 801/1590] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:55:44 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:44.374960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f943c-7cef-47c2-be46-1d98ddb4e600 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:44.384825 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f943c-7cef-47c2-be46-1d98ddb4e600 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:44.389454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdf603-0d20-47ca-93c3-ef5f989fa561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:44.390050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdf603-0d20-47ca-93c3-ef5f989fa561 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:44.390332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdf603-0d20-47ca-93c3-ef5f989fa561 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:44.390603 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdf603-0d20-47ca-93c3-ef5f989fa561 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:44.391253 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdf603-0d20-47ca-93c3-ef5f989fa561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:44.393217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdf603-0d20-47ca-93c3-ef5f989fa561 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:44.449100 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 790/1591] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:55:44 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:44.450071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c41f1-bdec-48b8-9411-a60309cb26f4 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:44.460275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c41f1-bdec-48b8-9411-a60309cb26f4 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:44.464771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceacec6-c962-4fd3-b78e-8251cc776c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:44.465343 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceacec6-c962-4fd3-b78e-8251cc776c5c admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:44.465617 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceacec6-c962-4fd3-b78e-8251cc776c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:44.465881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceacec6-c962-4fd3-b78e-8251cc776c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:44.466490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceacec6-c962-4fd3-b78e-8251cc776c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:44.468419 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceacec6-c962-4fd3-b78e-8251cc776c5c admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:44.545340 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 802/1592] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:55:44 2022] POST /identity/v3/users => generated 284 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:44.546165 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdf603-0d20-47ca-93c3-ef5f989fa561 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:44.557007 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdf603-0d20-47ca-93c3-ef5f989fa561 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:44.561742 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3d906-4132-456e-8ca8-5db7f150a593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:44.562341 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3d906-4132-456e-8ca8-5db7f150a593 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:44.562622 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3d906-4132-456e-8ca8-5db7f150a593 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:44.562892 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3d906-4132-456e-8ca8-5db7f150a593 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:44.563585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3d906-4132-456e-8ca8-5db7f150a593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:44.565190 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3d906-4132-456e-8ca8-5db7f150a593 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:44.575552 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 803/1593] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:44.576349 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3d906-4132-456e-8ca8-5db7f150a593 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:44.586721 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3d906-4132-456e-8ca8-5db7f150a593 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:44.591177 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 791/1594] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:55:44 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:44.591177 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceacec6-c962-4fd3-b78e-8251cc776c5c admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:44.649192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c584b-8bc8-484b-8a0c-bce515f0a8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:44.649809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c584b-8bc8-484b-8a0c-bce515f0a8ed admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:44.650091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c584b-8bc8-484b-8a0c-bce515f0a8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:44.650364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c584b-8bc8-484b-8a0c-bce515f0a8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:44.651005 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c584b-8bc8-484b-8a0c-bce515f0a8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:44.652644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c584b-8bc8-484b-8a0c-bce515f0a8ed admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:44.655804 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceacec6-c962-4fd3-b78e-8251cc776c5c admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:44.660793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a8dfa-b1c4-4e62-8bde-c55a3691457d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:44.661466 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a8dfa-b1c4-4e62-8bde-c55a3691457d admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:44.662629 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a8dfa-b1c4-4e62-8bde-c55a3691457d admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:44.662730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a8dfa-b1c4-4e62-8bde-c55a3691457d admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:44.663269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 804/1595] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:44.663411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a8dfa-b1c4-4e62-8bde-c55a3691457d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:44.663885 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c584b-8bc8-484b-8a0c-bce515f0a8ed admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:44.664939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a8dfa-b1c4-4e62-8bde-c55a3691457d admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:44.675523 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c584b-8bc8-484b-8a0c-bce515f0a8ed admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:44.680327 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 792/1596] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:44.681062 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a8dfa-b1c4-4e62-8bde-c55a3691457d admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:44.681182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e1384-9d63-4f16-98a0-1a4166f3c119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:44.681889 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e1384-9d63-4f16-98a0-1a4166f3c119 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:44.682230 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e1384-9d63-4f16-98a0-1a4166f3c119 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:44.682673 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e1384-9d63-4f16-98a0-1a4166f3c119 admin admin] PATH_INFO: `/v3/projects/ef24352329aa44588012c5e9b6ae2a0a/users/5844b1ac8e9f46ee85c55fb9d2e1f18b/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:44.691177 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a8dfa-b1c4-4e62-8bde-c55a3691457d admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:44.698403 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e1384-9d63-4f16-98a0-1a4166f3c119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef24352329aa44588012c5e9b6ae2a0a, user_id=5844b1ac8e9f46ee85c55fb9d2e1f18b, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:44.700075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047d7ce-5724-44e0-8ec0-15cc6357d49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:44.700677 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047d7ce-5724-44e0-8ec0-15cc6357d49b admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:44.700950 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047d7ce-5724-44e0-8ec0-15cc6357d49b admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:44.701102 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e1384-9d63-4f16-98a0-1a4166f3c119 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:44.701236 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047d7ce-5724-44e0-8ec0-15cc6357d49b admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:44.701972 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047d7ce-5724-44e0-8ec0-15cc6357d49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:44.703615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047d7ce-5724-44e0-8ec0-15cc6357d49b admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:44.714400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 793/1597] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:44.718634 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047d7ce-5724-44e0-8ec0-15cc6357d49b admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:44.725420 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047d7ce-5724-44e0-8ec0-15cc6357d49b admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:44.730242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb6de9-6b13-460c-9243-bb10993b2dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:44.730801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb6de9-6b13-460c-9243-bb10993b2dac admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:44.731075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb6de9-6b13-460c-9243-bb10993b2dac admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:44.731341 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb6de9-6b13-460c-9243-bb10993b2dac admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:44.731994 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb6de9-6b13-460c-9243-bb10993b2dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:44.733733 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb6de9-6b13-460c-9243-bb10993b2dac admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:44.743853 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 794/1598] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:44.744615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb6de9-6b13-460c-9243-bb10993b2dac admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:44.753980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb6de9-6b13-460c-9243-bb10993b2dac admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:44.758717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d53aa-09c2-4c92-a76d-d90cc1c4417a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:44.759283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d53aa-09c2-4c92-a76d-d90cc1c4417a admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:44.759584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d53aa-09c2-4c92-a76d-d90cc1c4417a admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:44.759863 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d53aa-09c2-4c92-a76d-d90cc1c4417a admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:44.760479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d53aa-09c2-4c92-a76d-d90cc1c4417a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:44.762023 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d53aa-09c2-4c92-a76d-d90cc1c4417a admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:44.771587 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 795/1599] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:44.772347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d53aa-09c2-4c92-a76d-d90cc1c4417a admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:44.776953 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:44.782664 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d53aa-09c2-4c92-a76d-d90cc1c4417a admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:44.791761 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 805/1600] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:55:44 2022] PUT /identity/v3/projects/ef24352329aa44588012c5e9b6ae2a0a/users/5844b1ac8e9f46ee85c55fb9d2e1f18b/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:44.791761 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e1384-9d63-4f16-98a0-1a4166f3c119 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:44.847363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68017efa-19f9-44f5-81ee-6def5f878a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:44.848004 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68017efa-19f9-44f5-81ee-6def5f878a0d admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:44.848285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68017efa-19f9-44f5-81ee-6def5f878a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:44.848558 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68017efa-19f9-44f5-81ee-6def5f878a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:44.849892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68017efa-19f9-44f5-81ee-6def5f878a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:44.852653 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68017efa-19f9-44f5-81ee-6def5f878a0d admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:44.855133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e1384-9d63-4f16-98a0-1a4166f3c119 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:44.860003 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43570f26-8d13-432d-a4cf-977a5c4e7c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:44.860621 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43570f26-8d13-432d-a4cf-977a5c4e7c11 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:44.860899 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43570f26-8d13-432d-a4cf-977a5c4e7c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:44.861171 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43570f26-8d13-432d-a4cf-977a5c4e7c11 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:44.861802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43570f26-8d13-432d-a4cf-977a5c4e7c11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:44.867517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 796/1601] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:44.867703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43570f26-8d13-432d-a4cf-977a5c4e7c11 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:44.872790 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68017efa-19f9-44f5-81ee-6def5f878a0d admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:44.874657 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68017efa-19f9-44f5-81ee-6def5f878a0d admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:44.879436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece342ec-9bc9-4e97-9df8-d48f1033d2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:44.880235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece342ec-9bc9-4e97-9df8-d48f1033d2dc admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:44.880685 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece342ec-9bc9-4e97-9df8-d48f1033d2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:44.881199 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece342ec-9bc9-4e97-9df8-d48f1033d2dc admin admin] PATH_INFO: `/v3/projects/6024af8e49f745028b83bab50aabb144/users/55389c35c61b499aa0cf8d4c0d552205/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:44.897550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece342ec-9bc9-4e97-9df8-d48f1033d2dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6024af8e49f745028b83bab50aabb144, user_id=55389c35c61b499aa0cf8d4c0d552205, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:44.900528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece342ec-9bc9-4e97-9df8-d48f1033d2dc admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:44.993639 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 806/1602] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:55:44 2022] POST /identity/v3/users => generated 295 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:44.993639 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43570f26-8d13-432d-a4cf-977a5c4e7c11 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:44.996026 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:45.001229 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43570f26-8d13-432d-a4cf-977a5c4e7c11 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:45.006309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068e78f-52e4-4951-ae76-c37c84a33f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:45.006951 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068e78f-52e4-4951-ae76-c37c84a33f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:45.007234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068e78f-52e4-4951-ae76-c37c84a33f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:45.007510 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068e78f-52e4-4951-ae76-c37c84a33f38 admin admin] PATH_INFO: `/v3/projects/765bf146aae44c958e81386b67c3afa3/users/3725a8878d78434eb7d94fb413ba8078/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:45.020042 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 797/1603] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:55:44 2022] PUT /identity/v3/projects/6024af8e49f745028b83bab50aabb144/users/55389c35c61b499aa0cf8d4c0d552205/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:45.022085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece342ec-9bc9-4e97-9df8-d48f1033d2dc admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:45.024436 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2068e78f-52e4-4951-ae76-c37c84a33f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=765bf146aae44c958e81386b67c3afa3, user_id=3725a8878d78434eb7d94fb413ba8078, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:45.027871 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2068e78f-52e4-4951-ae76-c37c84a33f38 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:45.084470 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece342ec-9bc9-4e97-9df8-d48f1033d2dc admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:45.089142 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5df28-5266-4c2b-a4a5-ed1cf332749e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:45.089737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5df28-5266-4c2b-a4a5-ed1cf332749e admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:45.090010 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5df28-5266-4c2b-a4a5-ed1cf332749e admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:45.090273 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5df28-5266-4c2b-a4a5-ed1cf332749e admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:45.090898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5df28-5266-4c2b-a4a5-ed1cf332749e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:45.092501 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5df28-5266-4c2b-a4a5-ed1cf332749e admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:45.102948 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 798/1604] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:45.103831 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5df28-5266-4c2b-a4a5-ed1cf332749e admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:45.113332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5df28-5266-4c2b-a4a5-ed1cf332749e admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:45.117547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 807/1605] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:55:44 2022] PUT /identity/v3/projects/765bf146aae44c958e81386b67c3afa3/users/3725a8878d78434eb7d94fb413ba8078/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:45.118522 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068e78f-52e4-4951-ae76-c37c84a33f38 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:45.174412 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e854d-a336-4212-8969-394f1aff3703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:45.175056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e854d-a336-4212-8969-394f1aff3703 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:45.175333 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e854d-a336-4212-8969-394f1aff3703 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:45.175698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e854d-a336-4212-8969-394f1aff3703 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:45.176341 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e854d-a336-4212-8969-394f1aff3703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:45.178127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e854d-a336-4212-8969-394f1aff3703 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:45.182286 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068e78f-52e4-4951-ae76-c37c84a33f38 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:45.187017 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362007f-2e5c-4ad5-9c05-730e3638805a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:45.187665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362007f-2e5c-4ad5-9c05-730e3638805a admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:45.187946 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362007f-2e5c-4ad5-9c05-730e3638805a admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:45.188070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 799/1606] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:45.188219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362007f-2e5c-4ad5-9c05-730e3638805a admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:45.188868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362007f-2e5c-4ad5-9c05-730e3638805a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:45.189311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85577acc-c9ec-4a38-b017-d2f8f9ebaa7e None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:45.189592 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85577acc-c9ec-4a38-b017-d2f8f9ebaa7e None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:45.189867 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85577acc-c9ec-4a38-b017-d2f8f9ebaa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:45.190704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362007f-2e5c-4ad5-9c05-730e3638805a admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:45.203049 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 808/1607] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:45.203049 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362007f-2e5c-4ad5-9c05-730e3638805a admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:45.208905 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:45.213029 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362007f-2e5c-4ad5-9c05-730e3638805a admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:45.217737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93334736-3321-4a53-9845-c88567b188e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:45.218450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93334736-3321-4a53-9845-c88567b188e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:45.218728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93334736-3321-4a53-9845-c88567b188e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:45.218999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93334736-3321-4a53-9845-c88567b188e9 admin admin] PATH_INFO: `/v3/projects/588b092767bc4a8cb15638dc89f23966/users/983e57be9b214d788dc3a69da22a174e/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:45.222347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-85577acc-c9ec-4a38-b017-d2f8f9ebaa7e None None] MFA Rules not processed for user `5844b1ac8e9f46ee85c55fb9d2e1f18b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:45.223611 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-85577acc-c9ec-4a38-b017-d2f8f9ebaa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:45.234573 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93334736-3321-4a53-9845-c88567b188e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=588b092767bc4a8cb15638dc89f23966, user_id=983e57be9b214d788dc3a69da22a174e, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:45.237347 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93334736-3321-4a53-9845-c88567b188e9 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:45.288723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 800/1608] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:45.289573 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85577acc-c9ec-4a38-b017-d2f8f9ebaa7e None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:45.304082 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85577acc-c9ec-4a38-b017-d2f8f9ebaa7e None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:45.305678 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344821d-edad-4d5a-adfe-abd37992c79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:45.306282 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344821d-edad-4d5a-adfe-abd37992c79c admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:45.306561 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344821d-edad-4d5a-adfe-abd37992c79c admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:45.306832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344821d-edad-4d5a-adfe-abd37992c79c admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:45.307471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344821d-edad-4d5a-adfe-abd37992c79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:45.309115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344821d-edad-4d5a-adfe-abd37992c79c admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:45.323372 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 801/1609] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:45.323372 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344821d-edad-4d5a-adfe-abd37992c79c admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:45.330704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344821d-edad-4d5a-adfe-abd37992c79c admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:45.336408 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33691832-e85e-4ca1-8421-9bc90f46c61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:45.336542 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33691832-e85e-4ca1-8421-9bc90f46c61d admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:45.336794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33691832-e85e-4ca1-8421-9bc90f46c61d admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:45.337059 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33691832-e85e-4ca1-8421-9bc90f46c61d admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:45.337679 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33691832-e85e-4ca1-8421-9bc90f46c61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:45.339239 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33691832-e85e-4ca1-8421-9bc90f46c61d admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:45.348725 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 802/1610] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:45.350030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33691832-e85e-4ca1-8421-9bc90f46c61d admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:45.359881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33691832-e85e-4ca1-8421-9bc90f46c61d admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:45.366774 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 809/1611] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:55:45 2022] PUT /identity/v3/projects/588b092767bc4a8cb15638dc89f23966/users/983e57be9b214d788dc3a69da22a174e/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:45.368315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e9dfd-31c2-4218-9992-69ebd9c9808f None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:45.368606 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e9dfd-31c2-4218-9992-69ebd9c9808f None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:45.369107 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e9dfd-31c2-4218-9992-69ebd9c9808f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:45.389716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-c10e9dfd-31c2-4218-9992-69ebd9c9808f None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:45.390920 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c10e9dfd-31c2-4218-9992-69ebd9c9808f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:45.417685 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf526c9-f0bb-4ac3-995e-2943620e1019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:45.418397 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf526c9-f0bb-4ac3-995e-2943620e1019 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:45.418678 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf526c9-f0bb-4ac3-995e-2943620e1019 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:45.418944 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf526c9-f0bb-4ac3-995e-2943620e1019 admin admin] PATH_INFO: `/v3/projects/d84e7ca067c54214ab9a05aee9d4d662/users/a73bbbd0e1394f6799d6e7db603c1aa8/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:45.433198 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf526c9-f0bb-4ac3-995e-2943620e1019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84e7ca067c54214ab9a05aee9d4d662, user_id=a73bbbd0e1394f6799d6e7db603c1aa8, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:45.435857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf526c9-f0bb-4ac3-995e-2943620e1019 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:45.452623 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 810/1612] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:45.453438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e9dfd-31c2-4218-9992-69ebd9c9808f None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:45.463192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e9dfd-31c2-4218-9992-69ebd9c9808f None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:45.467960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2ee1c-ddcc-4db5-aa66-de6c3f45474d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:45.468870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2ee1c-ddcc-4db5-aa66-de6c3f45474d admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:45.468870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2ee1c-ddcc-4db5-aa66-de6c3f45474d admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:45.469130 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2ee1c-ddcc-4db5-aa66-de6c3f45474d admin admin] PATH_INFO: `/v3/projects/a10145cac8ec4c7fa689e373b45e4f6f/users/e95c629061564a93acaf944fd3ea3f72/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:45.484749 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2ee1c-ddcc-4db5-aa66-de6c3f45474d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a10145cac8ec4c7fa689e373b45e4f6f, user_id=e95c629061564a93acaf944fd3ea3f72, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:45.487437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2ee1c-ddcc-4db5-aa66-de6c3f45474d admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:45.550396 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 803/1613] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:55:45 2022] PUT /identity/v3/projects/d84e7ca067c54214ab9a05aee9d4d662/users/a73bbbd0e1394f6799d6e7db603c1aa8/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:45.551239 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf526c9-f0bb-4ac3-995e-2943620e1019 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:45.579348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 811/1614] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:55:45 2022] PUT /identity/v3/projects/a10145cac8ec4c7fa689e373b45e4f6f/users/e95c629061564a93acaf944fd3ea3f72/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:45.580721 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef15204-3973-4cde-9e3a-0c69ea992a52 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:45.583607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef15204-3973-4cde-9e3a-0c69ea992a52 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:45.583607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef15204-3973-4cde-9e3a-0c69ea992a52 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:45.583607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 812/1615] 10.222.0.15 () {54 vars in 962 bytes} [Wed Sep 14 19:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:55:45.583607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef15204-3973-4cde-9e3a-0c69ea992a52 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:45.616180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:45.617319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf526c9-f0bb-4ac3-995e-2943620e1019 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:45.649303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef15204-3973-4cde-9e3a-0c69ea992a52 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:45.653901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4d72a-0e4c-42b7-aa07-7052d50b5a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:45.654569 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4d72a-0e4c-42b7-aa07-7052d50b5a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:45.654855 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4d72a-0e4c-42b7-aa07-7052d50b5a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:45.655128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4d72a-0e4c-42b7-aa07-7052d50b5a97 admin admin] PATH_INFO: `/v3/projects/b193ebda478346ffb5ecaef06cd96983/users/1b6db6f2ea824ab5a34a8fe44ac8cc90/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:45.670942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4d72a-0e4c-42b7-aa07-7052d50b5a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b193ebda478346ffb5ecaef06cd96983, user_id=1b6db6f2ea824ab5a34a8fe44ac8cc90, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:45.672577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9aa01-9c59-418e-9e17-62f0fa6312b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:45.673246 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9aa01-9c59-418e-9e17-62f0fa6312b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:45.673517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9aa01-9c59-418e-9e17-62f0fa6312b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:45.673784 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9aa01-9c59-418e-9e17-62f0fa6312b6 admin admin] PATH_INFO: `/v3/projects/cc879ce4ccdb47d1bbf0272916b1624b/users/5f5a2982651f4660ad2e1596a7ff6202/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:45.673908 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4d72a-0e4c-42b7-aa07-7052d50b5a97 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:45.696458 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9aa01-9c59-418e-9e17-62f0fa6312b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc879ce4ccdb47d1bbf0272916b1624b, user_id=5f5a2982651f4660ad2e1596a7ff6202, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:45.699532 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9aa01-9c59-418e-9e17-62f0fa6312b6 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:45.791503 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 813/1616] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:55:45 2022] PUT /identity/v3/projects/b193ebda478346ffb5ecaef06cd96983/users/1b6db6f2ea824ab5a34a8fe44ac8cc90/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:45.792346 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4d72a-0e4c-42b7-aa07-7052d50b5a97 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:45.822279 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:45.828592 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 804/1617] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:55:45 2022] PUT /identity/v3/projects/cc879ce4ccdb47d1bbf0272916b1624b/users/5f5a2982651f4660ad2e1596a7ff6202/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:45.829972 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16f832-e18b-4082-9bd7-b7a2e09fd52d None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:45.837241 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16f832-e18b-4082-9bd7-b7a2e09fd52d None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:45.837241 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16f832-e18b-4082-9bd7-b7a2e09fd52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:45.849338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-dc16f832-e18b-4082-9bd7-b7a2e09fd52d None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:45.850540 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-dc16f832-e18b-4082-9bd7-b7a2e09fd52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:45.857431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4d72a-0e4c-42b7-aa07-7052d50b5a97 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:45.909125 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 805/1618] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:45.909900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16f832-e18b-4082-9bd7-b7a2e09fd52d None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:45.915202 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046823f6-9a9d-48fa-aa18-7ad8c3937827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:45.915917 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046823f6-9a9d-48fa-aa18-7ad8c3937827 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:45.916204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046823f6-9a9d-48fa-aa18-7ad8c3937827 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:45.916482 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046823f6-9a9d-48fa-aa18-7ad8c3937827 admin admin] PATH_INFO: `/v3/projects/6024af8e49f745028b83bab50aabb144/users/55389c35c61b499aa0cf8d4c0d552205/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:45.918551 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046823f6-9a9d-48fa-aa18-7ad8c3937827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6024af8e49f745028b83bab50aabb144, user_id=55389c35c61b499aa0cf8d4c0d552205, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:45.921446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046823f6-9a9d-48fa-aa18-7ad8c3937827 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:45.932731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 814/1619] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:55:45 2022] PUT /identity/v3/projects/6024af8e49f745028b83bab50aabb144/users/55389c35c61b499aa0cf8d4c0d552205/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:45.933985 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e855e7-95cb-4a3a-ad52-d9a5a582b207 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:45.934272 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e855e7-95cb-4a3a-ad52-d9a5a582b207 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:45.934547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e855e7-95cb-4a3a-ad52-d9a5a582b207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:45.965921 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16f832-e18b-4082-9bd7-b7a2e09fd52d None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:45.966138 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-50e855e7-95cb-4a3a-ad52-d9a5a582b207 None None] MFA Rules not processed for user `a73bbbd0e1394f6799d6e7db603c1aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:45.967349 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-50e855e7-95cb-4a3a-ad52-d9a5a582b207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:46.009363 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:46.016519 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78470488-29e6-4e5e-9838-558f534e0822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:46.017138 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78470488-29e6-4e5e-9838-558f534e0822 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:46.017413 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78470488-29e6-4e5e-9838-558f534e0822 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:46.017678 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78470488-29e6-4e5e-9838-558f534e0822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:46.031481 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:46.034172 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 815/1620] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:46.039318 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446b18d-8949-4800-9273-7fcca4c0e363 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:46.039318 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446b18d-8949-4800-9273-7fcca4c0e363 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:46.039318 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446b18d-8949-4800-9273-7fcca4c0e363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:46.063075 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-5446b18d-8949-4800-9273-7fcca4c0e363 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:46.065422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-5446b18d-8949-4800-9273-7fcca4c0e363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:46.085641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78470488-29e6-4e5e-9838-558f534e0822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:46.087080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78470488-29e6-4e5e-9838-558f534e0822 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:46.097801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 806/1621] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:55:46.102386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19d05c-d279-49bb-8de9-9d09b05f1cd0 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:46.102386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19d05c-d279-49bb-8de9-9d09b05f1cd0 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:46.102386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19d05c-d279-49bb-8de9-9d09b05f1cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:46.137924 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 816/1622] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:46.138791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446b18d-8949-4800-9273-7fcca4c0e363 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:46.141630 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-be19d05c-d279-49bb-8de9-9d09b05f1cd0 None None] MFA Rules not processed for user `421f6cc846b342918a177d2794eb3db8`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:46.143268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-be19d05c-d279-49bb-8de9-9d09b05f1cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:46.148862 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446b18d-8949-4800-9273-7fcca4c0e363 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:46.153505 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d61915-7dfc-4650-887e-8d57f6e5a3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:46.154118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d61915-7dfc-4650-887e-8d57f6e5a3ff admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:46.154396 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d61915-7dfc-4650-887e-8d57f6e5a3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:46.154712 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d61915-7dfc-4650-887e-8d57f6e5a3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:46.155362 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d61915-7dfc-4650-887e-8d57f6e5a3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:46.156980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d61915-7dfc-4650-887e-8d57f6e5a3ff admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:46.169850 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 817/1623] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:46.169850 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244c9d7-7430-4b84-8cb8-3572c64b4e21 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:46.169850 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244c9d7-7430-4b84-8cb8-3572c64b4e21 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:46.170149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244c9d7-7430-4b84-8cb8-3572c64b4e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:46.200429 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-7244c9d7-7430-4b84-8cb8-3572c64b4e21 None None] MFA Rules not processed for user `5f5a2982651f4660ad2e1596a7ff6202`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:46.201645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-7244c9d7-7430-4b84-8cb8-3572c64b4e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:46.215277 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 807/1624] 10.222.0.15 () {58 vars in 1059 bytes} [Wed Sep 14 19:55:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:46.216086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19d05c-d279-49bb-8de9-9d09b05f1cd0 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:46.225240 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19d05c-d279-49bb-8de9-9d09b05f1cd0 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:46.232465 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4230521-d380-457e-a11b-3baac6df421f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:46.234354 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4230521-d380-457e-a11b-3baac6df421f service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:46.234354 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4230521-d380-457e-a11b-3baac6df421f service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:46.234354 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4230521-d380-457e-a11b-3baac6df421f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:46.244463 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4230521-d380-457e-a11b-3baac6df421f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:46.246222 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4230521-d380-457e-a11b-3baac6df421f service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:46.257876 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 808/1625] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:55:46.259249 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb36945-82ec-4e65-a940-532395b8779c None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:46.259574 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb36945-82ec-4e65-a940-532395b8779c None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:46.259994 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb36945-82ec-4e65-a940-532395b8779c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:46.283619 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 818/1626] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:46.286170 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b524309-c91d-4b1a-9afe-ef594f569eb9 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:46.286170 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b524309-c91d-4b1a-9afe-ef594f569eb9 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:46.286170 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b524309-c91d-4b1a-9afe-ef594f569eb9 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:46.287829 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 819/1627] 10.222.0.15 () {54 vars in 962 bytes} [Wed Sep 14 19:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:55:46.288454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b524309-c91d-4b1a-9afe-ef594f569eb9 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:46.297045 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-feb36945-82ec-4e65-a940-532395b8779c None None] MFA Rules not processed for user `55389c35c61b499aa0cf8d4c0d552205`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:46.299013 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-feb36945-82ec-4e65-a940-532395b8779c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:46.301784 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b524309-c91d-4b1a-9afe-ef594f569eb9 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:46.305731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30b343-584b-41bb-82f4-ca81337b4299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:46.306348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30b343-584b-41bb-82f4-ca81337b4299 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:46.306631 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30b343-584b-41bb-82f4-ca81337b4299 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:46.306906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30b343-584b-41bb-82f4-ca81337b4299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:46.318214 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30b343-584b-41bb-82f4-ca81337b4299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:46.320327 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30b343-584b-41bb-82f4-ca81337b4299 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:46.330738 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 820/1628] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:55:46.331431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30b343-584b-41bb-82f4-ca81337b4299 service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:46.342657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30b343-584b-41bb-82f4-ca81337b4299 service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:46.348207 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a29d97-69d4-4390-9de1-0d0aed0df5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:46.349169 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a29d97-69d4-4390-9de1-0d0aed0df5d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:46.349531 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a29d97-69d4-4390-9de1-0d0aed0df5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:46.349860 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a29d97-69d4-4390-9de1-0d0aed0df5d6 admin admin] PATH_INFO: `/v3/projects/b193ebda478346ffb5ecaef06cd96983/users/1b6db6f2ea824ab5a34a8fe44ac8cc90/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:46.352407 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a29d97-69d4-4390-9de1-0d0aed0df5d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b193ebda478346ffb5ecaef06cd96983, user_id=1b6db6f2ea824ab5a34a8fe44ac8cc90, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:46.355750 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a29d97-69d4-4390-9de1-0d0aed0df5d6 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:46.367380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 821/1629] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:55:46 2022] PUT /identity/v3/projects/b193ebda478346ffb5ecaef06cd96983/users/1b6db6f2ea824ab5a34a8fe44ac8cc90/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:46.368324 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a29d97-69d4-4390-9de1-0d0aed0df5d6 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:46.388619 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 809/1630] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:46 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:46.389527 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb36945-82ec-4e65-a940-532395b8779c None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:46.409197 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:46.448950 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:46.452970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb36945-82ec-4e65-a940-532395b8779c None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:46.453956 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a29d97-69d4-4390-9de1-0d0aed0df5d6 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:46.459809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30093985-3842-4c7d-a507-248ccb30164b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:46.464063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30093985-3842-4c7d-a507-248ccb30164b service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:46.464063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30093985-3842-4c7d-a507-248ccb30164b service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:46.464063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30093985-3842-4c7d-a507-248ccb30164b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:46.520712 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385b484-a078-4b9c-9544-c9e58ca93f26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:46.521323 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385b484-a078-4b9c-9544-c9e58ca93f26 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:46.521601 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385b484-a078-4b9c-9544-c9e58ca93f26 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:46.521923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385b484-a078-4b9c-9544-c9e58ca93f26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:46.525787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30093985-3842-4c7d-a507-248ccb30164b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:46.527678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30093985-3842-4c7d-a507-248ccb30164b service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:46.540871 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 822/1631] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:55:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:55:46.558316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f897369-b264-4142-993a-7599f0d25d84 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:46.567199 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f897369-b264-4142-993a-7599f0d25d84 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:46.567199 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f897369-b264-4142-993a-7599f0d25d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:46.587640 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385b484-a078-4b9c-9544-c9e58ca93f26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:46.589522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385b484-a078-4b9c-9544-c9e58ca93f26 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:46.601783 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 810/1632] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:55:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:55:46.931735 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35049d95-484d-44ea-a61f-5a13c8ef3d20 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:46.931735 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35049d95-484d-44ea-a61f-5a13c8ef3d20 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:46.931735 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35049d95-484d-44ea-a61f-5a13c8ef3d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:46.954314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-2f897369-b264-4142-993a-7599f0d25d84 None None] MFA Rules not processed for user `421f6cc846b342918a177d2794eb3db8`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:46.954314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2f897369-b264-4142-993a-7599f0d25d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:46.957546 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-35049d95-484d-44ea-a61f-5a13c8ef3d20 None None] MFA Rules not processed for user `1b6db6f2ea824ab5a34a8fe44ac8cc90`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:46.957546 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-35049d95-484d-44ea-a61f-5a13c8ef3d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:46.960270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 823/1633] 10.222.0.15 () {58 vars in 1059 bytes} [Wed Sep 14 19:55:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:46.960270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f897369-b264-4142-993a-7599f0d25d84 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:46.960270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f897369-b264-4142-993a-7599f0d25d84 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:46.960270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda565d-772b-401e-a18b-d73a10e72062 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:46.965763 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda565d-772b-401e-a18b-d73a10e72062 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:46.965763 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda565d-772b-401e-a18b-d73a10e72062 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:46.965763 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda565d-772b-401e-a18b-d73a10e72062 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:46.967128 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:46.968201 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda565d-772b-401e-a18b-d73a10e72062 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:46.968201 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda565d-772b-401e-a18b-d73a10e72062 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:46.969392 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 811/1634] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:46.969392 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35049d95-484d-44ea-a61f-5a13c8ef3d20 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:46.969392 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35049d95-484d-44ea-a61f-5a13c8ef3d20 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:46.972344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 824/1635] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:55:46 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:55:46.973521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd47b95-d553-42cd-a8da-60ae522f6574 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:46.973521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd47b95-d553-42cd-a8da-60ae522f6574 service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:46.973521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd47b95-d553-42cd-a8da-60ae522f6574 service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:46.973521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd47b95-d553-42cd-a8da-60ae522f6574 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:46.976607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ed27c-39c7-4c05-b9d2-ef9ce2bca947 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:46.976607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ed27c-39c7-4c05-b9d2-ef9ce2bca947 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:46.976607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ed27c-39c7-4c05-b9d2-ef9ce2bca947 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:46.976607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 825/1636] 10.222.0.15 () {54 vars in 912 bytes} [Wed Sep 14 19:55:46 2022] GET /identity => generated 270 bytes in 49 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 19:55:46.976607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb208b5-d65e-4ddd-b9b6-5c0b013bf92f None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:46.976607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb208b5-d65e-4ddd-b9b6-5c0b013bf92f None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:46.987455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb208b5-d65e-4ddd-b9b6-5c0b013bf92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:47.000421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd47b95-d553-42cd-a8da-60ae522f6574 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:47.007042 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd47b95-d553-42cd-a8da-60ae522f6574 service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:47.028804 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 812/1637] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:55:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:55:47.029684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd47b95-d553-42cd-a8da-60ae522f6574 service nova] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:47.030600 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-2cb208b5-d65e-4ddd-b9b6-5c0b013bf92f None None] MFA Rules not processed for user `421f6cc846b342918a177d2794eb3db8`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:47.034451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2cb208b5-d65e-4ddd-b9b6-5c0b013bf92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:47.041881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd47b95-d553-42cd-a8da-60ae522f6574 service nova] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:47.045837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3fa27-9682-408e-a06f-aa23b35b4135 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:47.046607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3fa27-9682-408e-a06f-aa23b35b4135 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:47.047098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3fa27-9682-408e-a06f-aa23b35b4135 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:47.047591 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3fa27-9682-408e-a06f-aa23b35b4135 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:47.057894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 826/1638] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Sep 14 19:55:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:47.133816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3fa27-9682-408e-a06f-aa23b35b4135 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:47.137437 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3fa27-9682-408e-a06f-aa23b35b4135 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:47.150882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 813/1639] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:55:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:55:47.457889 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74c49c-ba6a-47c0-b7ba-06b5a1fde2aa None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:47.459066 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74c49c-ba6a-47c0-b7ba-06b5a1fde2aa None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:47.459479 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74c49c-ba6a-47c0-b7ba-06b5a1fde2aa None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:47.461930 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 827/1640] 10.222.0.15 () {54 vars in 912 bytes} [Wed Sep 14 19:55:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:55:47.468280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4c448-6c6a-467f-8366-ad9a9577efa5 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:47.468559 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4c448-6c6a-467f-8366-ad9a9577efa5 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:47.468830 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4c448-6c6a-467f-8366-ad9a9577efa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:47.497935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-0ca4c448-6c6a-467f-8366-ad9a9577efa5 None None] MFA Rules not processed for user `421f6cc846b342918a177d2794eb3db8`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:47.513305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0ca4c448-6c6a-467f-8366-ad9a9577efa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:47.544515 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 814/1641] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Sep 14 19:55:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:47.972271 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74c49c-ba6a-47c0-b7ba-06b5a1fde2aa None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:47.985376 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74c49c-ba6a-47c0-b7ba-06b5a1fde2aa None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:47.989559 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d363e-c763-4448-8a0c-da5688c6422d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:47.990398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d363e-c763-4448-8a0c-da5688c6422d service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:47.990789 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d363e-c763-4448-8a0c-da5688c6422d service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:47.991128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d363e-c763-4448-8a0c-da5688c6422d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:48.001912 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d363e-c763-4448-8a0c-da5688c6422d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:48.003448 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d363e-c763-4448-8a0c-da5688c6422d service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:48.015200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 828/1642] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:55:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:55:48.359116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4c448-6c6a-467f-8366-ad9a9577efa5 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:48.391597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4c448-6c6a-467f-8366-ad9a9577efa5 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:48.399771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e80dd-2707-4c0e-a7b6-68e05a825d44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:48.400508 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e80dd-2707-4c0e-a7b6-68e05a825d44 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:48.400856 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e80dd-2707-4c0e-a7b6-68e05a825d44 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:48.401666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e80dd-2707-4c0e-a7b6-68e05a825d44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:48.416652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e80dd-2707-4c0e-a7b6-68e05a825d44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:48.418102 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e80dd-2707-4c0e-a7b6-68e05a825d44 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:48.429524 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 815/1643] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:55:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:55:49.206447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d363e-c763-4448-8a0c-da5688c6422d service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:49.257800 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:49.296841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d363e-c763-4448-8a0c-da5688c6422d service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:49.307135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4107d-2f72-4d1a-998b-372c6fd43b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:49.308181 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4107d-2f72-4d1a-998b-372c6fd43b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:49.308709 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4107d-2f72-4d1a-998b-372c6fd43b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:49.309165 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4107d-2f72-4d1a-998b-372c6fd43b3f admin admin] PATH_INFO: `/v3/users/254e2c96e6b34d4da8ea9d68e503851f` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:49.312919 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4107d-2f72-4d1a-998b-372c6fd43b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=254e2c96e6b34d4da8ea9d68e503851f)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:49.316022 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4107d-2f72-4d1a-998b-372c6fd43b3f admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:49.545386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bbd4107d-2f72-4d1a-998b-372c6fd43b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '254e2c96e6b34d4da8ea9d68e503851f'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:49.641099 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bbd4107d-2f72-4d1a-998b-372c6fd43b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '254e2c96e6b34d4da8ea9d68e503851f'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:49.644409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bbd4107d-2f72-4d1a-998b-372c6fd43b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '254e2c96e6b34d4da8ea9d68e503851f'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:49.674693 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bbd4107d-2f72-4d1a-998b-372c6fd43b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '254e2c96e6b34d4da8ea9d68e503851f'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:49.685226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bbd4107d-2f72-4d1a-998b-372c6fd43b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '254e2c96e6b34d4da8ea9d68e503851f'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:49.699330 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 829/1644] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:55:49 2022] DELETE /identity/v3/users/254e2c96e6b34d4da8ea9d68e503851f => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:49.703624 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01efe4-bb86-46ec-96b9-252ec8d325ce None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:49.704118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01efe4-bb86-46ec-96b9-252ec8d325ce None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:49.704716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01efe4-bb86-46ec-96b9-252ec8d325ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:49.733968 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-ce01efe4-bb86-46ec-96b9-252ec8d325ce None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:49.737284 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ce01efe4-bb86-46ec-96b9-252ec8d325ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:49.827516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:49.842952 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 816/1645] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:49.863885 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4107d-2f72-4d1a-998b-372c6fd43b3f admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:49.870238 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-bbd4107d-2f72-4d1a-998b-372c6fd43b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:49.974894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4107d-2f72-4d1a-998b-372c6fd43b3f admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:49.979223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce3dd2-7720-43ee-b1dd-88ebd2aae2d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:49.979964 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce3dd2-7720-43ee-b1dd-88ebd2aae2d2 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:49.980246 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce3dd2-7720-43ee-b1dd-88ebd2aae2d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:49.980523 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce3dd2-7720-43ee-b1dd-88ebd2aae2d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:49.994667 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce3dd2-7720-43ee-b1dd-88ebd2aae2d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:49.995511 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce3dd2-7720-43ee-b1dd-88ebd2aae2d2 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:50.021863 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 830/1646] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:55:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:55:51.619348 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01efe4-bb86-46ec-96b9-252ec8d325ce None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:51.626213 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ce01efe4-bb86-46ec-96b9-252ec8d325ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:51.661051 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01efe4-bb86-46ec-96b9-252ec8d325ce None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:51.675332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b97599-c37e-48df-8e5c-59d60bf108f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:51.675910 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b97599-c37e-48df-8e5c-59d60bf108f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:51.679060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b97599-c37e-48df-8e5c-59d60bf108f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:51.680589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b97599-c37e-48df-8e5c-59d60bf108f3 admin admin] PATH_INFO: `/v3/projects/425c0d41bb054c00893a9b9dc7a0fa10` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:51.685239 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b97599-c37e-48df-8e5c-59d60bf108f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=425c0d41bb054c00893a9b9dc7a0fa10)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:51.694189 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b97599-c37e-48df-8e5c-59d60bf108f3 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:51.923222 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-82b97599-c37e-48df-8e5c-59d60bf108f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '425c0d41bb054c00893a9b9dc7a0fa10', 'request_id': 'req-82b97599-c37e-48df-8e5c-59d60bf108f3'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:52.023675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-82b97599-c37e-48df-8e5c-59d60bf108f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '425c0d41bb054c00893a9b9dc7a0fa10', 'request_id': 'req-82b97599-c37e-48df-8e5c-59d60bf108f3'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:52.039342 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-82b97599-c37e-48df-8e5c-59d60bf108f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '425c0d41bb054c00893a9b9dc7a0fa10', 'request_id': 'req-82b97599-c37e-48df-8e5c-59d60bf108f3'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:52.055720 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-82b97599-c37e-48df-8e5c-59d60bf108f3 admin admin] The token cache is being invalidate because project 425c0d41bb054c00893a9b9dc7a0fa10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:55:52.056240 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-82b97599-c37e-48df-8e5c-59d60bf108f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:52.057240 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-82b97599-c37e-48df-8e5c-59d60bf108f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:52.062422 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 817/1647] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:55:51 2022] DELETE /identity/v3/projects/425c0d41bb054c00893a9b9dc7a0fa10 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:52.066150 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce3dd2-7720-43ee-b1dd-88ebd2aae2d2 service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:52.089083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce3dd2-7720-43ee-b1dd-88ebd2aae2d2 service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:52.316402 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933db22-5200-4aa5-8831-cae577665229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:52.317568 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933db22-5200-4aa5-8831-cae577665229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:52.318284 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933db22-5200-4aa5-8831-cae577665229 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:52.318771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933db22-5200-4aa5-8831-cae577665229 admin admin] PATH_INFO: `/v3/users/55389c35c61b499aa0cf8d4c0d552205` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:52.320217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933db22-5200-4aa5-8831-cae577665229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55389c35c61b499aa0cf8d4c0d552205)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:52.322909 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933db22-5200-4aa5-8831-cae577665229 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:52.326837 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:52.627607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b97599-c37e-48df-8e5c-59d60bf108f3 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:52.629081 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-82b97599-c37e-48df-8e5c-59d60bf108f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:52.645077 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-9933db22-5200-4aa5-8831-cae577665229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55389c35c61b499aa0cf8d4c0d552205'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:52.734026 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-9933db22-5200-4aa5-8831-cae577665229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55389c35c61b499aa0cf8d4c0d552205'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:52.735898 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-9933db22-5200-4aa5-8831-cae577665229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55389c35c61b499aa0cf8d4c0d552205'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:52.776944 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-9933db22-5200-4aa5-8831-cae577665229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55389c35c61b499aa0cf8d4c0d552205'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:52.786711 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b97599-c37e-48df-8e5c-59d60bf108f3 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:52.788101 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-9933db22-5200-4aa5-8831-cae577665229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55389c35c61b499aa0cf8d4c0d552205'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:52.804492 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 831/1648] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:55:52 2022] DELETE /identity/v3/users/55389c35c61b499aa0cf8d4c0d552205 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:52.810574 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e8ff3-25dd-4955-9d09-0c1a40af0dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:52.811260 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e8ff3-25dd-4955-9d09-0c1a40af0dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:52.816153 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e8ff3-25dd-4955-9d09-0c1a40af0dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:52.816153 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e8ff3-25dd-4955-9d09-0c1a40af0dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:52.816153 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d46e8ff3-25dd-4955-9d09-0c1a40af0dc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:53.013666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e8ff3-25dd-4955-9d09-0c1a40af0dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:53.015232 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e8ff3-25dd-4955-9d09-0c1a40af0dc2 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:53.049951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 818/1649] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:55:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:55:53.460469 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933db22-5200-4aa5-8831-cae577665229 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:53.461049 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-9933db22-5200-4aa5-8831-cae577665229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:53.648936 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933db22-5200-4aa5-8831-cae577665229 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:53.665907 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f9226-1ee7-411e-84af-d7fe162dee79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:53.666904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f9226-1ee7-411e-84af-d7fe162dee79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:53.666904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f9226-1ee7-411e-84af-d7fe162dee79 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:53.667277 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f9226-1ee7-411e-84af-d7fe162dee79 admin admin] PATH_INFO: `/v3/users/a73bbbd0e1394f6799d6e7db603c1aa8` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:53.668894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f9226-1ee7-411e-84af-d7fe162dee79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73bbbd0e1394f6799d6e7db603c1aa8)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:53.671104 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f9226-1ee7-411e-84af-d7fe162dee79 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:54.028719 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-f47f9226-1ee7-411e-84af-d7fe162dee79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73bbbd0e1394f6799d6e7db603c1aa8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:54.151929 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-f47f9226-1ee7-411e-84af-d7fe162dee79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73bbbd0e1394f6799d6e7db603c1aa8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:54.152499 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-f47f9226-1ee7-411e-84af-d7fe162dee79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73bbbd0e1394f6799d6e7db603c1aa8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:54.192639 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-f47f9226-1ee7-411e-84af-d7fe162dee79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73bbbd0e1394f6799d6e7db603c1aa8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:54.215111 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-f47f9226-1ee7-411e-84af-d7fe162dee79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73bbbd0e1394f6799d6e7db603c1aa8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:54.233496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e8ff3-25dd-4955-9d09-0c1a40af0dc2 service cinder] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:54.240430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 832/1650] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:55:53 2022] DELETE /identity/v3/users/a73bbbd0e1394f6799d6e7db603c1aa8 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:54.242365 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d46e8ff3-25dd-4955-9d09-0c1a40af0dc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:54.249020 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb9f5e-3db7-44e2-abae-e3b727327c62 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:54.255931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb9f5e-3db7-44e2-abae-e3b727327c62 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:54.257567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb9f5e-3db7-44e2-abae-e3b727327c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:54.267304 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e8ff3-25dd-4955-9d09-0c1a40af0dc2 service cinder] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:54.285623 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-bffb9f5e-3db7-44e2-abae-e3b727327c62 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:54.288503 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-bffb9f5e-3db7-44e2-abae-e3b727327c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:54.385312 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:54.450720 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48cad5-5ec5-4086-9334-0022c16c8c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:54.451637 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48cad5-5ec5-4086-9334-0022c16c8c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:54.463334 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48cad5-5ec5-4086-9334-0022c16c8c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:54.466644 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48cad5-5ec5-4086-9334-0022c16c8c28 admin admin] PATH_INFO: `/v3/projects/6024af8e49f745028b83bab50aabb144` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:54.471855 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48cad5-5ec5-4086-9334-0022c16c8c28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6024af8e49f745028b83bab50aabb144)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:54.472819 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 833/1651] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:54.478270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48cad5-5ec5-4086-9334-0022c16c8c28 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:54.541071 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb9f5e-3db7-44e2-abae-e3b727327c62 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:54.543064 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-bffb9f5e-3db7-44e2-abae-e3b727327c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:54.678506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-6b48cad5-5ec5-4086-9334-0022c16c8c28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6024af8e49f745028b83bab50aabb144', 'request_id': 'req-6b48cad5-5ec5-4086-9334-0022c16c8c28'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:54.741511 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb9f5e-3db7-44e2-abae-e3b727327c62 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:54.832218 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-6b48cad5-5ec5-4086-9334-0022c16c8c28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6024af8e49f745028b83bab50aabb144', 'request_id': 'req-6b48cad5-5ec5-4086-9334-0022c16c8c28'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:54.843858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219f8bb-cd52-4d36-bbfe-66982674c458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:54.852556 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219f8bb-cd52-4d36-bbfe-66982674c458 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:54.852556 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219f8bb-cd52-4d36-bbfe-66982674c458 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:54.852556 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219f8bb-cd52-4d36-bbfe-66982674c458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:54.854897 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-6b48cad5-5ec5-4086-9334-0022c16c8c28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6024af8e49f745028b83bab50aabb144', 'request_id': 'req-6b48cad5-5ec5-4086-9334-0022c16c8c28'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:54.881663 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-6b48cad5-5ec5-4086-9334-0022c16c8c28 admin admin] The token cache is being invalidate because project 6024af8e49f745028b83bab50aabb144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:55:54.881989 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-6b48cad5-5ec5-4086-9334-0022c16c8c28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:54.890460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-6b48cad5-5ec5-4086-9334-0022c16c8c28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:54.901747 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 819/1652] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:55:54 2022] DELETE /identity/v3/projects/6024af8e49f745028b83bab50aabb144 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:54.907597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899161a-7fbe-4fa1-a9a5-0388c49e4de8 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:54.907597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899161a-7fbe-4fa1-a9a5-0388c49e4de8 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:54.907597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899161a-7fbe-4fa1-a9a5-0388c49e4de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:54.973051 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219f8bb-cd52-4d36-bbfe-66982674c458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:54.974587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219f8bb-cd52-4d36-bbfe-66982674c458 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:54.989008 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-f899161a-7fbe-4fa1-a9a5-0388c49e4de8 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:54.991151 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f899161a-7fbe-4fa1-a9a5-0388c49e4de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:54.995670 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 834/1653] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:55:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:55:55.013847 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 820/1654] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:55.023941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621aadb-0002-48bc-9b32-e8f76d8828e1 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:55.023941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621aadb-0002-48bc-9b32-e8f76d8828e1 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:55.023941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621aadb-0002-48bc-9b32-e8f76d8828e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:55.093173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-f621aadb-0002-48bc-9b32-e8f76d8828e1 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:55.094400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f621aadb-0002-48bc-9b32-e8f76d8828e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:55.142922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 835/1655] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:55:55.149878 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899161a-7fbe-4fa1-a9a5-0388c49e4de8 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:55.178829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899161a-7fbe-4fa1-a9a5-0388c49e4de8 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:55.184622 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22907bbc-cfc5-4c5b-8330-15daa490871b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:55.185117 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22907bbc-cfc5-4c5b-8330-15daa490871b admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:55.185431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22907bbc-cfc5-4c5b-8330-15daa490871b admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:55.185697 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22907bbc-cfc5-4c5b-8330-15daa490871b admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:55.186339 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22907bbc-cfc5-4c5b-8330-15daa490871b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:55:55.186649 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22907bbc-cfc5-4c5b-8330-15daa490871b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:55.188286 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22907bbc-cfc5-4c5b-8330-15daa490871b admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:55.219640 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 821/1656] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:55:55.222882 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621aadb-0002-48bc-9b32-e8f76d8828e1 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:55.252635 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621aadb-0002-48bc-9b32-e8f76d8828e1 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:55.260180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507dacb0-1a35-4fd8-9273-64a9a0af234b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:55.261262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dacb0-1a35-4fd8-9273-64a9a0af234b admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:55.261777 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dacb0-1a35-4fd8-9273-64a9a0af234b admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:55.262229 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dacb0-1a35-4fd8-9273-64a9a0af234b admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:55.263070 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507dacb0-1a35-4fd8-9273-64a9a0af234b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:55.266022 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507dacb0-1a35-4fd8-9273-64a9a0af234b admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:55.423275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22907bbc-cfc5-4c5b-8330-15daa490871b admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:55.432018 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 836/1657] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:55:55 2022] POST /identity/v3/projects => generated 371 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:55.444941 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22907bbc-cfc5-4c5b-8330-15daa490871b admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:55.503962 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:55.604968 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1245b8c-d9cf-4d7a-b591-d8ba121733bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:55.607639 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1245b8c-d9cf-4d7a-b591-d8ba121733bc admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:55.608028 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1245b8c-d9cf-4d7a-b591-d8ba121733bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:55.608416 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1245b8c-d9cf-4d7a-b591-d8ba121733bc admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:55.609185 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1245b8c-d9cf-4d7a-b591-d8ba121733bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:55.617122 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1245b8c-d9cf-4d7a-b591-d8ba121733bc admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:55.735945 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 822/1658] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:55:55 2022] POST /identity/v3/users => generated 286 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:55.740248 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507dacb0-1a35-4fd8-9273-64a9a0af234b admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:55.761877 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507dacb0-1a35-4fd8-9273-64a9a0af234b admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:55.790933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43f429-da2b-4b10-847e-9d84988054cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:55.796161 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43f429-da2b-4b10-847e-9d84988054cb admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:55.798240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43f429-da2b-4b10-847e-9d84988054cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:55.798536 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43f429-da2b-4b10-847e-9d84988054cb admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:55.802031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43f429-da2b-4b10-847e-9d84988054cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:55.803783 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43f429-da2b-4b10-847e-9d84988054cb admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:55.836049 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 837/1659] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:55.836932 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1245b8c-d9cf-4d7a-b591-d8ba121733bc admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:55.847925 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1245b8c-d9cf-4d7a-b591-d8ba121733bc admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:55.869714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f7b74-34b9-4e6a-adc4-ccbb914d84b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:55.871098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f7b74-34b9-4e6a-adc4-ccbb914d84b3 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:55.871386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f7b74-34b9-4e6a-adc4-ccbb914d84b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:55.873474 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f7b74-34b9-4e6a-adc4-ccbb914d84b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:55.875758 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f7b74-34b9-4e6a-adc4-ccbb914d84b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:55.877427 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f7b74-34b9-4e6a-adc4-ccbb914d84b3 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:55.915585 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 823/1660] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:55.919400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43f429-da2b-4b10-847e-9d84988054cb admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:55.939911 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43f429-da2b-4b10-847e-9d84988054cb admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:55.961634 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d52db0-8814-43c8-9f36-34e8ed297079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:55.962252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d52db0-8814-43c8-9f36-34e8ed297079 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:55.963182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d52db0-8814-43c8-9f36-34e8ed297079 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:55.963473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d52db0-8814-43c8-9f36-34e8ed297079 admin admin] PATH_INFO: `/v3/projects/2783d6eada0c4ba99e57e2bbaae4f3c6/users/298619956ec64676aa24441c734641af/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:56.026391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d52db0-8814-43c8-9f36-34e8ed297079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2783d6eada0c4ba99e57e2bbaae4f3c6, user_id=298619956ec64676aa24441c734641af, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:56.044854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d52db0-8814-43c8-9f36-34e8ed297079 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:56.200133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 838/1661] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:55:55 2022] PUT /identity/v3/projects/2783d6eada0c4ba99e57e2bbaae4f3c6/users/298619956ec64676aa24441c734641af/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:56.202551 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6f31f-f476-4aa4-b2ef-5caa9b97477f None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:56.203025 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6f31f-f476-4aa4-b2ef-5caa9b97477f None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:56.203439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6f31f-f476-4aa4-b2ef-5caa9b97477f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:56.251827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-1ac6f31f-f476-4aa4-b2ef-5caa9b97477f None None] MFA Rules not processed for user `298619956ec64676aa24441c734641af`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:56.256247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1ac6f31f-f476-4aa4-b2ef-5caa9b97477f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:56.484668 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 824/1662] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:56.490478 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d52db0-8814-43c8-9f36-34e8ed297079 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:56.599491 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d52db0-8814-43c8-9f36-34e8ed297079 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:56.615259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd7562-bc67-477e-a9ad-1559c3ab93f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:56.615932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd7562-bc67-477e-a9ad-1559c3ab93f5 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:56.616216 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd7562-bc67-477e-a9ad-1559c3ab93f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:56.616491 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd7562-bc67-477e-a9ad-1559c3ab93f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:56.617144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd7562-bc67-477e-a9ad-1559c3ab93f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:56.619399 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd7562-bc67-477e-a9ad-1559c3ab93f5 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:56.779727 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 839/1663] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:55:56 2022] POST /identity/v3/projects => generated 371 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:56.785113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6f31f-f476-4aa4-b2ef-5caa9b97477f None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:56.822149 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6f31f-f476-4aa4-b2ef-5caa9b97477f None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:56.990485 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39b5f8-ab83-4fca-82a7-95537daf28c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:56.991050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39b5f8-ab83-4fca-82a7-95537daf28c6 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:56.991329 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39b5f8-ab83-4fca-82a7-95537daf28c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:56.991624 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39b5f8-ab83-4fca-82a7-95537daf28c6 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:56.992365 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39b5f8-ab83-4fca-82a7-95537daf28c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:57.002041 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39b5f8-ab83-4fca-82a7-95537daf28c6 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:57.038261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd7562-bc67-477e-a9ad-1559c3ab93f5 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:57.044294 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-d0dd7562-bc67-477e-a9ad-1559c3ab93f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:57.100965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd7562-bc67-477e-a9ad-1559c3ab93f5 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:57.120670 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebcc3c-6106-4a30-9cdc-49a9b0f03a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:57.123082 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebcc3c-6106-4a30-9cdc-49a9b0f03a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:57.127469 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebcc3c-6106-4a30-9cdc-49a9b0f03a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:57.128058 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebcc3c-6106-4a30-9cdc-49a9b0f03a3e admin admin] PATH_INFO: `/v3/users/5844b1ac8e9f46ee85c55fb9d2e1f18b` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:57.139044 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebcc3c-6106-4a30-9cdc-49a9b0f03a3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5844b1ac8e9f46ee85c55fb9d2e1f18b)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:57.145904 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 825/1664] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:55:56 2022] POST /identity/v3/users => generated 292 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:57.152233 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebcc3c-6106-4a30-9cdc-49a9b0f03a3e admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:57.157142 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39b5f8-ab83-4fca-82a7-95537daf28c6 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:57.213487 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39b5f8-ab83-4fca-82a7-95537daf28c6 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:57.235674 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554ec9e-0362-4c81-bd32-801b4101b5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:57.239979 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554ec9e-0362-4c81-bd32-801b4101b5bd admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:57.244074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554ec9e-0362-4c81-bd32-801b4101b5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:57.245610 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554ec9e-0362-4c81-bd32-801b4101b5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:57.250427 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554ec9e-0362-4c81-bd32-801b4101b5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:57.262882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554ec9e-0362-4c81-bd32-801b4101b5bd admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:57.310424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 826/1665] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:57.315243 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554ec9e-0362-4c81-bd32-801b4101b5bd admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:57.319713 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d554ec9e-0362-4c81-bd32-801b4101b5bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:57.356661 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554ec9e-0362-4c81-bd32-801b4101b5bd admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:57.375148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3a68d-23a8-4427-9cc0-f1183ec8fec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:57.376108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3a68d-23a8-4427-9cc0-f1183ec8fec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:57.376393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3a68d-23a8-4427-9cc0-f1183ec8fec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:57.376672 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3a68d-23a8-4427-9cc0-f1183ec8fec0 admin admin] PATH_INFO: `/v3/projects/d84e7ca067c54214ab9a05aee9d4d662` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:57.383781 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3a68d-23a8-4427-9cc0-f1183ec8fec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84e7ca067c54214ab9a05aee9d4d662)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:57.386940 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3a68d-23a8-4427-9cc0-f1183ec8fec0 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:57.514049 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d9ebcc3c-6106-4a30-9cdc-49a9b0f03a3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5844b1ac8e9f46ee85c55fb9d2e1f18b'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:57.551658 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-51d3a68d-23a8-4427-9cc0-f1183ec8fec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84e7ca067c54214ab9a05aee9d4d662', 'request_id': 'req-51d3a68d-23a8-4427-9cc0-f1183ec8fec0'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:57.623604 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d9ebcc3c-6106-4a30-9cdc-49a9b0f03a3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5844b1ac8e9f46ee85c55fb9d2e1f18b'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:57.624909 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d9ebcc3c-6106-4a30-9cdc-49a9b0f03a3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5844b1ac8e9f46ee85c55fb9d2e1f18b'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:57.654720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d9ebcc3c-6106-4a30-9cdc-49a9b0f03a3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5844b1ac8e9f46ee85c55fb9d2e1f18b'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:57.667910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d9ebcc3c-6106-4a30-9cdc-49a9b0f03a3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5844b1ac8e9f46ee85c55fb9d2e1f18b'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:57.684391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 840/1666] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:55:57 2022] DELETE /identity/v3/users/5844b1ac8e9f46ee85c55fb9d2e1f18b => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:57.684391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebcc3c-6106-4a30-9cdc-49a9b0f03a3e admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:57.684677 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-d9ebcc3c-6106-4a30-9cdc-49a9b0f03a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:57.688791 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-51d3a68d-23a8-4427-9cc0-f1183ec8fec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84e7ca067c54214ab9a05aee9d4d662', 'request_id': 'req-51d3a68d-23a8-4427-9cc0-f1183ec8fec0'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:57.701327 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-51d3a68d-23a8-4427-9cc0-f1183ec8fec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84e7ca067c54214ab9a05aee9d4d662', 'request_id': 'req-51d3a68d-23a8-4427-9cc0-f1183ec8fec0'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:57.737666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-51d3a68d-23a8-4427-9cc0-f1183ec8fec0 admin admin] The token cache is being invalidate because project d84e7ca067c54214ab9a05aee9d4d662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:55:57.745112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-51d3a68d-23a8-4427-9cc0-f1183ec8fec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:57.745112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-51d3a68d-23a8-4427-9cc0-f1183ec8fec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:55:57.747175 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 827/1667] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:55:57 2022] DELETE /identity/v3/projects/d84e7ca067c54214ab9a05aee9d4d662 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:57.748818 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3142f02-0ef3-425d-ba2f-6a6ef53f4586 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:57.752975 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3142f02-0ef3-425d-ba2f-6a6ef53f4586 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:57.753451 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3142f02-0ef3-425d-ba2f-6a6ef53f4586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:57.808748 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-e3142f02-0ef3-425d-ba2f-6a6ef53f4586 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:57.810141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e3142f02-0ef3-425d-ba2f-6a6ef53f4586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:57.930828 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebcc3c-6106-4a30-9cdc-49a9b0f03a3e admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:57.931471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:57.950181 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c20c2a-53f3-4ff8-a309-639947719da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:57.951272 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c20c2a-53f3-4ff8-a309-639947719da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:57.951804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c20c2a-53f3-4ff8-a309-639947719da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:57.952438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c20c2a-53f3-4ff8-a309-639947719da7 admin admin] PATH_INFO: `/v3/projects/f6e91ae8a64a4fa3a91bbf529a5f331d/users/7ab617208dae47eca850e4de563b12ad/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:58.019452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c20c2a-53f3-4ff8-a309-639947719da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e91ae8a64a4fa3a91bbf529a5f331d, user_id=7ab617208dae47eca850e4de563b12ad, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:58.029740 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 828/1668] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:58.035259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c20c2a-53f3-4ff8-a309-639947719da7 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:58.054154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b489908-fa36-4328-a006-2b340e01e075 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:58.056927 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b489908-fa36-4328-a006-2b340e01e075 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:58.057579 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b489908-fa36-4328-a006-2b340e01e075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:58.123324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-0b489908-fa36-4328-a006-2b340e01e075 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:58.125621 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0b489908-fa36-4328-a006-2b340e01e075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:58.160099 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 829/1669] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:58.167083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 841/1670] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:55:57 2022] PUT /identity/v3/projects/f6e91ae8a64a4fa3a91bbf529a5f331d/users/7ab617208dae47eca850e4de563b12ad/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:58.171217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335742c-3fae-4c07-95b8-5e161d216840 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:58.173047 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c20c2a-53f3-4ff8-a309-639947719da7 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:58.179802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-98c20c2a-53f3-4ff8-a309-639947719da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:58.180981 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335742c-3fae-4c07-95b8-5e161d216840 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:58.186957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335742c-3fae-4c07-95b8-5e161d216840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:58.306058 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-b335742c-3fae-4c07-95b8-5e161d216840 None None] MFA Rules not processed for user `3725a8878d78434eb7d94fb413ba8078`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:58.306058 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b335742c-3fae-4c07-95b8-5e161d216840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:58.371896 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c20c2a-53f3-4ff8-a309-639947719da7 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:58.380952 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30f861-6a2c-4cfd-ae73-776fac7b548a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:58.381975 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30f861-6a2c-4cfd-ae73-776fac7b548a service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:58.382393 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30f861-6a2c-4cfd-ae73-776fac7b548a service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:58.384072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30f861-6a2c-4cfd-ae73-776fac7b548a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:58.527802 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 830/1671] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:58.530102 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed172947-b88b-4f8e-9d09-d15326e2643c None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:58.531725 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed172947-b88b-4f8e-9d09-d15326e2643c None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:58.533684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed172947-b88b-4f8e-9d09-d15326e2643c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:58.596889 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-ed172947-b88b-4f8e-9d09-d15326e2643c None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:58.603684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ed172947-b88b-4f8e-9d09-d15326e2643c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:58.613571 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30f861-6a2c-4cfd-ae73-776fac7b548a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:58.625751 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30f861-6a2c-4cfd-ae73-776fac7b548a service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:58.631408 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 831/1672] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:58.632825 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed172947-b88b-4f8e-9d09-d15326e2643c None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:58.634457 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ed172947-b88b-4f8e-9d09-d15326e2643c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:58.655446 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed172947-b88b-4f8e-9d09-d15326e2643c None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:58.655952 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 842/1673] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:55:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:55:58.658301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1267eb-90da-45c7-8335-c315a0c9a1d6 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:58.659136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1267eb-90da-45c7-8335-c315a0c9a1d6 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:58.660157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1267eb-90da-45c7-8335-c315a0c9a1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:58.668341 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f432842-85a6-4153-8f86-35b4b65e0ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:58.673872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f432842-85a6-4153-8f86-35b4b65e0ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:58.673872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f432842-85a6-4153-8f86-35b4b65e0ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:58.673872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f432842-85a6-4153-8f86-35b4b65e0ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:58.673872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f432842-85a6-4153-8f86-35b4b65e0ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:58.673872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f432842-85a6-4153-8f86-35b4b65e0ab8 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:58.720155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 832/1674] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:55:58.722434 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f432842-85a6-4153-8f86-35b4b65e0ab8 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:58.724309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-9c1267eb-90da-45c7-8335-c315a0c9a1d6 None None] MFA Rules not processed for user `3725a8878d78434eb7d94fb413ba8078`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:58.728747 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-9c1267eb-90da-45c7-8335-c315a0c9a1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:58.746763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f432842-85a6-4153-8f86-35b4b65e0ab8 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:58.750225 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 843/1675] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:58.751060 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1267eb-90da-45c7-8335-c315a0c9a1d6 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:58.766639 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66738577-8734-4896-8536-6ff5758d38fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:58.767278 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66738577-8734-4896-8536-6ff5758d38fb admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:58.777278 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66738577-8734-4896-8536-6ff5758d38fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:58.777278 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66738577-8734-4896-8536-6ff5758d38fb admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:58.777278 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66738577-8734-4896-8536-6ff5758d38fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:55:58.777278 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66738577-8734-4896-8536-6ff5758d38fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:58.777278 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66738577-8734-4896-8536-6ff5758d38fb admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:58.794893 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1267eb-90da-45c7-8335-c315a0c9a1d6 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:58.810053 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a50edf-1e5c-4d4a-b259-9787ae6bfdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:58.811612 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a50edf-1e5c-4d4a-b259-9787ae6bfdef admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:58.811612 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a50edf-1e5c-4d4a-b259-9787ae6bfdef admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:58.811612 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a50edf-1e5c-4d4a-b259-9787ae6bfdef admin admin] PATH_INFO: `/v3/projects/f6e91ae8a64a4fa3a91bbf529a5f331d/users/7ab617208dae47eca850e4de563b12ad/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:58.817869 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a50edf-1e5c-4d4a-b259-9787ae6bfdef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e91ae8a64a4fa3a91bbf529a5f331d, user_id=7ab617208dae47eca850e4de563b12ad, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:58.821497 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 833/1676] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:55:58.822589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66738577-8734-4896-8536-6ff5758d38fb admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:58.823286 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a50edf-1e5c-4d4a-b259-9787ae6bfdef admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:58.827896 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-66738577-8734-4896-8536-6ff5758d38fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:58.853606 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 844/1677] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:55:58 2022] PUT /identity/v3/projects/f6e91ae8a64a4fa3a91bbf529a5f331d/users/7ab617208dae47eca850e4de563b12ad/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:55:58.867421 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a50edf-1e5c-4d4a-b259-9787ae6bfdef admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:59.012243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a50edf-1e5c-4d4a-b259-9787ae6bfdef admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:59.028194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32c45e-1041-494e-869b-dc04e63458ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:59.031175 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32c45e-1041-494e-869b-dc04e63458ba admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:59.031743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32c45e-1041-494e-869b-dc04e63458ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:59.032410 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32c45e-1041-494e-869b-dc04e63458ba admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:59.035228 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32c45e-1041-494e-869b-dc04e63458ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:59.038126 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32c45e-1041-494e-869b-dc04e63458ba admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:59.102809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:59.128042 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66738577-8734-4896-8536-6ff5758d38fb admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:59.159188 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 845/1678] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:55:58 2022] POST /identity/v3/projects => generated 381 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:59.171467 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b48c9-12d9-4680-a1aa-300952b9760d None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:59.171961 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b48c9-12d9-4680-a1aa-300952b9760d None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:59.172379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b48c9-12d9-4680-a1aa-300952b9760d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:59.249854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-e26b48c9-12d9-4680-a1aa-300952b9760d None None] MFA Rules not processed for user `7ab617208dae47eca850e4de563b12ad`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:59.287731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-e26b48c9-12d9-4680-a1aa-300952b9760d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:59.381412 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f286e-e145-4531-97aa-64d8c57d77a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:59.382121 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f286e-e145-4531-97aa-64d8c57d77a5 service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:59.382412 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f286e-e145-4531-97aa-64d8c57d77a5 service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:59.382689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f286e-e145-4531-97aa-64d8c57d77a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:59.499765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 846/1679] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:55:59.500486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b48c9-12d9-4680-a1aa-300952b9760d None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:59.571885 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f286e-e145-4531-97aa-64d8c57d77a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:59.574311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f286e-e145-4531-97aa-64d8c57d77a5 service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:59.600450 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 834/1680] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:55:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 778 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:55:59.605314 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f286e-e145-4531-97aa-64d8c57d77a5 service nova] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:55:59.616268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-325f286e-e145-4531-97aa-64d8c57d77a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:59.678334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b48c9-12d9-4680-a1aa-300952b9760d None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:59.696978 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df99b0-195e-4758-aaf3-625de7a1c1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:59.697752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df99b0-195e-4758-aaf3-625de7a1c1cc admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:59.697872 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df99b0-195e-4758-aaf3-625de7a1c1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:59.698150 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df99b0-195e-4758-aaf3-625de7a1c1cc admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:59.698799 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df99b0-195e-4758-aaf3-625de7a1c1cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:55:59.700782 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df99b0-195e-4758-aaf3-625de7a1c1cc admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:55:59.812305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f286e-e145-4531-97aa-64d8c57d77a5 service nova] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:55:59.862763 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 847/1681] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:55:59 2022] POST /identity/v3/users => generated 291 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:55:59.864823 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8575e-5fb5-4aeb-a1ac-effbc62c6137 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:59.869418 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8575e-5fb5-4aeb-a1ac-effbc62c6137 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:59.869994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8575e-5fb5-4aeb-a1ac-effbc62c6137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:55:59.984015 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-25c8575e-5fb5-4aeb-a1ac-effbc62c6137 None None] MFA Rules not processed for user `e95c629061564a93acaf944fd3ea3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:55:59.985331 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-25c8575e-5fb5-4aeb-a1ac-effbc62c6137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:55:59.993988 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b59e9-5306-455e-a037-4d7006715c25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:55:59.995806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b59e9-5306-455e-a037-4d7006715c25 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:55:59.996256 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b59e9-5306-455e-a037-4d7006715c25 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:55:59.996767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b59e9-5306-455e-a037-4d7006715c25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:00.016069 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b59e9-5306-455e-a037-4d7006715c25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:00.018805 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b59e9-5306-455e-a037-4d7006715c25 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:00.073416 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 835/1682] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:55:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:00.074287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b59e9-5306-455e-a037-4d7006715c25 service cinder] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:00.086545 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:00.106977 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b59e9-5306-455e-a037-4d7006715c25 service cinder] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:00.147451 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dfe16-28c4-44f9-be78-42f113fb9abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:00.152216 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dfe16-28c4-44f9-be78-42f113fb9abf admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:00.152647 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dfe16-28c4-44f9-be78-42f113fb9abf admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:00.154171 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dfe16-28c4-44f9-be78-42f113fb9abf admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:00.159828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66dfe16-28c4-44f9-be78-42f113fb9abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:00.169729 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66dfe16-28c4-44f9-be78-42f113fb9abf admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:00.216345 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 836/1683] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:00.216550 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 848/1684] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:55:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:00.220423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dfe16-28c4-44f9-be78-42f113fb9abf admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:00.225334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8575e-5fb5-4aeb-a1ac-effbc62c6137 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:00.227394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-25c8575e-5fb5-4aeb-a1ac-effbc62c6137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:00.257663 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dfe16-28c4-44f9-be78-42f113fb9abf admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:00.278747 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9711529-2af2-4bf8-b878-224937b3ec27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:00.285517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9711529-2af2-4bf8-b878-224937b3ec27 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:00.285517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9711529-2af2-4bf8-b878-224937b3ec27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:00.285517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9711529-2af2-4bf8-b878-224937b3ec27 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:00.285517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9711529-2af2-4bf8-b878-224937b3ec27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:00.287956 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9711529-2af2-4bf8-b878-224937b3ec27 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:00.340294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 837/1685] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:00.344125 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9711529-2af2-4bf8-b878-224937b3ec27 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:00.387922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9711529-2af2-4bf8-b878-224937b3ec27 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:00.406252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92090c86-94c2-4d42-8199-36f6316da570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:00.406940 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92090c86-94c2-4d42-8199-36f6316da570 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:00.407453 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92090c86-94c2-4d42-8199-36f6316da570 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:00.407760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92090c86-94c2-4d42-8199-36f6316da570 admin admin] PATH_INFO: `/v3/projects/40e2239c31ee431bb97e2d3139a45a52/users/2d930df2d6de4698adffefb994608537/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:00.469047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92090c86-94c2-4d42-8199-36f6316da570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40e2239c31ee431bb97e2d3139a45a52, user_id=2d930df2d6de4698adffefb994608537, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:00.473037 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92090c86-94c2-4d42-8199-36f6316da570 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:00.483734 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8575e-5fb5-4aeb-a1ac-effbc62c6137 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:00.491085 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d89c5-0f57-40e4-85e1-6093956ad9fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:00.492969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d89c5-0f57-40e4-85e1-6093956ad9fd service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:00.492969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d89c5-0f57-40e4-85e1-6093956ad9fd service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:00.492969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d89c5-0f57-40e4-85e1-6093956ad9fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:00.502612 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d89c5-0f57-40e4-85e1-6093956ad9fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:00.505211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d89c5-0f57-40e4-85e1-6093956ad9fd service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:00.517380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 849/1686] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:00.518968 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1743ee-ab93-4a8a-be48-29ec0702a53e None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:00.519384 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1743ee-ab93-4a8a-be48-29ec0702a53e None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:00.519805 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1743ee-ab93-4a8a-be48-29ec0702a53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:00.552860 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-8e1743ee-ab93-4a8a-be48-29ec0702a53e None None] MFA Rules not processed for user `983e57be9b214d788dc3a69da22a174e`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:00.554892 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-8e1743ee-ab93-4a8a-be48-29ec0702a53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:00.609793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 838/1687] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:00 2022] PUT /identity/v3/projects/40e2239c31ee431bb97e2d3139a45a52/users/2d930df2d6de4698adffefb994608537/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:00.611355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92090c86-94c2-4d42-8199-36f6316da570 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:00.616070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-92090c86-94c2-4d42-8199-36f6316da570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:00.692743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 850/1688] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:00.694618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a4e6b-4f50-4657-af51-3130b419bc1b None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:00.694910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a4e6b-4f50-4657-af51-3130b419bc1b None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:00.697458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a4e6b-4f50-4657-af51-3130b419bc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:00.734097 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-6f8a4e6b-4f50-4657-af51-3130b419bc1b None None] MFA Rules not processed for user `2d930df2d6de4698adffefb994608537`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:00.735712 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-6f8a4e6b-4f50-4657-af51-3130b419bc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:00.790703 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92090c86-94c2-4d42-8199-36f6316da570 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:00.798346 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e71929-a4e0-48ba-bff3-9367c88a862e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:00.803061 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e71929-a4e0-48ba-bff3-9367c88a862e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:00.803061 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e71929-a4e0-48ba-bff3-9367c88a862e admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:00.803061 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e71929-a4e0-48ba-bff3-9367c88a862e admin admin] PATH_INFO: `/v3/projects/ef24352329aa44588012c5e9b6ae2a0a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:00.803061 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e71929-a4e0-48ba-bff3-9367c88a862e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef24352329aa44588012c5e9b6ae2a0a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:00.804350 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e71929-a4e0-48ba-bff3-9367c88a862e admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:00.846434 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 851/1689] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:00.848520 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cdd07-a7ff-4192-a3c5-4a46712906b7 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:00.848956 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cdd07-a7ff-4192-a3c5-4a46712906b7 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:00.849358 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cdd07-a7ff-4192-a3c5-4a46712906b7 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:00.851362 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 852/1690] 10.222.0.15 () {54 vars in 912 bytes} [Wed Sep 14 19:56:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:56:00.852650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cdd07-a7ff-4192-a3c5-4a46712906b7 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:00.917814 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cdd07-a7ff-4192-a3c5-4a46712906b7 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:00.921902 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b814a-9422-4284-85f1-0f5005f872f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:00.922657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b814a-9422-4284-85f1-0f5005f872f2 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:00.923040 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b814a-9422-4284-85f1-0f5005f872f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:00.923365 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b814a-9422-4284-85f1-0f5005f872f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:00.925136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-314b814a-9422-4284-85f1-0f5005f872f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:01.003220 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b814a-9422-4284-85f1-0f5005f872f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:01.006970 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b814a-9422-4284-85f1-0f5005f872f2 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:01.019257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 853/1691] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:01.020643 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b814a-9422-4284-85f1-0f5005f872f2 service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:01.033849 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f6e71929-a4e0-48ba-bff3-9367c88a862e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef24352329aa44588012c5e9b6ae2a0a', 'request_id': 'req-f6e71929-a4e0-48ba-bff3-9367c88a862e'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:01.126377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b814a-9422-4284-85f1-0f5005f872f2 service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:01.146508 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f6e71929-a4e0-48ba-bff3-9367c88a862e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef24352329aa44588012c5e9b6ae2a0a', 'request_id': 'req-f6e71929-a4e0-48ba-bff3-9367c88a862e'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:01.161815 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f6e71929-a4e0-48ba-bff3-9367c88a862e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef24352329aa44588012c5e9b6ae2a0a', 'request_id': 'req-f6e71929-a4e0-48ba-bff3-9367c88a862e'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:01.186315 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f6e71929-a4e0-48ba-bff3-9367c88a862e admin admin] The token cache is being invalidate because project ef24352329aa44588012c5e9b6ae2a0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:01.186720 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f6e71929-a4e0-48ba-bff3-9367c88a862e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:01.188313 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f6e71929-a4e0-48ba-bff3-9367c88a862e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:01.196424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 839/1692] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:00 2022] DELETE /identity/v3/projects/ef24352329aa44588012c5e9b6ae2a0a => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:01.196424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e71929-a4e0-48ba-bff3-9367c88a862e admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:01.196424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f6e71929-a4e0-48ba-bff3-9367c88a862e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:01.236751 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b3f08-6a50-4fad-abb9-876b9dc3ca92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:01.237444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b3f08-6a50-4fad-abb9-876b9dc3ca92 service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:01.237729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b3f08-6a50-4fad-abb9-876b9dc3ca92 service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:01.238142 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b3f08-6a50-4fad-abb9-876b9dc3ca92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:01.241365 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-df3b3f08-6a50-4fad-abb9-876b9dc3ca92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:01.288777 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:01.326152 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e71929-a4e0-48ba-bff3-9367c88a862e admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:01.333514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d68a5b-d97e-4944-8ad0-951173c01382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:01.334394 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d68a5b-d97e-4944-8ad0-951173c01382 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:01.334748 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d68a5b-d97e-4944-8ad0-951173c01382 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:01.335720 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d68a5b-d97e-4944-8ad0-951173c01382 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:01.335834 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d68a5b-d97e-4944-8ad0-951173c01382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:01.337876 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d68a5b-d97e-4944-8ad0-951173c01382 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:01.354410 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b3f08-6a50-4fad-abb9-876b9dc3ca92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:01.357326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b3f08-6a50-4fad-abb9-876b9dc3ca92 service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:01.374763 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 854/1693] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:01.385386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b657f2c-889b-411f-99d6-6a28c4f85573 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:01.385891 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b657f2c-889b-411f-99d6-6a28c4f85573 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:01.386397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b657f2c-889b-411f-99d6-6a28c4f85573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:01.455274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-2b657f2c-889b-411f-99d6-6a28c4f85573 None None] MFA Rules not processed for user `221300017882415ca3a7c9192343b956`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:01.456896 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2b657f2c-889b-411f-99d6-6a28c4f85573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:01.479785 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 840/1694] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:01 2022] POST /identity/v3/projects => generated 381 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:01.481440 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b426e-c7e2-4524-b051-dae7d9a87bd9 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:01.482045 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b426e-c7e2-4524-b051-dae7d9a87bd9 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:01.482540 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b426e-c7e2-4524-b051-dae7d9a87bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:01.544823 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-cb3b426e-c7e2-4524-b051-dae7d9a87bd9 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:01.546565 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-cb3b426e-c7e2-4524-b051-dae7d9a87bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:01.623367 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 855/1695] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Sep 14 19:56:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:01.624462 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b657f2c-889b-411f-99d6-6a28c4f85573 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:01.641251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b657f2c-889b-411f-99d6-6a28c4f85573 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:01.665992 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 841/1696] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:01.667430 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b426e-c7e2-4524-b051-dae7d9a87bd9 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:01.669033 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-cb3b426e-c7e2-4524-b051-dae7d9a87bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:01.781269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0629e4-96b6-4aea-8485-685b6fd46af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:01.781826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0629e4-96b6-4aea-8485-685b6fd46af3 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:01.783009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0629e4-96b6-4aea-8485-685b6fd46af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:01.783009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0629e4-96b6-4aea-8485-685b6fd46af3 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:01.784241 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0629e4-96b6-4aea-8485-685b6fd46af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:01.786587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0629e4-96b6-4aea-8485-685b6fd46af3 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:01.841510 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b426e-c7e2-4524-b051-dae7d9a87bd9 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:01.850817 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952111f-90d3-451a-a329-c629093cad4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:01.851461 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952111f-90d3-451a-a329-c629093cad4a service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:01.854627 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952111f-90d3-451a-a329-c629093cad4a service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:01.854927 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952111f-90d3-451a-a329-c629093cad4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:01.874483 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952111f-90d3-451a-a329-c629093cad4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:01.876645 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952111f-90d3-451a-a329-c629093cad4a service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:01.899094 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 842/1697] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:01.903874 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d8587-353b-4d1e-b563-596d531e1c2b None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:01.904202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d8587-353b-4d1e-b563-596d531e1c2b None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:01.904498 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d8587-353b-4d1e-b563-596d531e1c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:01.931269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 856/1698] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:01 2022] POST /identity/v3/users => generated 297 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:01.931910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0629e4-96b6-4aea-8485-685b6fd46af3 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:01.942762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-312d8587-353b-4d1e-b563-596d531e1c2b None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:01.944154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-312d8587-353b-4d1e-b563-596d531e1c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:01.954409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 843/1699] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:01.958049 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d8587-353b-4d1e-b563-596d531e1c2b None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:01.961465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0629e4-96b6-4aea-8485-685b6fd46af3 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:01.971361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82887b9-2280-42ee-a6d7-e01cda6f07a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:01.972332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82887b9-2280-42ee-a6d7-e01cda6f07a3 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:01.972687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d8587-353b-4d1e-b563-596d531e1c2b None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:01.972906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82887b9-2280-42ee-a6d7-e01cda6f07a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:01.973939 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82887b9-2280-42ee-a6d7-e01cda6f07a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:01.976089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82887b9-2280-42ee-a6d7-e01cda6f07a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:01.979537 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82887b9-2280-42ee-a6d7-e01cda6f07a3 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:01.979705 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d59f44-008a-4e28-b8da-fda8900f0b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:01.980196 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d59f44-008a-4e28-b8da-fda8900f0b31 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:01.980536 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d59f44-008a-4e28-b8da-fda8900f0b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:01.980813 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d59f44-008a-4e28-b8da-fda8900f0b31 admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:01.984409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d59f44-008a-4e28-b8da-fda8900f0b31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:56:01.984409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d59f44-008a-4e28-b8da-fda8900f0b31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:01.984409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d59f44-008a-4e28-b8da-fda8900f0b31 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:01.995230 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 857/1700] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:01.996286 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82887b9-2280-42ee-a6d7-e01cda6f07a3 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:02.000959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 844/1701] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:56:02.000959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d59f44-008a-4e28-b8da-fda8900f0b31 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:02.001207 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a82887b9-2280-42ee-a6d7-e01cda6f07a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:02.011729 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d59f44-008a-4e28-b8da-fda8900f0b31 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:02.014908 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82887b9-2280-42ee-a6d7-e01cda6f07a3 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:02.018447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19426fa1-a181-4c16-8721-336967cb4e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:02.024584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19426fa1-a181-4c16-8721-336967cb4e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:02.024584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19426fa1-a181-4c16-8721-336967cb4e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:02.024584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19426fa1-a181-4c16-8721-336967cb4e23 admin admin] PATH_INFO: `/v3/projects/b5640eceb856408eb860b711ad70a71c/users/b18c8b3b32f14656a059dfa9106cb1dd/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:02.024825 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b959d-33bb-423d-b802-c1999129c5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:02.025080 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b959d-33bb-423d-b802-c1999129c5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:02.027504 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b959d-33bb-423d-b802-c1999129c5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:02.027814 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b959d-33bb-423d-b802-c1999129c5a3 admin admin] PATH_INFO: `/v3/users/5f5a2982651f4660ad2e1596a7ff6202` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:02.032369 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b959d-33bb-423d-b802-c1999129c5a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f5a2982651f4660ad2e1596a7ff6202)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:02.034708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b959d-33bb-423d-b802-c1999129c5a3 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:02.056321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19426fa1-a181-4c16-8721-336967cb4e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5640eceb856408eb860b711ad70a71c, user_id=b18c8b3b32f14656a059dfa9106cb1dd, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:02.059404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19426fa1-a181-4c16-8721-336967cb4e23 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:02.161832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 845/1702] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:01 2022] PUT /identity/v3/projects/b5640eceb856408eb860b711ad70a71c/users/b18c8b3b32f14656a059dfa9106cb1dd/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:02.162402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19426fa1-a181-4c16-8721-336967cb4e23 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:02.286555 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19426fa1-a181-4c16-8721-336967cb4e23 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:02.291821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97f2b8-9f40-44c2-b426-f41c5fd6a427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:02.292523 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97f2b8-9f40-44c2-b426-f41c5fd6a427 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:02.292880 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97f2b8-9f40-44c2-b426-f41c5fd6a427 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:02.293214 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97f2b8-9f40-44c2-b426-f41c5fd6a427 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:02.293970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97f2b8-9f40-44c2-b426-f41c5fd6a427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:02.296284 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97f2b8-9f40-44c2-b426-f41c5fd6a427 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:02.349919 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-120b959d-33bb-423d-b802-c1999129c5a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f5a2982651f4660ad2e1596a7ff6202'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:02.448993 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 846/1703] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:02 2022] POST /identity/v3/projects => generated 365 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:02.449743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97f2b8-9f40-44c2-b426-f41c5fd6a427 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:02.473255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-120b959d-33bb-423d-b802-c1999129c5a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f5a2982651f4660ad2e1596a7ff6202'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:02.474255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-120b959d-33bb-423d-b802-c1999129c5a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f5a2982651f4660ad2e1596a7ff6202'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:02.505544 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-120b959d-33bb-423d-b802-c1999129c5a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f5a2982651f4660ad2e1596a7ff6202'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:02.522558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-120b959d-33bb-423d-b802-c1999129c5a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f5a2982651f4660ad2e1596a7ff6202'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:02.543472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 858/1704] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:01 2022] DELETE /identity/v3/users/5f5a2982651f4660ad2e1596a7ff6202 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:02.543472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b959d-33bb-423d-b802-c1999129c5a3 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:02.566896 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-120b959d-33bb-423d-b802-c1999129c5a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:02.652220 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97f2b8-9f40-44c2-b426-f41c5fd6a427 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:02.730005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d6f6e-6c17-4901-bc58-da2171da4b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:02.730702 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d6f6e-6c17-4901-bc58-da2171da4b98 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:02.730986 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d6f6e-6c17-4901-bc58-da2171da4b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:02.731312 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d6f6e-6c17-4901-bc58-da2171da4b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:02.732509 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d6f6e-6c17-4901-bc58-da2171da4b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:02.734273 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d6f6e-6c17-4901-bc58-da2171da4b98 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:02.751275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 847/1705] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:02.751275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2837d-3697-49a0-b22b-e19a028a9b88 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:02.751532 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2837d-3697-49a0-b22b-e19a028a9b88 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:02.751927 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2837d-3697-49a0-b22b-e19a028a9b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:02.754238 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b959d-33bb-423d-b802-c1999129c5a3 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:02.773710 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97a413-1d1c-499a-a8d7-ec808d560ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:02.774525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97a413-1d1c-499a-a8d7-ec808d560ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:02.776780 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97a413-1d1c-499a-a8d7-ec808d560ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:02.777503 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97a413-1d1c-499a-a8d7-ec808d560ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:02.778953 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97a413-1d1c-499a-a8d7-ec808d560ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:02.784009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97a413-1d1c-499a-a8d7-ec808d560ca1 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:02.816834 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-e4f2837d-3697-49a0-b22b-e19a028a9b88 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:02.821675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e4f2837d-3697-49a0-b22b-e19a028a9b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:02.843824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 848/1706] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:02.844204 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2837d-3697-49a0-b22b-e19a028a9b88 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:02.848299 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:02.856156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e4f2837d-3697-49a0-b22b-e19a028a9b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:02.887385 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2837d-3697-49a0-b22b-e19a028a9b88 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:02.900467 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3b290-75bc-4a12-bb46-4cf51decc310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:02.901221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3b290-75bc-4a12-bb46-4cf51decc310 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:02.901504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3b290-75bc-4a12-bb46-4cf51decc310 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:02.901780 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3b290-75bc-4a12-bb46-4cf51decc310 admin admin] PATH_INFO: `/v3/projects/b5640eceb856408eb860b711ad70a71c/users/b18c8b3b32f14656a059dfa9106cb1dd/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:02.908281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3b290-75bc-4a12-bb46-4cf51decc310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5640eceb856408eb860b711ad70a71c, user_id=b18c8b3b32f14656a059dfa9106cb1dd, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:02.918005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3b290-75bc-4a12-bb46-4cf51decc310 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:02.948709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 849/1707] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:02 2022] PUT /identity/v3/projects/b5640eceb856408eb860b711ad70a71c/users/b18c8b3b32f14656a059dfa9106cb1dd/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:02.950589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3b290-75bc-4a12-bb46-4cf51decc310 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:02.955025 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0ae3b290-75bc-4a12-bb46-4cf51decc310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:02.977679 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 859/1708] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:02 2022] POST /identity/v3/users => generated 283 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:02.998094 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f73423-a80f-4a1c-bc3f-37f4cc1a3380 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:02.998094 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f73423-a80f-4a1c-bc3f-37f4cc1a3380 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:02.998094 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f73423-a80f-4a1c-bc3f-37f4cc1a3380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:03.074330 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-34f73423-a80f-4a1c-bc3f-37f4cc1a3380 None None] MFA Rules not processed for user `b18c8b3b32f14656a059dfa9106cb1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:03.075989 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-34f73423-a80f-4a1c-bc3f-37f4cc1a3380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:03.119418 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3b290-75bc-4a12-bb46-4cf51decc310 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:03.132379 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54758875-a4d4-45a2-ac2f-7f40ce3e7ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:03.133176 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54758875-a4d4-45a2-ac2f-7f40ce3e7ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:03.133325 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54758875-a4d4-45a2-ac2f-7f40ce3e7ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:03.133790 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54758875-a4d4-45a2-ac2f-7f40ce3e7ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:03.321605 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54758875-a4d4-45a2-ac2f-7f40ce3e7ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:03.323322 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54758875-a4d4-45a2-ac2f-7f40ce3e7ab2 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:03.345325 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 850/1709] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:03.346303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54758875-a4d4-45a2-ac2f-7f40ce3e7ab2 service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:03.374700 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54758875-a4d4-45a2-ac2f-7f40ce3e7ab2 service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:03.401407 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef23cfb-a788-4cfe-8664-99158a7ac48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:03.402031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef23cfb-a788-4cfe-8664-99158a7ac48b admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:03.402311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef23cfb-a788-4cfe-8664-99158a7ac48b admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:03.402580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef23cfb-a788-4cfe-8664-99158a7ac48b admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:03.403233 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef23cfb-a788-4cfe-8664-99158a7ac48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:03.404923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef23cfb-a788-4cfe-8664-99158a7ac48b admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:03.422764 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 860/1710] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:03.422764 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f73423-a80f-4a1c-bc3f-37f4cc1a3380 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:03.422764 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-34f73423-a80f-4a1c-bc3f-37f4cc1a3380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:03.456557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 851/1711] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:03.457837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef23cfb-a788-4cfe-8664-99158a7ac48b admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:03.468871 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-aef23cfb-a788-4cfe-8664-99158a7ac48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:03.604747 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f73423-a80f-4a1c-bc3f-37f4cc1a3380 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:03.613110 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef23cfb-a788-4cfe-8664-99158a7ac48b admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:03.619636 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051f024-0d77-4add-b4a6-b026377dd938 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:03.620144 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051f024-0d77-4add-b4a6-b026377dd938 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:03.620420 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051f024-0d77-4add-b4a6-b026377dd938 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:03.623037 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e1e5d-f9a8-4f12-8d54-2e6f50fa6719 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6942a851a69b446e90a2b138f4482465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:03.623724 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e1e5d-f9a8-4f12-8d54-2e6f50fa6719 service placement] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:03.624001 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e1e5d-f9a8-4f12-8d54-2e6f50fa6719 service placement] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:03.624270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e1e5d-f9a8-4f12-8d54-2e6f50fa6719 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:03.625046 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051f024-0d77-4add-b4a6-b026377dd938 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:03.633750 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f27e1e5d-f9a8-4f12-8d54-2e6f50fa6719 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:03.651233 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051f024-0d77-4add-b4a6-b026377dd938 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:03.652862 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051f024-0d77-4add-b4a6-b026377dd938 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:03.660557 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e1e5d-f9a8-4f12-8d54-2e6f50fa6719 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:03.662773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e1e5d-f9a8-4f12-8d54-2e6f50fa6719 service placement] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:03.683670 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 852/1712] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:03.684860 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051f024-0d77-4add-b4a6-b026377dd938 service cinder] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:03.713855 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 861/1713] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:03.732425 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051f024-0d77-4add-b4a6-b026377dd938 service cinder] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:03.748590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c7f17-4964-413a-9316-f3cd38c5e675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:03.748590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c7f17-4964-413a-9316-f3cd38c5e675 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:03.748590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c7f17-4964-413a-9316-f3cd38c5e675 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:03.748590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c7f17-4964-413a-9316-f3cd38c5e675 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:03.751148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c7f17-4964-413a-9316-f3cd38c5e675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:03.752914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c7f17-4964-413a-9316-f3cd38c5e675 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:03.793044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 853/1714] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:03.797321 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e1e5d-f9a8-4f12-8d54-2e6f50fa6719 service placement] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:03.813704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e1e5d-f9a8-4f12-8d54-2e6f50fa6719 service placement] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:03.840700 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc64ec-05e3-49e8-87ff-cc1bc1e5e9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:03.840700 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc64ec-05e3-49e8-87ff-cc1bc1e5e9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:03.840700 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc64ec-05e3-49e8-87ff-cc1bc1e5e9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:03.840700 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc64ec-05e3-49e8-87ff-cc1bc1e5e9d4 admin admin] PATH_INFO: `/v3/projects/6c47e3923dba4f779eae71b87d66fea4/users/b2a17a80a4624a52ab46477ed578e264/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:03.878246 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc64ec-05e3-49e8-87ff-cc1bc1e5e9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c47e3923dba4f779eae71b87d66fea4, user_id=b2a17a80a4624a52ab46477ed578e264, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:03.883072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc64ec-05e3-49e8-87ff-cc1bc1e5e9d4 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:04.040685 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 862/1715] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:03 2022] PUT /identity/v3/projects/6c47e3923dba4f779eae71b87d66fea4/users/b2a17a80a4624a52ab46477ed578e264/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:04.049573 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b1692-27a7-454f-b026-5d3841acc2b5 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:04.050009 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b1692-27a7-454f-b026-5d3841acc2b5 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:04.050427 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b1692-27a7-454f-b026-5d3841acc2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:04.063655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc64ec-05e3-49e8-87ff-cc1bc1e5e9d4 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:04.113931 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-877b1692-27a7-454f-b026-5d3841acc2b5 None None] MFA Rules not processed for user `b2a17a80a4624a52ab46477ed578e264`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:04.117641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-877b1692-27a7-454f-b026-5d3841acc2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:04.206691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc64ec-05e3-49e8-87ff-cc1bc1e5e9d4 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:04.211275 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f14fd7-d18c-4ad1-908e-6033fd60e19c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:04.213810 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f14fd7-d18c-4ad1-908e-6033fd60e19c service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:04.214339 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f14fd7-d18c-4ad1-908e-6033fd60e19c service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:04.214979 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f14fd7-d18c-4ad1-908e-6033fd60e19c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:04.217947 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-d2f14fd7-d18c-4ad1-908e-6033fd60e19c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:04.251627 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 854/1716] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:04.255511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b1692-27a7-454f-b026-5d3841acc2b5 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:04.301555 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:04.446446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f14fd7-d18c-4ad1-908e-6033fd60e19c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:04.451615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f14fd7-d18c-4ad1-908e-6033fd60e19c service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:04.489053 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 863/1717] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:56:04.500123 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b1692-27a7-454f-b026-5d3841acc2b5 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:04.509887 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec7c03-37b0-42c6-9047-02b115b51b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:04.510586 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec7c03-37b0-42c6-9047-02b115b51b07 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:04.510861 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec7c03-37b0-42c6-9047-02b115b51b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:04.511331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec7c03-37b0-42c6-9047-02b115b51b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:04.512166 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec7c03-37b0-42c6-9047-02b115b51b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:04.517500 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec7c03-37b0-42c6-9047-02b115b51b07 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:04.853644 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 855/1718] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:04 2022] POST /identity/v3/projects => generated 363 bytes in 596 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:04.856230 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f14fd7-d18c-4ad1-908e-6033fd60e19c service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:04.875290 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f14fd7-d18c-4ad1-908e-6033fd60e19c service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:05.046624 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cd349-e426-480b-8d09-0f8f03e7fb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:05.047589 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cd349-e426-480b-8d09-0f8f03e7fb0c admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:05.049085 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cd349-e426-480b-8d09-0f8f03e7fb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:05.049518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cd349-e426-480b-8d09-0f8f03e7fb0c admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:05.050763 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cd349-e426-480b-8d09-0f8f03e7fb0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:05.053507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cd349-e426-480b-8d09-0f8f03e7fb0c admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:05.140300 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec7c03-37b0-42c6-9047-02b115b51b07 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:05.145040 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-c6ec7c03-37b0-42c6-9047-02b115b51b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:05.235106 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec7c03-37b0-42c6-9047-02b115b51b07 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:05.235106 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2293e-a75d-4620-a116-dfd073902459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:05.235106 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2293e-a75d-4620-a116-dfd073902459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:05.235106 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2293e-a75d-4620-a116-dfd073902459 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:05.236909 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2293e-a75d-4620-a116-dfd073902459 admin admin] PATH_INFO: `/v3/projects/cc879ce4ccdb47d1bbf0272916b1624b` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:05.236909 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2293e-a75d-4620-a116-dfd073902459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc879ce4ccdb47d1bbf0272916b1624b)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:05.236909 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2293e-a75d-4620-a116-dfd073902459 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:05.484589 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 864/1719] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:04 2022] POST /identity/v3/users => generated 288 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:05.484589 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cd349-e426-480b-8d09-0f8f03e7fb0c admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:05.506299 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cd349-e426-480b-8d09-0f8f03e7fb0c admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:05.512950 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a31d9-8bb1-49c3-a24f-b5783ab8269f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:05.513756 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a31d9-8bb1-49c3-a24f-b5783ab8269f admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:05.514002 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a31d9-8bb1-49c3-a24f-b5783ab8269f admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:05.514280 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a31d9-8bb1-49c3-a24f-b5783ab8269f admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:05.514960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a31d9-8bb1-49c3-a24f-b5783ab8269f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:05.516710 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a31d9-8bb1-49c3-a24f-b5783ab8269f admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:05.529513 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 865/1720] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:05.533716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a31d9-8bb1-49c3-a24f-b5783ab8269f admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:05.557485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:05.563903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a31d9-8bb1-49c3-a24f-b5783ab8269f admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:05.572754 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2b2a3-4e30-4bab-b1a1-6ed853da758f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:05.573706 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2b2a3-4e30-4bab-b1a1-6ed853da758f admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:05.574321 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2b2a3-4e30-4bab-b1a1-6ed853da758f admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:05.574779 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2b2a3-4e30-4bab-b1a1-6ed853da758f admin admin] PATH_INFO: `/v3/projects/a15dc32516fa41a0ae1310def043b7b9/users/0099048ebb734d30b514e2aa5543e527/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:05.607854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2b2a3-4e30-4bab-b1a1-6ed853da758f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a15dc32516fa41a0ae1310def043b7b9, user_id=0099048ebb734d30b514e2aa5543e527, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:05.612292 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2b2a3-4e30-4bab-b1a1-6ed853da758f admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:06.973751 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 866/1721] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:05 2022] PUT /identity/v3/projects/a15dc32516fa41a0ae1310def043b7b9/users/0099048ebb734d30b514e2aa5543e527/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 1436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:56:06.973751 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2b2a3-4e30-4bab-b1a1-6ed853da758f admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:07.031388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-79f2293e-a75d-4620-a116-dfd073902459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc879ce4ccdb47d1bbf0272916b1624b', 'request_id': 'req-79f2293e-a75d-4620-a116-dfd073902459'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:07.129668 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2b2a3-4e30-4bab-b1a1-6ed853da758f admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:07.145986 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-79f2293e-a75d-4620-a116-dfd073902459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc879ce4ccdb47d1bbf0272916b1624b', 'request_id': 'req-79f2293e-a75d-4620-a116-dfd073902459'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:07.154631 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-79f2293e-a75d-4620-a116-dfd073902459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc879ce4ccdb47d1bbf0272916b1624b', 'request_id': 'req-79f2293e-a75d-4620-a116-dfd073902459'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:07.189618 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-79f2293e-a75d-4620-a116-dfd073902459 admin admin] The token cache is being invalidate because project cc879ce4ccdb47d1bbf0272916b1624b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:07.189963 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-79f2293e-a75d-4620-a116-dfd073902459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:07.192656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-79f2293e-a75d-4620-a116-dfd073902459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:07.198695 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 856/1722] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:05 2022] DELETE /identity/v3/projects/cc879ce4ccdb47d1bbf0272916b1624b => generated 0 bytes in 2058 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:07.198695 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12918b8-40fd-497f-bcbb-054e1018ef37 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:07.198695 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12918b8-40fd-497f-bcbb-054e1018ef37 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:07.198695 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12918b8-40fd-497f-bcbb-054e1018ef37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:07.245103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-f12918b8-40fd-497f-bcbb-054e1018ef37 None None] MFA Rules not processed for user `e95c629061564a93acaf944fd3ea3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:07.245103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f12918b8-40fd-497f-bcbb-054e1018ef37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:07.251349 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4410097-2f13-4b62-99cc-9eebe18c715f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:07.252137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4410097-2f13-4b62-99cc-9eebe18c715f admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:07.252447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4410097-2f13-4b62-99cc-9eebe18c715f admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:07.253232 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4410097-2f13-4b62-99cc-9eebe18c715f admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:07.253958 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4410097-2f13-4b62-99cc-9eebe18c715f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:07.257685 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4410097-2f13-4b62-99cc-9eebe18c715f admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:07.271732 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 867/1723] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:56:07.273663 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee258ac-fe69-49c6-82e6-96fc04f3895a None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:07.273663 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee258ac-fe69-49c6-82e6-96fc04f3895a None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:07.274245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee258ac-fe69-49c6-82e6-96fc04f3895a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:07.300334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-2ee258ac-fe69-49c6-82e6-96fc04f3895a None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:07.302528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2ee258ac-fe69-49c6-82e6-96fc04f3895a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:07.320524 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 868/1724] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:07.320524 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee258ac-fe69-49c6-82e6-96fc04f3895a None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:07.320524 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2ee258ac-fe69-49c6-82e6-96fc04f3895a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:07.332208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee258ac-fe69-49c6-82e6-96fc04f3895a None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:07.342902 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a77f1-736d-471a-8f35-4a66fa8289c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:07.342902 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a77f1-736d-471a-8f35-4a66fa8289c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:07.342902 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a77f1-736d-471a-8f35-4a66fa8289c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:07.342902 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a77f1-736d-471a-8f35-4a66fa8289c8 admin admin] PATH_INFO: `/v3/projects/a15dc32516fa41a0ae1310def043b7b9/users/0099048ebb734d30b514e2aa5543e527/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:07.343256 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a77f1-736d-471a-8f35-4a66fa8289c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a15dc32516fa41a0ae1310def043b7b9, user_id=0099048ebb734d30b514e2aa5543e527, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:07.345563 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a77f1-736d-471a-8f35-4a66fa8289c8 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:07.349650 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 857/1725] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:07.354322 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c042d7-2e06-4cef-b78b-f2a13d74ec75 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:07.354609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c042d7-2e06-4cef-b78b-f2a13d74ec75 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:07.354886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c042d7-2e06-4cef-b78b-f2a13d74ec75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:07.382267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 869/1726] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:07 2022] PUT /identity/v3/projects/a15dc32516fa41a0ae1310def043b7b9/users/0099048ebb734d30b514e2aa5543e527/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:07.392332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aea1af-1318-4cc0-8d06-58ffad3b5c3c None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:07.392843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aea1af-1318-4cc0-8d06-58ffad3b5c3c None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:07.393314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aea1af-1318-4cc0-8d06-58ffad3b5c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:07.410489 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-53c042d7-2e06-4cef-b78b-f2a13d74ec75 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:07.412590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-53c042d7-2e06-4cef-b78b-f2a13d74ec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:07.471099 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-a3aea1af-1318-4cc0-8d06-58ffad3b5c3c None None] MFA Rules not processed for user `0099048ebb734d30b514e2aa5543e527`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:07.475358 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a3aea1af-1318-4cc0-8d06-58ffad3b5c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:07.533807 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:07.542942 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 858/1727] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:07.546427 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e3a4a-fb4f-4481-b7ea-a6f4b10e353d None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:07.546427 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e3a4a-fb4f-4481-b7ea-a6f4b10e353d None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:07.546427 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e3a4a-fb4f-4481-b7ea-a6f4b10e353d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:07.598550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-1e9e3a4a-fb4f-4481-b7ea-a6f4b10e353d None None] MFA Rules not processed for user `983e57be9b214d788dc3a69da22a174e`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:07.610384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1e9e3a4a-fb4f-4481-b7ea-a6f4b10e353d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:07.610510 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 870/1728] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:07.610510 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aea1af-1318-4cc0-8d06-58ffad3b5c3c None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:07.632633 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aea1af-1318-4cc0-8d06-58ffad3b5c3c None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:07.647317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec326b8-3963-45e0-b84b-ce6df0c868ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:07.648254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec326b8-3963-45e0-b84b-ce6df0c868ef admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:07.648809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec326b8-3963-45e0-b84b-ce6df0c868ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:07.649050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec326b8-3963-45e0-b84b-ce6df0c868ef admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:07.650090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec326b8-3963-45e0-b84b-ce6df0c868ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:56:07.650516 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec326b8-3963-45e0-b84b-ce6df0c868ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:07.652688 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec326b8-3963-45e0-b84b-ce6df0c868ef admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:07.666787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 871/1729] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:56:07.668025 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec326b8-3963-45e0-b84b-ce6df0c868ef admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:07.671981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-6ec326b8-3963-45e0-b84b-ce6df0c868ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:07.728246 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 859/1730] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:07.729424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e3a4a-fb4f-4481-b7ea-a6f4b10e353d None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:07.752716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e3a4a-fb4f-4481-b7ea-a6f4b10e353d None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:07.755169 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec326b8-3963-45e0-b84b-ce6df0c868ef admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:07.758850 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64612f-209d-4d52-ad79-bcc5409b90a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:07.759794 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e59f1-1a08-4eaf-b893-931ff1c5ce05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:07.759944 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64612f-209d-4d52-ad79-bcc5409b90a8 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:07.760305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64612f-209d-4d52-ad79-bcc5409b90a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:07.760423 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e59f1-1a08-4eaf-b893-931ff1c5ce05 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:07.760698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e59f1-1a08-4eaf-b893-931ff1c5ce05 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:07.760811 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64612f-209d-4d52-ad79-bcc5409b90a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:07.760974 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e59f1-1a08-4eaf-b893-931ff1c5ce05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:07.761711 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64612f-209d-4d52-ad79-bcc5409b90a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:07.763685 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64612f-209d-4d52-ad79-bcc5409b90a8 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:07.773446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e59f1-1a08-4eaf-b893-931ff1c5ce05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:07.775157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e59f1-1a08-4eaf-b893-931ff1c5ce05 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:07.807506 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 872/1731] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:07.924604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 860/1732] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:07 2022] POST /identity/v3/projects => generated 363 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:07.930165 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e59f1-1a08-4eaf-b893-931ff1c5ce05 service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:07.944525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e59f1-1a08-4eaf-b893-931ff1c5ce05 service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:08.144152 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40657c88-9069-4d14-a9e2-c49f6911d1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:08.144888 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40657c88-9069-4d14-a9e2-c49f6911d1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:08.146340 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40657c88-9069-4d14-a9e2-c49f6911d1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:08.146628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40657c88-9069-4d14-a9e2-c49f6911d1a6 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:08.150369 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40657c88-9069-4d14-a9e2-c49f6911d1a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:08.163127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40657c88-9069-4d14-a9e2-c49f6911d1a6 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:08.295449 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 873/1733] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:07 2022] POST /identity/v3/users => generated 282 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:08.300137 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64612f-209d-4d52-ad79-bcc5409b90a8 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:08.311903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64612f-209d-4d52-ad79-bcc5409b90a8 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:08.318289 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d37bc-ee46-43cc-842a-c06aef20058e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:08.319348 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d37bc-ee46-43cc-842a-c06aef20058e admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:08.319727 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d37bc-ee46-43cc-842a-c06aef20058e admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:08.320072 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d37bc-ee46-43cc-842a-c06aef20058e admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:08.320799 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d37bc-ee46-43cc-842a-c06aef20058e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:08.322645 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d37bc-ee46-43cc-842a-c06aef20058e admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:08.339296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 861/1734] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:56:08.344426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40657c88-9069-4d14-a9e2-c49f6911d1a6 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:08.385385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40657c88-9069-4d14-a9e2-c49f6911d1a6 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:08.413156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94209f0c-db40-43e5-b352-d4b2c9519973 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:08.413782 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94209f0c-db40-43e5-b352-d4b2c9519973 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:08.414484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94209f0c-db40-43e5-b352-d4b2c9519973 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:08.420542 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 862/1735] 10.222.0.15 () {54 vars in 912 bytes} [Wed Sep 14 19:56:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:56:08.421834 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85279030-b63c-48cc-b296-80d05d857691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:08.422474 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85279030-b63c-48cc-b296-80d05d857691 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:08.422768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85279030-b63c-48cc-b296-80d05d857691 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:08.423041 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85279030-b63c-48cc-b296-80d05d857691 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:08.423794 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85279030-b63c-48cc-b296-80d05d857691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:08.425665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85279030-b63c-48cc-b296-80d05d857691 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:08.438146 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5dad5-88b8-4c0c-a8e3-94e8e298d71e None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:08.438492 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5dad5-88b8-4c0c-a8e3-94e8e298d71e None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:08.438969 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5dad5-88b8-4c0c-a8e3-94e8e298d71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:08.447742 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 874/1736] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:56:08.450625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85279030-b63c-48cc-b296-80d05d857691 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:08.463073 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85279030-b63c-48cc-b296-80d05d857691 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:08.469154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-e6f5dad5-88b8-4c0c-a8e3-94e8e298d71e None None] MFA Rules not processed for user `221300017882415ca3a7c9192343b956`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:08.470442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e6f5dad5-88b8-4c0c-a8e3-94e8e298d71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:08.470960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5ce28-3e61-4324-afbf-a205c506291a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:08.471889 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5ce28-3e61-4324-afbf-a205c506291a admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:08.472380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5ce28-3e61-4324-afbf-a205c506291a admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:08.472953 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5ce28-3e61-4324-afbf-a205c506291a admin admin] PATH_INFO: `/v3/projects/1d2114bdef73405e8291fa0af35f52e8/users/136df6c7427345aaa167caab8db5df74/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:08.496646 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5ce28-3e61-4324-afbf-a205c506291a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d2114bdef73405e8291fa0af35f52e8, user_id=136df6c7427345aaa167caab8db5df74, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:08.499730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5ce28-3e61-4324-afbf-a205c506291a admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:08.562186 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 863/1737] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Sep 14 19:56:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:08.574117 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5dad5-88b8-4c0c-a8e3-94e8e298d71e None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:08.575816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e6f5dad5-88b8-4c0c-a8e3-94e8e298d71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:08.591032 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5dad5-88b8-4c0c-a8e3-94e8e298d71e None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:08.592971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 875/1738] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:08 2022] PUT /identity/v3/projects/1d2114bdef73405e8291fa0af35f52e8/users/136df6c7427345aaa167caab8db5df74/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:56:08.607634 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31bf7f-2aec-43eb-bb7f-5e18a2c44b7f None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:08.607939 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31bf7f-2aec-43eb-bb7f-5e18a2c44b7f None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:08.608209 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31bf7f-2aec-43eb-bb7f-5e18a2c44b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:08.642126 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-2c31bf7f-2aec-43eb-bb7f-5e18a2c44b7f None None] MFA Rules not processed for user `136df6c7427345aaa167caab8db5df74`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:08.643374 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2c31bf7f-2aec-43eb-bb7f-5e18a2c44b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:08.672376 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cd0f4-cfb7-4c69-ada5-53ac85d0d9da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:08.673954 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cd0f4-cfb7-4c69-ada5-53ac85d0d9da service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:08.674963 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cd0f4-cfb7-4c69-ada5-53ac85d0d9da service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:08.675496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cd0f4-cfb7-4c69-ada5-53ac85d0d9da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:08.686723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9cd0f4-cfb7-4c69-ada5-53ac85d0d9da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:08.688785 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9cd0f4-cfb7-4c69-ada5-53ac85d0d9da service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:08.721910 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 864/1739] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:08.733761 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:08.773243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 876/1740] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:08.777728 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cd0f4-cfb7-4c69-ada5-53ac85d0d9da service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:08.855021 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cd0f4-cfb7-4c69-ada5-53ac85d0d9da service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:08.860772 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436ba63-77ce-4f7f-b19b-6f05cc9fedcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:08.861467 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436ba63-77ce-4f7f-b19b-6f05cc9fedcb admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:08.861762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436ba63-77ce-4f7f-b19b-6f05cc9fedcb admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:08.862186 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436ba63-77ce-4f7f-b19b-6f05cc9fedcb admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:08.863271 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436ba63-77ce-4f7f-b19b-6f05cc9fedcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:08.869658 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436ba63-77ce-4f7f-b19b-6f05cc9fedcb admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:09.066673 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 865/1741] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:08 2022] POST /identity/v3/projects => generated 363 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:09.073822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31bf7f-2aec-43eb-bb7f-5e18a2c44b7f None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:09.093507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31bf7f-2aec-43eb-bb7f-5e18a2c44b7f None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:09.258548 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5364cac-bc05-4a59-935a-aca2dbeb9ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:09.259201 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5364cac-bc05-4a59-935a-aca2dbeb9ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:09.263360 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5364cac-bc05-4a59-935a-aca2dbeb9ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:09.263735 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5364cac-bc05-4a59-935a-aca2dbeb9ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:09.264535 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5364cac-bc05-4a59-935a-aca2dbeb9ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:09.266506 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5364cac-bc05-4a59-935a-aca2dbeb9ca9 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:09.407248 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 877/1742] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:09 2022] POST /identity/v3/users => generated 288 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:09.411943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436ba63-77ce-4f7f-b19b-6f05cc9fedcb admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:09.439812 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436ba63-77ce-4f7f-b19b-6f05cc9fedcb admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:09.456539 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058433f1-7aea-4267-abf6-1f9c91eaf76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:09.460731 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058433f1-7aea-4267-abf6-1f9c91eaf76c admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:09.460731 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058433f1-7aea-4267-abf6-1f9c91eaf76c admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:09.460731 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058433f1-7aea-4267-abf6-1f9c91eaf76c admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:09.460731 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058433f1-7aea-4267-abf6-1f9c91eaf76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:09.462436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058433f1-7aea-4267-abf6-1f9c91eaf76c admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:09.482285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 866/1743] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:09.486682 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5364cac-bc05-4a59-935a-aca2dbeb9ca9 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:09.519221 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5364cac-bc05-4a59-935a-aca2dbeb9ca9 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:09.545431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37d4c6-27de-4b9f-bd73-11fb799bf3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:09.546542 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37d4c6-27de-4b9f-bd73-11fb799bf3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:09.547493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37d4c6-27de-4b9f-bd73-11fb799bf3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:09.547946 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37d4c6-27de-4b9f-bd73-11fb799bf3f7 admin admin] PATH_INFO: `/v3/projects/55bba2e1aaea4bd89ca6fc516ff17db4/users/d70cead5882e46e892b99b8832804242/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:09.619312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37d4c6-27de-4b9f-bd73-11fb799bf3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55bba2e1aaea4bd89ca6fc516ff17db4, user_id=d70cead5882e46e892b99b8832804242, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:09.623231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37d4c6-27de-4b9f-bd73-11fb799bf3f7 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:09.785634 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 878/1744] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:09 2022] PUT /identity/v3/projects/55bba2e1aaea4bd89ca6fc516ff17db4/users/d70cead5882e46e892b99b8832804242/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:09.798124 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058433f1-7aea-4267-abf6-1f9c91eaf76c admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:09.814293 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058433f1-7aea-4267-abf6-1f9c91eaf76c admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:09.846926 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:09.907967 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eead1de-9654-4879-8a43-31b870e8b34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:09.908930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eead1de-9654-4879-8a43-31b870e8b34c admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:09.909355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eead1de-9654-4879-8a43-31b870e8b34c admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:09.909779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eead1de-9654-4879-8a43-31b870e8b34c admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:09.910814 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eead1de-9654-4879-8a43-31b870e8b34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:09.915432 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eead1de-9654-4879-8a43-31b870e8b34c admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:09.931569 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 867/1745] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:09.935400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37d4c6-27de-4b9f-bd73-11fb799bf3f7 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:09.951217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37d4c6-27de-4b9f-bd73-11fb799bf3f7 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:09.957119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6b99c-4fb5-4353-9ef0-ec24d82c439b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:09.957976 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6b99c-4fb5-4353-9ef0-ec24d82c439b admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:09.958182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6b99c-4fb5-4353-9ef0-ec24d82c439b admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:09.958506 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6b99c-4fb5-4353-9ef0-ec24d82c439b admin admin] PATH_INFO: `/v3/projects/55bba2e1aaea4bd89ca6fc516ff17db4/users/d70cead5882e46e892b99b8832804242/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:09.960858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6b99c-4fb5-4353-9ef0-ec24d82c439b admin admin] RBAC: Authorizing `identity:create_grant(project_id=55bba2e1aaea4bd89ca6fc516ff17db4, user_id=d70cead5882e46e892b99b8832804242, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:09.963575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6b99c-4fb5-4353-9ef0-ec24d82c439b admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:09.975509 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 879/1746] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:09 2022] PUT /identity/v3/projects/55bba2e1aaea4bd89ca6fc516ff17db4/users/d70cead5882e46e892b99b8832804242/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:09.986104 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02a322-d4e3-4bcc-bd5e-87de8c371cee None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:09.986479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02a322-d4e3-4bcc-bd5e-87de8c371cee None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:09.986920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02a322-d4e3-4bcc-bd5e-87de8c371cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:10.022517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-0d02a322-d4e3-4bcc-bd5e-87de8c371cee None None] MFA Rules not processed for user `d70cead5882e46e892b99b8832804242`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:10.024586 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0d02a322-d4e3-4bcc-bd5e-87de8c371cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:10.135998 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 868/1747] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:10.156066 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6b99c-4fb5-4353-9ef0-ec24d82c439b admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:10.194264 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02a322-d4e3-4bcc-bd5e-87de8c371cee None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:10.236803 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6b99c-4fb5-4353-9ef0-ec24d82c439b admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:10.243424 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad8803-d3e2-46b9-8609-ec0f69d6b4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:10.250585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad8803-d3e2-46b9-8609-ec0f69d6b4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:10.250585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad8803-d3e2-46b9-8609-ec0f69d6b4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:10.250585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad8803-d3e2-46b9-8609-ec0f69d6b4bf admin admin] PATH_INFO: `/v3/users/b2a17a80a4624a52ab46477ed578e264` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:10.250585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad8803-d3e2-46b9-8609-ec0f69d6b4bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2a17a80a4624a52ab46477ed578e264)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:10.250585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad8803-d3e2-46b9-8609-ec0f69d6b4bf admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:10.261114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02a322-d4e3-4bcc-bd5e-87de8c371cee None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:10.267630 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26699bd-4315-4421-8d78-82582606e62b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:10.268236 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26699bd-4315-4421-8d78-82582606e62b service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:10.268574 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26699bd-4315-4421-8d78-82582606e62b service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:10.268903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26699bd-4315-4421-8d78-82582606e62b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:10.283968 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26699bd-4315-4421-8d78-82582606e62b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:10.285418 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26699bd-4315-4421-8d78-82582606e62b service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:10.299702 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 869/1748] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:56:10.615753 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a0ad8803-d3e2-46b9-8609-ec0f69d6b4bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2a17a80a4624a52ab46477ed578e264'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:10.766186 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a0ad8803-d3e2-46b9-8609-ec0f69d6b4bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2a17a80a4624a52ab46477ed578e264'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:10.766971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a0ad8803-d3e2-46b9-8609-ec0f69d6b4bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2a17a80a4624a52ab46477ed578e264'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:10.788341 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a0ad8803-d3e2-46b9-8609-ec0f69d6b4bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2a17a80a4624a52ab46477ed578e264'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:10.810373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a0ad8803-d3e2-46b9-8609-ec0f69d6b4bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2a17a80a4624a52ab46477ed578e264'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:10.825843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 880/1749] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:10 2022] DELETE /identity/v3/users/b2a17a80a4624a52ab46477ed578e264 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:10.830996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610012ba-484e-4edf-85d2-5f67e9355003 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:10.831458 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610012ba-484e-4edf-85d2-5f67e9355003 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:10.831652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610012ba-484e-4edf-85d2-5f67e9355003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:10.848780 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad8803-d3e2-46b9-8609-ec0f69d6b4bf admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:10.851755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a0ad8803-d3e2-46b9-8609-ec0f69d6b4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:10.883134 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-610012ba-484e-4edf-85d2-5f67e9355003 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:10.884768 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-610012ba-484e-4edf-85d2-5f67e9355003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:10.950984 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad8803-d3e2-46b9-8609-ec0f69d6b4bf admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:10.958551 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0570484-1784-4417-9d3a-850422848ff0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:10.966390 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0570484-1784-4417-9d3a-850422848ff0 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:10.966390 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0570484-1784-4417-9d3a-850422848ff0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:10.966390 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0570484-1784-4417-9d3a-850422848ff0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:10.966390 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a0570484-1784-4417-9d3a-850422848ff0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:11.006539 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 870/1750] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:11.019435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610012ba-484e-4edf-85d2-5f67e9355003 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:11.022014 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-610012ba-484e-4edf-85d2-5f67e9355003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:11.093521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0570484-1784-4417-9d3a-850422848ff0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:11.095091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0570484-1784-4417-9d3a-850422848ff0 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:11.115003 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 881/1751] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:56:11.175430 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610012ba-484e-4edf-85d2-5f67e9355003 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:11.184937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f22a6f-ce1d-44e8-b4e2-b5a9c32ad377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:11.189987 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f22a6f-ce1d-44e8-b4e2-b5a9c32ad377 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:11.189987 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f22a6f-ce1d-44e8-b4e2-b5a9c32ad377 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:11.189987 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f22a6f-ce1d-44e8-b4e2-b5a9c32ad377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:11.208213 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f22a6f-ce1d-44e8-b4e2-b5a9c32ad377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:11.210212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f22a6f-ce1d-44e8-b4e2-b5a9c32ad377 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:11.225415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 871/1752] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:56:11.386156 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:11.459048 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a149f-0190-479a-9ba1-fdc78bec3e99 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:11.459579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a149f-0190-479a-9ba1-fdc78bec3e99 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:11.459926 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a149f-0190-479a-9ba1-fdc78bec3e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:11.530460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-714a149f-0190-479a-9ba1-fdc78bec3e99 None None] MFA Rules not processed for user `15fbda6263b44352b3ac560372bef725`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:11.532449 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-714a149f-0190-479a-9ba1-fdc78bec3e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:11.783066 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 882/1753] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Sep 14 19:56:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:11.894370 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f22a6f-ce1d-44e8-b4e2-b5a9c32ad377 service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:11.896780 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-73f22a6f-ce1d-44e8-b4e2-b5a9c32ad377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:11.928531 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f22a6f-ce1d-44e8-b4e2-b5a9c32ad377 service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:11.950489 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c2374-c77d-47dc-a186-df392a740c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:11.951167 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c2374-c77d-47dc-a186-df392a740c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:11.951425 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c2374-c77d-47dc-a186-df392a740c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:11.951782 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c2374-c77d-47dc-a186-df392a740c39 admin admin] PATH_INFO: `/v3/projects/6c47e3923dba4f779eae71b87d66fea4` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:11.952937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c2374-c77d-47dc-a186-df392a740c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c47e3923dba4f779eae71b87d66fea4)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:11.954884 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c2374-c77d-47dc-a186-df392a740c39 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:12.187463 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-786c2374-c77d-47dc-a186-df392a740c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c47e3923dba4f779eae71b87d66fea4', 'request_id': 'req-786c2374-c77d-47dc-a186-df392a740c39'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:12.339089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a149f-0190-479a-9ba1-fdc78bec3e99 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:12.340612 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-714a149f-0190-479a-9ba1-fdc78bec3e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:12.429089 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-786c2374-c77d-47dc-a186-df392a740c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c47e3923dba4f779eae71b87d66fea4', 'request_id': 'req-786c2374-c77d-47dc-a186-df392a740c39'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:12.436003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-786c2374-c77d-47dc-a186-df392a740c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c47e3923dba4f779eae71b87d66fea4', 'request_id': 'req-786c2374-c77d-47dc-a186-df392a740c39'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:12.453310 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-786c2374-c77d-47dc-a186-df392a740c39 admin admin] The token cache is being invalidate because project 6c47e3923dba4f779eae71b87d66fea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:12.453310 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-786c2374-c77d-47dc-a186-df392a740c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:12.453310 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-786c2374-c77d-47dc-a186-df392a740c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:12.453310 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 872/1754] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:11 2022] DELETE /identity/v3/projects/6c47e3923dba4f779eae71b87d66fea4 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:12.456738 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c2374-c77d-47dc-a186-df392a740c39 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:12.458354 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-786c2374-c77d-47dc-a186-df392a740c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:12.462456 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a149f-0190-479a-9ba1-fdc78bec3e99 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:12.569585 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c2374-c77d-47dc-a186-df392a740c39 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:12.569585 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cbcf2-ba24-4a46-b823-0f1499046ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:12.569585 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cbcf2-ba24-4a46-b823-0f1499046ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:12.569585 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cbcf2-ba24-4a46-b823-0f1499046ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:12.569967 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cbcf2-ba24-4a46-b823-0f1499046ea5 admin admin] PATH_INFO: `/v3/users/0099048ebb734d30b514e2aa5543e527` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:12.569967 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cbcf2-ba24-4a46-b823-0f1499046ea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0099048ebb734d30b514e2aa5543e527)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:12.569967 dv-cinder-839768-8-smb devstack@keystone.service[93544]: WARNING py.warnings [None req-504cbcf2-ba24-4a46-b823-0f1499046ea5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:56:12.569967 dv-cinder-839768-8-smb devstack@keystone.service[93544]: warnings.warn(msg) Sep 14 19:56:12.569967 dv-cinder-839768-8-smb devstack@keystone.service[93544]: Sep 14 19:56:12.569967 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cbcf2-ba24-4a46-b823-0f1499046ea5 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:12.570416 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33d667-eb79-4a4d-8432-2c2df518da7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee56bf9af257486e94e6ff1b33086f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:12.570416 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33d667-eb79-4a4d-8432-2c2df518da7c service swift] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:12.570416 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33d667-eb79-4a4d-8432-2c2df518da7c service swift] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:12.570416 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33d667-eb79-4a4d-8432-2c2df518da7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:12.570701 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-7a33d667-eb79-4a4d-8432-2c2df518da7c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:12.636814 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33d667-eb79-4a4d-8432-2c2df518da7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:12.638402 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33d667-eb79-4a4d-8432-2c2df518da7c service swift] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:12.647363 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 883/1755] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Sep 14 19:56:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 19:56:12.648677 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe8af6-d686-4471-a8b3-93291149d8bf None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:12.649117 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe8af6-d686-4471-a8b3-93291149d8bf None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:12.649469 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe8af6-d686-4471-a8b3-93291149d8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:12.669120 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-78fe8af6-d686-4471-a8b3-93291149d8bf None None] MFA Rules not processed for user `221300017882415ca3a7c9192343b956`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:12.670342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-78fe8af6-d686-4471-a8b3-93291149d8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:12.740302 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 884/1756] 10.222.0.33 () {58 vars in 1015 bytes} [Wed Sep 14 19:56:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:12.882114 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:12.989628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe8af6-d686-4471-a8b3-93291149d8bf None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:12.994993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-78fe8af6-d686-4471-a8b3-93291149d8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:13.015897 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe8af6-d686-4471-a8b3-93291149d8bf None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:13.032563 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c1e23-85fe-4443-bdd5-2782777fec3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:13.033650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c1e23-85fe-4443-bdd5-2782777fec3b service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:13.034138 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c1e23-85fe-4443-bdd5-2782777fec3b service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:13.034639 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c1e23-85fe-4443-bdd5-2782777fec3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:13.047504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-504cbcf2-ba24-4a46-b823-0f1499046ea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0099048ebb734d30b514e2aa5543e527'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:13.053506 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c1e23-85fe-4443-bdd5-2782777fec3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:13.055690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c1e23-85fe-4443-bdd5-2782777fec3b service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:13.080377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 885/1757] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:56:13.214740 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:13.219222 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-504cbcf2-ba24-4a46-b823-0f1499046ea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0099048ebb734d30b514e2aa5543e527'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:13.221391 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-504cbcf2-ba24-4a46-b823-0f1499046ea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0099048ebb734d30b514e2aa5543e527'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:13.242277 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-504cbcf2-ba24-4a46-b823-0f1499046ea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0099048ebb734d30b514e2aa5543e527'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:13.280570 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-504cbcf2-ba24-4a46-b823-0f1499046ea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0099048ebb734d30b514e2aa5543e527'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:13.295140 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 873/1758] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:12 2022] DELETE /identity/v3/users/0099048ebb734d30b514e2aa5543e527 => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:13.746739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=83,keystone:INSERT=7,keystone:DELETE=10 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:15.045955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c1e23-85fe-4443-bdd5-2782777fec3b service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:15.083520 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c1e23-85fe-4443-bdd5-2782777fec3b service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:15.227897 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5517a-d765-4126-be3b-b3dbac7943d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:15.228737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5517a-d765-4126-be3b-b3dbac7943d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:15.229112 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5517a-d765-4126-be3b-b3dbac7943d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:15.229477 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5517a-d765-4126-be3b-b3dbac7943d0 admin admin] PATH_INFO: `/v3/projects/a15dc32516fa41a0ae1310def043b7b9` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:15.231043 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5517a-d765-4126-be3b-b3dbac7943d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a15dc32516fa41a0ae1310def043b7b9)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:15.232196 dv-cinder-839768-8-smb devstack@keystone.service[93545]: WARNING py.warnings [None req-8ae5517a-d765-4126-be3b-b3dbac7943d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:56:15.232196 dv-cinder-839768-8-smb devstack@keystone.service[93545]: warnings.warn(msg) Sep 14 19:56:15.232196 dv-cinder-839768-8-smb devstack@keystone.service[93545]: Sep 14 19:56:15.235334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5517a-d765-4126-be3b-b3dbac7943d0 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:15.429611 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd44de-27e3-4e89-adba-b55be0b487db None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:15.430069 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd44de-27e3-4e89-adba-b55be0b487db None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:15.430159 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd44de-27e3-4e89-adba-b55be0b487db None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:15.431801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 874/1759] 10.222.0.15 () {54 vars in 921 bytes} [Wed Sep 14 19:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:56:15.439965 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022eb7c0-d061-46d7-af9f-1fe8e23b948f None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:15.440097 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022eb7c0-d061-46d7-af9f-1fe8e23b948f None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:15.440529 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022eb7c0-d061-46d7-af9f-1fe8e23b948f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:15.500391 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-022eb7c0-d061-46d7-af9f-1fe8e23b948f None None] MFA Rules not processed for user `421f6cc846b342918a177d2794eb3db8`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:15.501762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:15.505708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-022eb7c0-d061-46d7-af9f-1fe8e23b948f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:15.541251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-8ae5517a-d765-4126-be3b-b3dbac7943d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a15dc32516fa41a0ae1310def043b7b9', 'request_id': 'req-8ae5517a-d765-4126-be3b-b3dbac7943d0'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:15.635867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-8ae5517a-d765-4126-be3b-b3dbac7943d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a15dc32516fa41a0ae1310def043b7b9', 'request_id': 'req-8ae5517a-d765-4126-be3b-b3dbac7943d0'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:15.645611 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-8ae5517a-d765-4126-be3b-b3dbac7943d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a15dc32516fa41a0ae1310def043b7b9', 'request_id': 'req-8ae5517a-d765-4126-be3b-b3dbac7943d0'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:15.665807 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 875/1760] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Sep 14 19:56:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:56:15.688073 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-8ae5517a-d765-4126-be3b-b3dbac7943d0 admin admin] The token cache is being invalidate because project a15dc32516fa41a0ae1310def043b7b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:15.689190 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-8ae5517a-d765-4126-be3b-b3dbac7943d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:15.691287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-8ae5517a-d765-4126-be3b-b3dbac7943d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:15.694933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 886/1761] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:15 2022] DELETE /identity/v3/projects/a15dc32516fa41a0ae1310def043b7b9 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:15.699903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022eb7c0-d061-46d7-af9f-1fe8e23b948f None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:15.703998 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-022eb7c0-d061-46d7-af9f-1fe8e23b948f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:15.722448 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9be3d-99fa-4a54-87c9-2da075519029 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:15.722737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9be3d-99fa-4a54-87c9-2da075519029 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:15.725868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9be3d-99fa-4a54-87c9-2da075519029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:15.748878 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022eb7c0-d061-46d7-af9f-1fe8e23b948f None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:15.776749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c1ec7-6796-444a-b76f-51f6b6c07cc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:15.777415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c1ec7-6796-444a-b76f-51f6b6c07cc8 service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:15.777677 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c1ec7-6796-444a-b76f-51f6b6c07cc8 service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:15.777950 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c1ec7-6796-444a-b76f-51f6b6c07cc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:15.785011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-7a1c1ec7-6796-444a-b76f-51f6b6c07cc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:15.804627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-cba9be3d-99fa-4a54-87c9-2da075519029 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:15.811377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-cba9be3d-99fa-4a54-87c9-2da075519029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:15.840642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c1ec7-6796-444a-b76f-51f6b6c07cc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:15.844701 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c1ec7-6796-444a-b76f-51f6b6c07cc8 service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:15.877164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 876/1762] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:15.996230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018f868-3a17-4875-ab79-f6e5eed1858b None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:15.996517 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 887/1763] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:15.997302 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018f868-3a17-4875-ab79-f6e5eed1858b None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:15.997769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018f868-3a17-4875-ab79-f6e5eed1858b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:16.072853 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-2018f868-3a17-4875-ab79-f6e5eed1858b None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:16.094682 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-2018f868-3a17-4875-ab79-f6e5eed1858b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:16.107255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 877/1764] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:56:16.111479 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9be3d-99fa-4a54-87c9-2da075519029 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:16.125041 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9be3d-99fa-4a54-87c9-2da075519029 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:16.132815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f2c65-3a46-408a-845e-27f2b77742c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:16.133513 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f2c65-3a46-408a-845e-27f2b77742c7 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:16.133948 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f2c65-3a46-408a-845e-27f2b77742c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:16.134222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f2c65-3a46-408a-845e-27f2b77742c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:16.144198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f2c65-3a46-408a-845e-27f2b77742c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:56:16.149219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f2c65-3a46-408a-845e-27f2b77742c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:16.156853 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f2c65-3a46-408a-845e-27f2b77742c7 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:16.209295 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 888/1765] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:56:16.214029 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018f868-3a17-4875-ab79-f6e5eed1858b None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:16.226722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018f868-3a17-4875-ab79-f6e5eed1858b None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:16.252336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c3167-9cc0-4390-8766-8979415efa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:16.252336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c3167-9cc0-4390-8766-8979415efa33 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:16.252336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c3167-9cc0-4390-8766-8979415efa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:16.252336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c3167-9cc0-4390-8766-8979415efa33 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:16.252938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c3167-9cc0-4390-8766-8979415efa33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:16.264783 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c3167-9cc0-4390-8766-8979415efa33 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:16.483095 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 878/1766] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:16 2022] POST /identity/v3/projects => generated 369 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:16.485910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f2c65-3a46-408a-845e-27f2b77742c7 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:16.521142 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f2c65-3a46-408a-845e-27f2b77742c7 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:16.779724 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3c6fa-0aae-4093-8365-29b278e8efa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:16.780462 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3c6fa-0aae-4093-8365-29b278e8efa2 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:16.780807 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3c6fa-0aae-4093-8365-29b278e8efa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:16.781202 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3c6fa-0aae-4093-8365-29b278e8efa2 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:16.782000 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3c6fa-0aae-4093-8365-29b278e8efa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:16.784271 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3c6fa-0aae-4093-8365-29b278e8efa2 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:16.880738 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c3167-9cc0-4390-8766-8979415efa33 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:16.883744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-fa9c3167-9cc0-4390-8766-8979415efa33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:16.916363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c3167-9cc0-4390-8766-8979415efa33 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:16.930145 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 889/1767] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:16 2022] POST /identity/v3/users => generated 285 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:16.931362 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fe38e-8642-41b7-91a3-2d867f9dc68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:16.932516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fe38e-8642-41b7-91a3-2d867f9dc68d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:16.933611 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fe38e-8642-41b7-91a3-2d867f9dc68d admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:16.934355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fe38e-8642-41b7-91a3-2d867f9dc68d admin admin] PATH_INFO: `/v3/users/136df6c7427345aaa167caab8db5df74` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:16.937854 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fe38e-8642-41b7-91a3-2d867f9dc68d admin admin] RBAC: Authorizing `identity:delete_user(user_id=136df6c7427345aaa167caab8db5df74)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:16.940340 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fe38e-8642-41b7-91a3-2d867f9dc68d admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:16.945462 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3c6fa-0aae-4093-8365-29b278e8efa2 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:16.949683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:16.981969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3c6fa-0aae-4093-8365-29b278e8efa2 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:16.990747 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d87f5-138f-4103-ba5c-91d31a30bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:16.991967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d87f5-138f-4103-ba5c-91d31a30bb6b admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:16.992471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d87f5-138f-4103-ba5c-91d31a30bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:16.992969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d87f5-138f-4103-ba5c-91d31a30bb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:16.994810 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d87f5-138f-4103-ba5c-91d31a30bb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:16.996999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d87f5-138f-4103-ba5c-91d31a30bb6b admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:17.028731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 890/1768] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:17.032499 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d87f5-138f-4103-ba5c-91d31a30bb6b admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:17.055026 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d87f5-138f-4103-ba5c-91d31a30bb6b admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:17.086336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8b396-53ac-4d01-8d86-0de4fb5f0963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:17.087015 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8b396-53ac-4d01-8d86-0de4fb5f0963 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:17.087342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8b396-53ac-4d01-8d86-0de4fb5f0963 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:17.087890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8b396-53ac-4d01-8d86-0de4fb5f0963 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:17.088604 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8b396-53ac-4d01-8d86-0de4fb5f0963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:17.091174 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8b396-53ac-4d01-8d86-0de4fb5f0963 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:17.117287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 891/1769] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:56:17.119867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8b396-53ac-4d01-8d86-0de4fb5f0963 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:17.144613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8b396-53ac-4d01-8d86-0de4fb5f0963 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:17.169701 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93213d3-845c-49fc-8170-e96605734333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:17.170779 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93213d3-845c-49fc-8170-e96605734333 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:17.171491 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93213d3-845c-49fc-8170-e96605734333 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:17.172064 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93213d3-845c-49fc-8170-e96605734333 admin admin] PATH_INFO: `/v3/projects/d76bacdd7c154eac9b12e0debe87fab9/users/08544f78a0e04d3f88ebc2d2b9e138c4/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:17.256383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-719fe38e-8642-41b7-91a3-2d867f9dc68d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '136df6c7427345aaa167caab8db5df74'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:17.303785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93213d3-845c-49fc-8170-e96605734333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76bacdd7c154eac9b12e0debe87fab9, user_id=08544f78a0e04d3f88ebc2d2b9e138c4, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:17.313850 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93213d3-845c-49fc-8170-e96605734333 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:17.418130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-719fe38e-8642-41b7-91a3-2d867f9dc68d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '136df6c7427345aaa167caab8db5df74'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:17.422921 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-719fe38e-8642-41b7-91a3-2d867f9dc68d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '136df6c7427345aaa167caab8db5df74'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:17.423773 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:17.444515 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-719fe38e-8642-41b7-91a3-2d867f9dc68d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '136df6c7427345aaa167caab8db5df74'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:17.488523 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-719fe38e-8642-41b7-91a3-2d867f9dc68d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '136df6c7427345aaa167caab8db5df74'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:17.526155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 892/1770] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:17 2022] PUT /identity/v3/projects/d76bacdd7c154eac9b12e0debe87fab9/users/08544f78a0e04d3f88ebc2d2b9e138c4/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:17.526155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93213d3-845c-49fc-8170-e96605734333 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:17.526530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 879/1771] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:16 2022] DELETE /identity/v3/users/136df6c7427345aaa167caab8db5df74 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:17.526620 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c93213d3-845c-49fc-8170-e96605734333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:17.526696 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e35fb-5625-42e6-bc9e-a92a3d6ae6fa None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:17.526696 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e35fb-5625-42e6-bc9e-a92a3d6ae6fa None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:17.526696 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e35fb-5625-42e6-bc9e-a92a3d6ae6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:17.578095 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-c52e35fb-5625-42e6-bc9e-a92a3d6ae6fa None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:17.580872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-c52e35fb-5625-42e6-bc9e-a92a3d6ae6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:17.689938 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93213d3-845c-49fc-8170-e96605734333 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:17.696347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 880/1772] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:56:17.696347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3021a1-a07b-4f78-9158-982adfdd31f0 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:17.696347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3021a1-a07b-4f78-9158-982adfdd31f0 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:17.696347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3021a1-a07b-4f78-9158-982adfdd31f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:17.710312 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-6e3021a1-a07b-4f78-9158-982adfdd31f0 None None] MFA Rules not processed for user `08544f78a0e04d3f88ebc2d2b9e138c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:17.712298 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-6e3021a1-a07b-4f78-9158-982adfdd31f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:17.794503 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a6a6f-d319-4a47-84a6-b4ad0b815316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:17.795436 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a6a6f-d319-4a47-84a6-b4ad0b815316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:17.795963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a6a6f-d319-4a47-84a6-b4ad0b815316 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:17.796374 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a6a6f-d319-4a47-84a6-b4ad0b815316 admin admin] PATH_INFO: `/v3/users/3e1585a0ee9641e98358a7c25e5d2b15` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:17.798574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a6a6f-d319-4a47-84a6-b4ad0b815316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e1585a0ee9641e98358a7c25e5d2b15)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:17.802141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a6a6f-d319-4a47-84a6-b4ad0b815316 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:17.855918 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 881/1773] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:17.857935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3021a1-a07b-4f78-9158-982adfdd31f0 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:17.859676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-6e3021a1-a07b-4f78-9158-982adfdd31f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:18.022246 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3021a1-a07b-4f78-9158-982adfdd31f0 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:18.033021 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd34fe-0cc0-40c1-87b5-4ce6e08e7f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:18.034682 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd34fe-0cc0-40c1-87b5-4ce6e08e7f28 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:18.036474 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd34fe-0cc0-40c1-87b5-4ce6e08e7f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:18.036474 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd34fe-0cc0-40c1-87b5-4ce6e08e7f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:18.071339 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd34fe-0cc0-40c1-87b5-4ce6e08e7f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:18.075350 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd34fe-0cc0-40c1-87b5-4ce6e08e7f28 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:18.119846 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 882/1774] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:18.119846 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd34fe-0cc0-40c1-87b5-4ce6e08e7f28 service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:18.132293 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-cefd34fe-0cc0-40c1-87b5-4ce6e08e7f28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:18.191310 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd34fe-0cc0-40c1-87b5-4ce6e08e7f28 service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:18.199510 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3955a65-84e0-4ad5-b755-e824b59601fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:18.200224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3955a65-84e0-4ad5-b755-e824b59601fa admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:18.200504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3955a65-84e0-4ad5-b755-e824b59601fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:18.200772 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3955a65-84e0-4ad5-b755-e824b59601fa admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:18.201519 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3955a65-84e0-4ad5-b755-e824b59601fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:18.203421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3955a65-84e0-4ad5-b755-e824b59601fa admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:18.464895 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 883/1775] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:18 2022] POST /identity/v3/projects => generated 369 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:18.466855 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3955a65-84e0-4ad5-b755-e824b59601fa admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:18.519871 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-624a6a6f-d319-4a47-84a6-b4ad0b815316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e1585a0ee9641e98358a7c25e5d2b15'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:18.606853 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3955a65-84e0-4ad5-b755-e824b59601fa admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:18.636612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072cc1c-b0b9-451f-8cb0-9840569581aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:18.637695 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072cc1c-b0b9-451f-8cb0-9840569581aa admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:18.638346 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072cc1c-b0b9-451f-8cb0-9840569581aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:18.638990 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072cc1c-b0b9-451f-8cb0-9840569581aa admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:18.640332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072cc1c-b0b9-451f-8cb0-9840569581aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:18.650640 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072cc1c-b0b9-451f-8cb0-9840569581aa admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:18.674372 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-624a6a6f-d319-4a47-84a6-b4ad0b815316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e1585a0ee9641e98358a7c25e5d2b15'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:18.679343 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-624a6a6f-d319-4a47-84a6-b4ad0b815316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e1585a0ee9641e98358a7c25e5d2b15'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:18.708694 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-624a6a6f-d319-4a47-84a6-b4ad0b815316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e1585a0ee9641e98358a7c25e5d2b15'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:18.724308 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-624a6a6f-d319-4a47-84a6-b4ad0b815316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e1585a0ee9641e98358a7c25e5d2b15'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:18.762428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 893/1776] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:17 2022] DELETE /identity/v3/users/3e1585a0ee9641e98358a7c25e5d2b15 => generated 0 bytes in 1262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:18.766146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d76b6-7133-4b85-9223-40913d83ac26 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:18.771203 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d76b6-7133-4b85-9223-40913d83ac26 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:18.771203 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d76b6-7133-4b85-9223-40913d83ac26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:18.812893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 884/1777] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:18 2022] POST /identity/v3/users => generated 291 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:18.816824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072cc1c-b0b9-451f-8cb0-9840569581aa admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:18.820330 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0072cc1c-b0b9-451f-8cb0-9840569581aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:18.837023 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-f11d76b6-7133-4b85-9223-40913d83ac26 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:18.838663 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f11d76b6-7133-4b85-9223-40913d83ac26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:18.849820 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072cc1c-b0b9-451f-8cb0-9840569581aa admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:18.932551 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e004d-9e91-4ebd-850f-3c547d8dc205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:18.932551 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e004d-9e91-4ebd-850f-3c547d8dc205 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:18.932881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e004d-9e91-4ebd-850f-3c547d8dc205 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:18.933223 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e004d-9e91-4ebd-850f-3c547d8dc205 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:18.933978 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e004d-9e91-4ebd-850f-3c547d8dc205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:18.935760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e004d-9e91-4ebd-850f-3c547d8dc205 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:18.968990 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 885/1778] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:56:18.971331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35778ea8-f6ea-48f0-9dac-f50ab265aa7a None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:18.971723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35778ea8-f6ea-48f0-9dac-f50ab265aa7a None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:18.978601 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35778ea8-f6ea-48f0-9dac-f50ab265aa7a None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:18.979655 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 886/1779] 10.222.0.15 () {54 vars in 921 bytes} [Wed Sep 14 19:56:18 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:56:18.980443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35778ea8-f6ea-48f0-9dac-f50ab265aa7a None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:19.009674 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 894/1780] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:19.024467 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35778ea8-f6ea-48f0-9dac-f50ab265aa7a None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:19.025238 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bec74-698c-4f92-9015-d927a1c21ac7 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:19.025648 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bec74-698c-4f92-9015-d927a1c21ac7 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:19.026106 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bec74-698c-4f92-9015-d927a1c21ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:19.047525 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a10a4-2a2a-4c9a-bd6a-6d3514b3ad1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:19.047525 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a10a4-2a2a-4c9a-bd6a-6d3514b3ad1d admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:19.047525 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a10a4-2a2a-4c9a-bd6a-6d3514b3ad1d admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:19.047818 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a10a4-2a2a-4c9a-bd6a-6d3514b3ad1d admin admin] PATH_INFO: `/v3/projects/ec43047fd8774939b9182699b291c2b0/users/0ab81a2612d346eea82454182943f220/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:19.090571 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-897bec74-698c-4f92-9015-d927a1c21ac7 None None] MFA Rules not processed for user `421f6cc846b342918a177d2794eb3db8`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:19.090980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a10a4-2a2a-4c9a-bd6a-6d3514b3ad1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec43047fd8774939b9182699b291c2b0, user_id=0ab81a2612d346eea82454182943f220, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:19.092620 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-897bec74-698c-4f92-9015-d927a1c21ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:19.095066 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a10a4-2a2a-4c9a-bd6a-6d3514b3ad1d admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:19.245714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 887/1781] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:18 2022] PUT /identity/v3/projects/ec43047fd8774939b9182699b291c2b0/users/0ab81a2612d346eea82454182943f220/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:19.246850 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a10a4-2a2a-4c9a-bd6a-6d3514b3ad1d admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:19.253867 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-c28a10a4-2a2a-4c9a-bd6a-6d3514b3ad1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:19.389456 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 895/1782] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Sep 14 19:56:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:19.391036 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897bec74-698c-4f92-9015-d927a1c21ac7 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:19.391677 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:19.445038 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897bec74-698c-4f92-9015-d927a1c21ac7 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:19.527863 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a10a4-2a2a-4c9a-bd6a-6d3514b3ad1d admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:19.543685 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a477d-6100-4349-a482-7ab6d8a7a498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:19.544693 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a477d-6100-4349-a482-7ab6d8a7a498 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:19.545203 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a477d-6100-4349-a482-7ab6d8a7a498 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:19.545644 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a477d-6100-4349-a482-7ab6d8a7a498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:19.568823 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1598462-0966-40ea-9057-c4b61f715e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:19.578450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1598462-0966-40ea-9057-c4b61f715e44 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:19.578993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1598462-0966-40ea-9057-c4b61f715e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:19.579419 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1598462-0966-40ea-9057-c4b61f715e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:19.580380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1598462-0966-40ea-9057-c4b61f715e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:19.582845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1598462-0966-40ea-9057-c4b61f715e44 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:19.595114 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 896/1783] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:19.602535 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1598462-0966-40ea-9057-c4b61f715e44 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:19.622390 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1598462-0966-40ea-9057-c4b61f715e44 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:19.644407 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba0585-458c-4908-bc82-616ed18b66d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:19.645153 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0585-458c-4908-bc82-616ed18b66d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:19.645717 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0585-458c-4908-bc82-616ed18b66d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:19.646222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0585-458c-4908-bc82-616ed18b66d0 admin admin] PATH_INFO: `/v3/projects/ec43047fd8774939b9182699b291c2b0/users/0ab81a2612d346eea82454182943f220/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:19.650270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba0585-458c-4908-bc82-616ed18b66d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec43047fd8774939b9182699b291c2b0, user_id=0ab81a2612d346eea82454182943f220, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:19.654114 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba0585-458c-4908-bc82-616ed18b66d0 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:19.680162 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a477d-6100-4349-a482-7ab6d8a7a498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:19.680780 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 897/1784] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:19 2022] PUT /identity/v3/projects/ec43047fd8774939b9182699b291c2b0/users/0ab81a2612d346eea82454182943f220/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:19.684822 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a477d-6100-4349-a482-7ab6d8a7a498 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:19.706852 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ed498-b23d-4e6f-b627-fb63e0ae3f92 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:19.708828 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ed498-b23d-4e6f-b627-fb63e0ae3f92 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:19.710439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ed498-b23d-4e6f-b627-fb63e0ae3f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:19.723226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 888/1785] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:19.770364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-4c4ed498-b23d-4e6f-b627-fb63e0ae3f92 None None] MFA Rules not processed for user `0ab81a2612d346eea82454182943f220`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:19.772567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4c4ed498-b23d-4e6f-b627-fb63e0ae3f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:19.799270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:19.929665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a477d-6100-4349-a482-7ab6d8a7a498 service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:19.931767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-422a477d-6100-4349-a482-7ab6d8a7a498 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:19.952875 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 898/1786] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:19.967642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ed498-b23d-4e6f-b627-fb63e0ae3f92 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:19.969306 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4c4ed498-b23d-4e6f-b627-fb63e0ae3f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:20.142545 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ed498-b23d-4e6f-b627-fb63e0ae3f92 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:20.152824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7c268-aa98-4df0-a387-199ad8ea6d3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:20.153356 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7c268-aa98-4df0-a387-199ad8ea6d3a service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:20.153630 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7c268-aa98-4df0-a387-199ad8ea6d3a service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:20.154664 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7c268-aa98-4df0-a387-199ad8ea6d3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:20.180675 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7c268-aa98-4df0-a387-199ad8ea6d3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:20.182048 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a477d-6100-4349-a482-7ab6d8a7a498 service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:20.182178 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7c268-aa98-4df0-a387-199ad8ea6d3a service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:20.204421 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 899/1787] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:20.333448 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0ba5a-9512-4f73-8d8c-2d072b1b2fc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:20.334303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0ba5a-9512-4f73-8d8c-2d072b1b2fc4 service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:20.335164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0ba5a-9512-4f73-8d8c-2d072b1b2fc4 service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:20.335164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0ba5a-9512-4f73-8d8c-2d072b1b2fc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:20.357293 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0ba5a-9512-4f73-8d8c-2d072b1b2fc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:20.363050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0ba5a-9512-4f73-8d8c-2d072b1b2fc4 service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:20.381628 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 889/1788] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:20.610709 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7c268-aa98-4df0-a387-199ad8ea6d3a service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:20.616710 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-45f7c268-aa98-4df0-a387-199ad8ea6d3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:20.830681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7c268-aa98-4df0-a387-199ad8ea6d3a service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:20.839682 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89d7b6-d823-4c62-bafb-6c49e09c7f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:20.840410 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89d7b6-d823-4c62-bafb-6c49e09c7f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:20.840841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89d7b6-d823-4c62-bafb-6c49e09c7f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:20.847031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89d7b6-d823-4c62-bafb-6c49e09c7f83 admin admin] PATH_INFO: `/v3/users/2d930df2d6de4698adffefb994608537` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:20.848733 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0ba5a-9512-4f73-8d8c-2d072b1b2fc4 service nova] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:20.849226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89d7b6-d823-4c62-bafb-6c49e09c7f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d930df2d6de4698adffefb994608537)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:20.850948 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-eea0ba5a-9512-4f73-8d8c-2d072b1b2fc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:20.851911 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89d7b6-d823-4c62-bafb-6c49e09c7f83 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:20.908777 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0ba5a-9512-4f73-8d8c-2d072b1b2fc4 service nova] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:20.933719 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a29b57-ca03-4c97-8758-00d362510bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:20.933719 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a29b57-ca03-4c97-8758-00d362510bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:20.933719 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a29b57-ca03-4c97-8758-00d362510bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:20.935788 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a29b57-ca03-4c97-8758-00d362510bc6 admin admin] PATH_INFO: `/v3/projects/bfa9a250b42e48bdae315e3b29708591` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:20.939044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a29b57-ca03-4c97-8758-00d362510bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfa9a250b42e48bdae315e3b29708591)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:20.943460 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a29b57-ca03-4c97-8758-00d362510bc6 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:21.177906 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b2a29b57-ca03-4c97-8758-00d362510bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfa9a250b42e48bdae315e3b29708591', 'request_id': 'req-b2a29b57-ca03-4c97-8758-00d362510bc6'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:21.214716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1c89d7b6-d823-4c62-bafb-6c49e09c7f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d930df2d6de4698adffefb994608537'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:21.277584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b2a29b57-ca03-4c97-8758-00d362510bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfa9a250b42e48bdae315e3b29708591', 'request_id': 'req-b2a29b57-ca03-4c97-8758-00d362510bc6'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:21.293041 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b2a29b57-ca03-4c97-8758-00d362510bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfa9a250b42e48bdae315e3b29708591', 'request_id': 'req-b2a29b57-ca03-4c97-8758-00d362510bc6'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:21.355966 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b2a29b57-ca03-4c97-8758-00d362510bc6 admin admin] The token cache is being invalidate because project bfa9a250b42e48bdae315e3b29708591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:21.359663 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b2a29b57-ca03-4c97-8758-00d362510bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:21.359663 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b2a29b57-ca03-4c97-8758-00d362510bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:21.388838 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 890/1789] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:20 2022] DELETE /identity/v3/projects/bfa9a250b42e48bdae315e3b29708591 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:56:21.390112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a29b57-ca03-4c97-8758-00d362510bc6 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:21.392458 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b2a29b57-ca03-4c97-8758-00d362510bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:21.401942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1c89d7b6-d823-4c62-bafb-6c49e09c7f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d930df2d6de4698adffefb994608537'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:21.402586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1c89d7b6-d823-4c62-bafb-6c49e09c7f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d930df2d6de4698adffefb994608537'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:21.465430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1c89d7b6-d823-4c62-bafb-6c49e09c7f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d930df2d6de4698adffefb994608537'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:21.486374 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1c89d7b6-d823-4c62-bafb-6c49e09c7f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d930df2d6de4698adffefb994608537'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:21.519893 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 900/1790] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:20 2022] DELETE /identity/v3/users/2d930df2d6de4698adffefb994608537 => generated 0 bytes in 912 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:21.521805 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89d7b6-d823-4c62-bafb-6c49e09c7f83 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:21.527227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-1c89d7b6-d823-4c62-bafb-6c49e09c7f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:21.559213 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a29b57-ca03-4c97-8758-00d362510bc6 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:21.740942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89d7b6-d823-4c62-bafb-6c49e09c7f83 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:21.751243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d469ec-64da-442e-b5a7-74b7a9aa8451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:21.751243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d469ec-64da-442e-b5a7-74b7a9aa8451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:21.751243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d469ec-64da-442e-b5a7-74b7a9aa8451 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:21.751243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d469ec-64da-442e-b5a7-74b7a9aa8451 admin admin] PATH_INFO: `/v3/users/1b6db6f2ea824ab5a34a8fe44ac8cc90` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:21.764644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d469ec-64da-442e-b5a7-74b7a9aa8451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b6db6f2ea824ab5a34a8fe44ac8cc90)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:21.773728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d469ec-64da-442e-b5a7-74b7a9aa8451 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:21.774384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7b990-82de-4a08-9528-a78a03df1099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:21.776475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7b990-82de-4a08-9528-a78a03df1099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:21.776475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7b990-82de-4a08-9528-a78a03df1099 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:21.783236 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7b990-82de-4a08-9528-a78a03df1099 admin admin] PATH_INFO: `/v3/projects/1d2114bdef73405e8291fa0af35f52e8` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:21.786948 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7b990-82de-4a08-9528-a78a03df1099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d2114bdef73405e8291fa0af35f52e8)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:21.796941 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7b990-82de-4a08-9528-a78a03df1099 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:21.905383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:22.143408 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-60a7b990-82de-4a08-9528-a78a03df1099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d2114bdef73405e8291fa0af35f52e8', 'request_id': 'req-60a7b990-82de-4a08-9528-a78a03df1099'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:22.181166 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a2d469ec-64da-442e-b5a7-74b7a9aa8451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b6db6f2ea824ab5a34a8fe44ac8cc90'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:22.361942 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-60a7b990-82de-4a08-9528-a78a03df1099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d2114bdef73405e8291fa0af35f52e8', 'request_id': 'req-60a7b990-82de-4a08-9528-a78a03df1099'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:22.375561 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-60a7b990-82de-4a08-9528-a78a03df1099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d2114bdef73405e8291fa0af35f52e8', 'request_id': 'req-60a7b990-82de-4a08-9528-a78a03df1099'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:22.390665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-60a7b990-82de-4a08-9528-a78a03df1099 admin admin] The token cache is being invalidate because project 1d2114bdef73405e8291fa0af35f52e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:22.395471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-60a7b990-82de-4a08-9528-a78a03df1099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:22.395471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-60a7b990-82de-4a08-9528-a78a03df1099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:22.395471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 891/1791] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:21 2022] DELETE /identity/v3/projects/1d2114bdef73405e8291fa0af35f52e8 => generated 0 bytes in 1004 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:22.395471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2f8c4-2ce0-45fa-9e62-0496982489f0 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:22.395471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2f8c4-2ce0-45fa-9e62-0496982489f0 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:22.396377 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2f8c4-2ce0-45fa-9e62-0496982489f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:22.417861 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-d0a2f8c4-2ce0-45fa-9e62-0496982489f0 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:22.420811 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d0a2f8c4-2ce0-45fa-9e62-0496982489f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:22.486266 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a2d469ec-64da-442e-b5a7-74b7a9aa8451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b6db6f2ea824ab5a34a8fe44ac8cc90'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:22.486266 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a2d469ec-64da-442e-b5a7-74b7a9aa8451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b6db6f2ea824ab5a34a8fe44ac8cc90'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:22.491621 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a2d469ec-64da-442e-b5a7-74b7a9aa8451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b6db6f2ea824ab5a34a8fe44ac8cc90'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:22.519792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 892/1792] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:22.521934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2f8c4-2ce0-45fa-9e62-0496982489f0 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:22.601111 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a2d469ec-64da-442e-b5a7-74b7a9aa8451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b6db6f2ea824ab5a34a8fe44ac8cc90'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:22.601301 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d0a2f8c4-2ce0-45fa-9e62-0496982489f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:22.601380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 901/1793] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:21 2022] DELETE /identity/v3/users/1b6db6f2ea824ab5a34a8fe44ac8cc90 => generated 0 bytes in 1022 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:22.601380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d469ec-64da-442e-b5a7-74b7a9aa8451 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:22.601380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a2d469ec-64da-442e-b5a7-74b7a9aa8451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:22.601572 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2f8c4-2ce0-45fa-9e62-0496982489f0 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:22.646376 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a47ee4-5b72-4c30-8ebb-f73b067b8c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:22.647449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a47ee4-5b72-4c30-8ebb-f73b067b8c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:22.648017 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a47ee4-5b72-4c30-8ebb-f73b067b8c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:22.648526 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a47ee4-5b72-4c30-8ebb-f73b067b8c82 admin admin] PATH_INFO: `/v3/users/d70cead5882e46e892b99b8832804242` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:22.650380 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a47ee4-5b72-4c30-8ebb-f73b067b8c82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70cead5882e46e892b99b8832804242)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:22.655011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a47ee4-5b72-4c30-8ebb-f73b067b8c82 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:22.688298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d469ec-64da-442e-b5a7-74b7a9aa8451 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:22.709680 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df31de-5b10-4892-a2df-60bb965a6283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:22.709680 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df31de-5b10-4892-a2df-60bb965a6283 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:22.709680 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df31de-5b10-4892-a2df-60bb965a6283 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:22.709680 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df31de-5b10-4892-a2df-60bb965a6283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:22.710851 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df31de-5b10-4892-a2df-60bb965a6283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:22.711219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df31de-5b10-4892-a2df-60bb965a6283 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:22.723606 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 902/1794] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:56:23.398615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d9a47ee4-5b72-4c30-8ebb-f73b067b8c82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70cead5882e46e892b99b8832804242'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:23.647910 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d9a47ee4-5b72-4c30-8ebb-f73b067b8c82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70cead5882e46e892b99b8832804242'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:23.648623 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d9a47ee4-5b72-4c30-8ebb-f73b067b8c82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70cead5882e46e892b99b8832804242'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:23.672927 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d9a47ee4-5b72-4c30-8ebb-f73b067b8c82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70cead5882e46e892b99b8832804242'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:23.690970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d9a47ee4-5b72-4c30-8ebb-f73b067b8c82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70cead5882e46e892b99b8832804242'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:23.700189 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 893/1795] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:22 2022] DELETE /identity/v3/users/d70cead5882e46e892b99b8832804242 => generated 0 bytes in 1179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:23.751523 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df31de-5b10-4892-a2df-60bb965a6283 service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:23.753458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-e3df31de-5b10-4892-a2df-60bb965a6283 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:23.783874 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a47ee4-5b72-4c30-8ebb-f73b067b8c82 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:23.785956 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df31de-5b10-4892-a2df-60bb965a6283 service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:23.788476 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d9a47ee4-5b72-4c30-8ebb-f73b067b8c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:23.935281 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb5e01-4047-446e-8766-b075004883cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:23.938033 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:23.938527 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb5e01-4047-446e-8766-b075004883cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:23.938957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb5e01-4047-446e-8766-b075004883cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:23.939389 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb5e01-4047-446e-8766-b075004883cc admin admin] PATH_INFO: `/v3/projects/40e2239c31ee431bb97e2d3139a45a52` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:23.940834 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb5e01-4047-446e-8766-b075004883cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=40e2239c31ee431bb97e2d3139a45a52)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:23.944819 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb5e01-4047-446e-8766-b075004883cc admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:24.012930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a47ee4-5b72-4c30-8ebb-f73b067b8c82 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:24.018934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34201f78-bab4-41c7-91dd-76168f3c89f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:24.019721 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34201f78-bab4-41c7-91dd-76168f3c89f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:24.020074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34201f78-bab4-41c7-91dd-76168f3c89f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:24.020511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34201f78-bab4-41c7-91dd-76168f3c89f4 admin admin] PATH_INFO: `/v3/projects/b193ebda478346ffb5ecaef06cd96983` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:24.022082 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34201f78-bab4-41c7-91dd-76168f3c89f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b193ebda478346ffb5ecaef06cd96983)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:24.024626 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34201f78-bab4-41c7-91dd-76168f3c89f4 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:24.217137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d5bb5e01-4047-446e-8766-b075004883cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40e2239c31ee431bb97e2d3139a45a52', 'request_id': 'req-d5bb5e01-4047-446e-8766-b075004883cc'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:24.251328 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-34201f78-bab4-41c7-91dd-76168f3c89f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b193ebda478346ffb5ecaef06cd96983', 'request_id': 'req-34201f78-bab4-41c7-91dd-76168f3c89f4'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:24.351293 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d5bb5e01-4047-446e-8766-b075004883cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40e2239c31ee431bb97e2d3139a45a52', 'request_id': 'req-d5bb5e01-4047-446e-8766-b075004883cc'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:24.361834 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d5bb5e01-4047-446e-8766-b075004883cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40e2239c31ee431bb97e2d3139a45a52', 'request_id': 'req-d5bb5e01-4047-446e-8766-b075004883cc'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:24.387041 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d5bb5e01-4047-446e-8766-b075004883cc admin admin] The token cache is being invalidate because project 40e2239c31ee431bb97e2d3139a45a52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:24.387853 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d5bb5e01-4047-446e-8766-b075004883cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:24.413370 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d5bb5e01-4047-446e-8766-b075004883cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:24.436907 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 903/1796] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:23 2022] DELETE /identity/v3/projects/40e2239c31ee431bb97e2d3139a45a52 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:24.438698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb5e01-4047-446e-8766-b075004883cc admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:24.446554 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-d5bb5e01-4047-446e-8766-b075004883cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:24.476568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-34201f78-bab4-41c7-91dd-76168f3c89f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b193ebda478346ffb5ecaef06cd96983', 'request_id': 'req-34201f78-bab4-41c7-91dd-76168f3c89f4'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:24.485778 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-34201f78-bab4-41c7-91dd-76168f3c89f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b193ebda478346ffb5ecaef06cd96983', 'request_id': 'req-34201f78-bab4-41c7-91dd-76168f3c89f4'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:24.519082 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-34201f78-bab4-41c7-91dd-76168f3c89f4 admin admin] The token cache is being invalidate because project b193ebda478346ffb5ecaef06cd96983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:24.519379 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-34201f78-bab4-41c7-91dd-76168f3c89f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:24.522328 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-34201f78-bab4-41c7-91dd-76168f3c89f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:24.528258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 894/1797] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:23 2022] DELETE /identity/v3/projects/b193ebda478346ffb5ecaef06cd96983 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:56:24.535132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75826db8-3525-4c33-b290-a13d4e3d0a95 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:24.535497 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75826db8-3525-4c33-b290-a13d4e3d0a95 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:24.540336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75826db8-3525-4c33-b290-a13d4e3d0a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:24.580838 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-75826db8-3525-4c33-b290-a13d4e3d0a95 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:24.582067 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-75826db8-3525-4c33-b290-a13d4e3d0a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:24.615914 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb5e01-4047-446e-8766-b075004883cc admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:24.766058 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 895/1798] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:56:24.774706 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163ac07-2e55-4b03-af07-62ecb804a169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:24.777767 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163ac07-2e55-4b03-af07-62ecb804a169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:24.778184 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163ac07-2e55-4b03-af07-62ecb804a169 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:24.778545 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163ac07-2e55-4b03-af07-62ecb804a169 admin admin] PATH_INFO: `/v3/users/b18c8b3b32f14656a059dfa9106cb1dd` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:24.781960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163ac07-2e55-4b03-af07-62ecb804a169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b18c8b3b32f14656a059dfa9106cb1dd)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:24.782188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f90fc0-01ce-4f4c-aea5-f00e8ea51df4 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:24.782866 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f90fc0-01ce-4f4c-aea5-f00e8ea51df4 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:24.783429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f90fc0-01ce-4f4c-aea5-f00e8ea51df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:24.800375 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163ac07-2e55-4b03-af07-62ecb804a169 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:24.829027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-96f90fc0-01ce-4f4c-aea5-f00e8ea51df4 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:24.830990 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-96f90fc0-01ce-4f4c-aea5-f00e8ea51df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:24.864043 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 896/1799] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:24.865131 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f90fc0-01ce-4f4c-aea5-f00e8ea51df4 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:24.879073 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f90fc0-01ce-4f4c-aea5-f00e8ea51df4 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:24.890841 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb66325-dbe8-472e-95de-930e722a4e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:24.890841 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb66325-dbe8-472e-95de-930e722a4e9d admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:24.893761 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb66325-dbe8-472e-95de-930e722a4e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:24.895283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb66325-dbe8-472e-95de-930e722a4e9d admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:24.896394 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb66325-dbe8-472e-95de-930e722a4e9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:56:24.898062 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb66325-dbe8-472e-95de-930e722a4e9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:24.901227 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb66325-dbe8-472e-95de-930e722a4e9d admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:24.930440 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 897/1800] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:56:24.934793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb66325-dbe8-472e-95de-930e722a4e9d admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:24.946187 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb66325-dbe8-472e-95de-930e722a4e9d admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:24.955041 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17495a85-e3fd-47f8-9bf9-3c5bcf75e8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:24.955932 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17495a85-e3fd-47f8-9bf9-3c5bcf75e8af admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:24.956225 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17495a85-e3fd-47f8-9bf9-3c5bcf75e8af admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:24.956501 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17495a85-e3fd-47f8-9bf9-3c5bcf75e8af admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:24.958329 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17495a85-e3fd-47f8-9bf9-3c5bcf75e8af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:24.964331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17495a85-e3fd-47f8-9bf9-3c5bcf75e8af admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:25.193129 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 898/1801] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:24 2022] POST /identity/v3/projects => generated 367 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:25.193129 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17495a85-e3fd-47f8-9bf9-3c5bcf75e8af admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:25.196652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-17495a85-e3fd-47f8-9bf9-3c5bcf75e8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:25.216633 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a163ac07-2e55-4b03-af07-62ecb804a169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b18c8b3b32f14656a059dfa9106cb1dd'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:25.293802 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17495a85-e3fd-47f8-9bf9-3c5bcf75e8af admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:25.299059 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3272e6-5cfa-40f1-b75a-049914e45370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:25.299770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3272e6-5cfa-40f1-b75a-049914e45370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:25.300112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3272e6-5cfa-40f1-b75a-049914e45370 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:25.300290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3272e6-5cfa-40f1-b75a-049914e45370 admin admin] PATH_INFO: `/v3/projects/55bba2e1aaea4bd89ca6fc516ff17db4` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:25.301870 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3272e6-5cfa-40f1-b75a-049914e45370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55bba2e1aaea4bd89ca6fc516ff17db4)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:25.304507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3272e6-5cfa-40f1-b75a-049914e45370 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:25.344658 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a163ac07-2e55-4b03-af07-62ecb804a169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b18c8b3b32f14656a059dfa9106cb1dd'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:25.345278 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a163ac07-2e55-4b03-af07-62ecb804a169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b18c8b3b32f14656a059dfa9106cb1dd'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:25.358305 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a163ac07-2e55-4b03-af07-62ecb804a169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b18c8b3b32f14656a059dfa9106cb1dd'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:25.365095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a163ac07-2e55-4b03-af07-62ecb804a169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b18c8b3b32f14656a059dfa9106cb1dd'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:25.371784 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 904/1802] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:24 2022] DELETE /identity/v3/users/b18c8b3b32f14656a059dfa9106cb1dd => generated 0 bytes in 934 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:25.380040 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163ac07-2e55-4b03-af07-62ecb804a169 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:25.380040 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a163ac07-2e55-4b03-af07-62ecb804a169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:25.449215 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8f3272e6-5cfa-40f1-b75a-049914e45370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55bba2e1aaea4bd89ca6fc516ff17db4', 'request_id': 'req-8f3272e6-5cfa-40f1-b75a-049914e45370'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:25.476391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163ac07-2e55-4b03-af07-62ecb804a169 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:25.549974 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82af55-da12-4a10-ae26-1af4bc7acf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:25.549974 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82af55-da12-4a10-ae26-1af4bc7acf27 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:25.549974 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82af55-da12-4a10-ae26-1af4bc7acf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:25.549974 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82af55-da12-4a10-ae26-1af4bc7acf27 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:25.550280 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82af55-da12-4a10-ae26-1af4bc7acf27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:25.550280 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82af55-da12-4a10-ae26-1af4bc7acf27 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:25.590057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8f3272e6-5cfa-40f1-b75a-049914e45370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55bba2e1aaea4bd89ca6fc516ff17db4', 'request_id': 'req-8f3272e6-5cfa-40f1-b75a-049914e45370'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:25.599042 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8f3272e6-5cfa-40f1-b75a-049914e45370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55bba2e1aaea4bd89ca6fc516ff17db4', 'request_id': 'req-8f3272e6-5cfa-40f1-b75a-049914e45370'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:25.621294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8f3272e6-5cfa-40f1-b75a-049914e45370 admin admin] The token cache is being invalidate because project 55bba2e1aaea4bd89ca6fc516ff17db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:25.621594 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8f3272e6-5cfa-40f1-b75a-049914e45370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:25.622274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8f3272e6-5cfa-40f1-b75a-049914e45370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:25.624484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 899/1803] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:25 2022] DELETE /identity/v3/projects/55bba2e1aaea4bd89ca6fc516ff17db4 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:25.630979 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c8c18-8281-49c7-bd78-99d5c9f21021 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:25.631133 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c8c18-8281-49c7-bd78-99d5c9f21021 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:25.631411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c8c18-8281-49c7-bd78-99d5c9f21021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:25.639593 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 905/1804] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:25 2022] POST /identity/v3/users => generated 284 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:25.643966 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82af55-da12-4a10-ae26-1af4bc7acf27 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:25.647143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-3b82af55-da12-4a10-ae26-1af4bc7acf27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:25.673389 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82af55-da12-4a10-ae26-1af4bc7acf27 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:25.673389 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78ac2a-3014-4945-848f-c99a8262c967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:25.673991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78ac2a-3014-4945-848f-c99a8262c967 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:25.674107 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78ac2a-3014-4945-848f-c99a8262c967 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:25.674347 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78ac2a-3014-4945-848f-c99a8262c967 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:25.675002 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78ac2a-3014-4945-848f-c99a8262c967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:25.677820 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78ac2a-3014-4945-848f-c99a8262c967 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:25.680705 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-428c8c18-8281-49c7-bd78-99d5c9f21021 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:25.681873 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-428c8c18-8281-49c7-bd78-99d5c9f21021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:25.692911 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 906/1805] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:25.696692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78ac2a-3014-4945-848f-c99a8262c967 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:25.707730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 900/1806] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:25.711721 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b2a4b-a15d-4e21-a5ca-d0806399e470 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:25.712208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78ac2a-3014-4945-848f-c99a8262c967 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:25.712432 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b2a4b-a15d-4e21-a5ca-d0806399e470 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:25.712884 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b2a4b-a15d-4e21-a5ca-d0806399e470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:25.718757 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8914b69-dd8b-468b-b47e-0fdd0d8494f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:25.720113 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8914b69-dd8b-468b-b47e-0fdd0d8494f9 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:25.720676 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8914b69-dd8b-468b-b47e-0fdd0d8494f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:25.721308 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8914b69-dd8b-468b-b47e-0fdd0d8494f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:25.722068 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8914b69-dd8b-468b-b47e-0fdd0d8494f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:25.724239 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8914b69-dd8b-468b-b47e-0fdd0d8494f9 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:25.745079 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 907/1807] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:25.746392 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8914b69-dd8b-468b-b47e-0fdd0d8494f9 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:25.755930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-502b2a4b-a15d-4e21-a5ca-d0806399e470 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:25.757182 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-502b2a4b-a15d-4e21-a5ca-d0806399e470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:25.765237 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8914b69-dd8b-468b-b47e-0fdd0d8494f9 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:25.775467 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 901/1808] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:25.776329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6abc1-c455-427f-9a8b-d2c474568b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:25.776833 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6abc1-c455-427f-9a8b-d2c474568b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:25.777315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6abc1-c455-427f-9a8b-d2c474568b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:25.778187 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b2a4b-a15d-4e21-a5ca-d0806399e470 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:25.782673 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6abc1-c455-427f-9a8b-d2c474568b0c admin admin] PATH_INFO: `/v3/projects/c194a88157374a05bad0d626284de4f0/users/2b313ba48ed8449bbb32a30b17661c19/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:25.791790 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b2a4b-a15d-4e21-a5ca-d0806399e470 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:25.797468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bfd48-541a-4dd5-bbec-680439096977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:25.798104 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bfd48-541a-4dd5-bbec-680439096977 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:25.798383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bfd48-541a-4dd5-bbec-680439096977 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:25.798653 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bfd48-541a-4dd5-bbec-680439096977 admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:25.799312 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bfd48-541a-4dd5-bbec-680439096977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:56:25.799647 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bfd48-541a-4dd5-bbec-680439096977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:25.802454 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bfd48-541a-4dd5-bbec-680439096977 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:25.808788 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6abc1-c455-427f-9a8b-d2c474568b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c194a88157374a05bad0d626284de4f0, user_id=2b313ba48ed8449bbb32a30b17661c19, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:25.814416 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6abc1-c455-427f-9a8b-d2c474568b0c admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:25.816198 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 902/1809] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:56:25.817919 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bfd48-541a-4dd5-bbec-680439096977 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:25.820299 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e63bfd48-541a-4dd5-bbec-680439096977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:25.836014 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bfd48-541a-4dd5-bbec-680439096977 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:25.841158 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ab262-91a7-49d6-8b3a-5491d776d4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:25.841960 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ab262-91a7-49d6-8b3a-5491d776d4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:25.842241 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ab262-91a7-49d6-8b3a-5491d776d4af admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:25.842513 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ab262-91a7-49d6-8b3a-5491d776d4af admin admin] PATH_INFO: `/v3/users/08544f78a0e04d3f88ebc2d2b9e138c4` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:25.844095 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ab262-91a7-49d6-8b3a-5491d776d4af admin admin] RBAC: Authorizing `identity:delete_user(user_id=08544f78a0e04d3f88ebc2d2b9e138c4)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:25.850685 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ab262-91a7-49d6-8b3a-5491d776d4af admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:25.928653 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 908/1810] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:25 2022] PUT /identity/v3/projects/c194a88157374a05bad0d626284de4f0/users/2b313ba48ed8449bbb32a30b17661c19/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:56:25.929767 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6abc1-c455-427f-9a8b-d2c474568b0c admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:25.977510 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:26.032249 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6abc1-c455-427f-9a8b-d2c474568b0c admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:26.039883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb25c22-2dfb-4dff-b0e3-3b6f528c8e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:26.041308 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb25c22-2dfb-4dff-b0e3-3b6f528c8e0d admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:26.041828 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb25c22-2dfb-4dff-b0e3-3b6f528c8e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:26.042789 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb25c22-2dfb-4dff-b0e3-3b6f528c8e0d admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:26.042789 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb25c22-2dfb-4dff-b0e3-3b6f528c8e0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:26.044870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb25c22-2dfb-4dff-b0e3-3b6f528c8e0d admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:26.069663 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-689ab262-91a7-49d6-8b3a-5491d776d4af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08544f78a0e04d3f88ebc2d2b9e138c4'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:26.162670 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-689ab262-91a7-49d6-8b3a-5491d776d4af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08544f78a0e04d3f88ebc2d2b9e138c4'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:26.163519 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-689ab262-91a7-49d6-8b3a-5491d776d4af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08544f78a0e04d3f88ebc2d2b9e138c4'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:26.174270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-689ab262-91a7-49d6-8b3a-5491d776d4af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08544f78a0e04d3f88ebc2d2b9e138c4'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:26.186482 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 909/1811] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:25 2022] POST /identity/v3/projects => generated 387 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:26.189055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a43c7c-49b9-46c3-8689-ccb799d8b343 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:26.189466 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a43c7c-49b9-46c3-8689-ccb799d8b343 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:26.190185 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a43c7c-49b9-46c3-8689-ccb799d8b343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:26.201366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-689ab262-91a7-49d6-8b3a-5491d776d4af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08544f78a0e04d3f88ebc2d2b9e138c4'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:26.227757 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 903/1812] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:25 2022] DELETE /identity/v3/users/08544f78a0e04d3f88ebc2d2b9e138c4 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:26.227757 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ab262-91a7-49d6-8b3a-5491d776d4af admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:26.229532 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-689ab262-91a7-49d6-8b3a-5491d776d4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:26.230808 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-d4a43c7c-49b9-46c3-8689-ccb799d8b343 None None] MFA Rules not processed for user `2b313ba48ed8449bbb32a30b17661c19`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:26.232216 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-d4a43c7c-49b9-46c3-8689-ccb799d8b343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:26.313144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 910/1813] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:26.313881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a43c7c-49b9-46c3-8689-ccb799d8b343 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:26.323796 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-d4a43c7c-49b9-46c3-8689-ccb799d8b343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:26.331877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ab262-91a7-49d6-8b3a-5491d776d4af admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:26.337229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626b61b-ab57-47b5-aa00-19713da1c8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:26.337921 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626b61b-ab57-47b5-aa00-19713da1c8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:26.338604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626b61b-ab57-47b5-aa00-19713da1c8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:26.338604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626b61b-ab57-47b5-aa00-19713da1c8ff admin admin] PATH_INFO: `/v3/projects/b5640eceb856408eb860b711ad70a71c` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:26.339616 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626b61b-ab57-47b5-aa00-19713da1c8ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5640eceb856408eb860b711ad70a71c)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:26.341530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626b61b-ab57-47b5-aa00-19713da1c8ff admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:26.344357 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a43c7c-49b9-46c3-8689-ccb799d8b343 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:26.351342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b241f-69cd-4f8c-af43-4bf7008dc266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:26.355657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b241f-69cd-4f8c-af43-4bf7008dc266 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:26.355657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b241f-69cd-4f8c-af43-4bf7008dc266 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:26.355657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b241f-69cd-4f8c-af43-4bf7008dc266 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:26.355657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b241f-69cd-4f8c-af43-4bf7008dc266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:26.355971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b241f-69cd-4f8c-af43-4bf7008dc266 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:26.425257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 911/1814] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:26 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:26.426887 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4537e9f-c2b2-4614-af00-6feec7500a49 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:26.427172 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4537e9f-c2b2-4614-af00-6feec7500a49 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:26.427444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4537e9f-c2b2-4614-af00-6feec7500a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:26.440103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-a626b61b-ab57-47b5-aa00-19713da1c8ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5640eceb856408eb860b711ad70a71c', 'request_id': 'req-a626b61b-ab57-47b5-aa00-19713da1c8ff'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:26.447011 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-f4537e9f-c2b2-4614-af00-6feec7500a49 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:26.453095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f4537e9f-c2b2-4614-af00-6feec7500a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:26.507090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 912/1815] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:26.507937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4537e9f-c2b2-4614-af00-6feec7500a49 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:26.509207 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f4537e9f-c2b2-4614-af00-6feec7500a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:26.527349 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4537e9f-c2b2-4614-af00-6feec7500a49 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:26.531955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460915b-f751-4ca4-917e-279000986aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:26.532566 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460915b-f751-4ca4-917e-279000986aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:26.532841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460915b-f751-4ca4-917e-279000986aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:26.533110 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460915b-f751-4ca4-917e-279000986aa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:26.533747 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460915b-f751-4ca4-917e-279000986aa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:26.536336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460915b-f751-4ca4-917e-279000986aa8 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:26.549996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-a626b61b-ab57-47b5-aa00-19713da1c8ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5640eceb856408eb860b711ad70a71c', 'request_id': 'req-a626b61b-ab57-47b5-aa00-19713da1c8ff'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:26.556472 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-a626b61b-ab57-47b5-aa00-19713da1c8ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5640eceb856408eb860b711ad70a71c', 'request_id': 'req-a626b61b-ab57-47b5-aa00-19713da1c8ff'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:26.568707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-a626b61b-ab57-47b5-aa00-19713da1c8ff admin admin] The token cache is being invalidate because project b5640eceb856408eb860b711ad70a71c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:26.568992 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-a626b61b-ab57-47b5-aa00-19713da1c8ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:26.569686 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-a626b61b-ab57-47b5-aa00-19713da1c8ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:26.571260 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 904/1816] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:26 2022] DELETE /identity/v3/projects/b5640eceb856408eb860b711ad70a71c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:26.572377 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626b61b-ab57-47b5-aa00-19713da1c8ff admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:26.573750 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-a626b61b-ab57-47b5-aa00-19713da1c8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:26.587277 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626b61b-ab57-47b5-aa00-19713da1c8ff admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:26.591976 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45799974-c676-4e3f-bbd4-b026133180cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:26.592573 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45799974-c676-4e3f-bbd4-b026133180cc admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:26.592850 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45799974-c676-4e3f-bbd4-b026133180cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:26.593121 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45799974-c676-4e3f-bbd4-b026133180cc admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:26.593768 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45799974-c676-4e3f-bbd4-b026133180cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:26.595387 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45799974-c676-4e3f-bbd4-b026133180cc admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:26.607034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 905/1817] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:26.608113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45799974-c676-4e3f-bbd4-b026133180cc admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:26.609888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-45799974-c676-4e3f-bbd4-b026133180cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:26.666857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45799974-c676-4e3f-bbd4-b026133180cc admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:26.670608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b4bee-3390-4f65-ad79-ed0d3e739aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:26.671212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b4bee-3390-4f65-ad79-ed0d3e739aef service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:26.671492 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b4bee-3390-4f65-ad79-ed0d3e739aef service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:26.671795 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b4bee-3390-4f65-ad79-ed0d3e739aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:26.673571 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-450b4bee-3390-4f65-ad79-ed0d3e739aef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:26.685398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b4bee-3390-4f65-ad79-ed0d3e739aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:26.686849 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b4bee-3390-4f65-ad79-ed0d3e739aef service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:26.697041 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 906/1818] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:26.698251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef01b8-35f4-4eda-a6b1-48d956a7933c None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:26.698527 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef01b8-35f4-4eda-a6b1-48d956a7933c None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:26.698799 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef01b8-35f4-4eda-a6b1-48d956a7933c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:26.703898 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 913/1819] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:26 2022] POST /identity/v3/projects => generated 369 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:26.703898 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460915b-f751-4ca4-917e-279000986aa8 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:26.723683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-ebef01b8-35f4-4eda-a6b1-48d956a7933c None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:26.724611 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ebef01b8-35f4-4eda-a6b1-48d956a7933c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:26.728494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:26.772651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460915b-f751-4ca4-917e-279000986aa8 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:26.778059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ac526-2245-4864-82cd-753f32fb4a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:26.778726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ac526-2245-4864-82cd-753f32fb4a6a admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:26.778952 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ac526-2245-4864-82cd-753f32fb4a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:26.779227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ac526-2245-4864-82cd-753f32fb4a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:26.779932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ac526-2245-4864-82cd-753f32fb4a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:26.781628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ac526-2245-4864-82cd-753f32fb4a6a admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:26.792477 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 914/1820] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:26.793298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ac526-2245-4864-82cd-753f32fb4a6a admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:26.794964 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-db6ac526-2245-4864-82cd-753f32fb4a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:26.796752 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 907/1821] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:26.797628 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef01b8-35f4-4eda-a6b1-48d956a7933c None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:26.812440 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef01b8-35f4-4eda-a6b1-48d956a7933c None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:26.814733 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ac526-2245-4864-82cd-753f32fb4a6a admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:26.817614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff65141-6578-4e47-9aaa-412c1597f8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:26.818269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff65141-6578-4e47-9aaa-412c1597f8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:26.818543 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff65141-6578-4e47-9aaa-412c1597f8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:26.818807 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff65141-6578-4e47-9aaa-412c1597f8b5 admin admin] PATH_INFO: `/v3/projects/a281b5cdc8a04979940d64039ef1ca3b/users/0cd276119102459abb595ad040b6c164/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:26.820103 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1971e1-0127-4273-a1f4-09e08c9da34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:26.820712 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1971e1-0127-4273-a1f4-09e08c9da34c admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:26.821108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1971e1-0127-4273-a1f4-09e08c9da34c admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:26.821515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1971e1-0127-4273-a1f4-09e08c9da34c admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:26.822429 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1971e1-0127-4273-a1f4-09e08c9da34c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:26.824380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1971e1-0127-4273-a1f4-09e08c9da34c admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:26.834358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff65141-6578-4e47-9aaa-412c1597f8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a281b5cdc8a04979940d64039ef1ca3b, user_id=0cd276119102459abb595ad040b6c164, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:26.837056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff65141-6578-4e47-9aaa-412c1597f8b5 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:26.990426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 915/1822] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:26 2022] POST /identity/v3/users => generated 291 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:26.998595 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 908/1823] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:26 2022] PUT /identity/v3/projects/a281b5cdc8a04979940d64039ef1ca3b/users/0cd276119102459abb595ad040b6c164/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:26.998739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfa451-6254-410a-9317-a69c08b47ac6 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:26.998739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfa451-6254-410a-9317-a69c08b47ac6 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:26.998739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfa451-6254-410a-9317-a69c08b47ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:27.008804 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff65141-6578-4e47-9aaa-412c1597f8b5 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:27.023252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-f2bfa451-6254-410a-9317-a69c08b47ac6 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:27.027745 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f2bfa451-6254-410a-9317-a69c08b47ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:27.079781 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff65141-6578-4e47-9aaa-412c1597f8b5 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:27.084992 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833d635-534e-4710-a04d-4a00dbb1e960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:27.085643 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833d635-534e-4710-a04d-4a00dbb1e960 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:27.085919 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833d635-534e-4710-a04d-4a00dbb1e960 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:27.086192 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833d635-534e-4710-a04d-4a00dbb1e960 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:27.087843 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833d635-534e-4710-a04d-4a00dbb1e960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:27.088495 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833d635-534e-4710-a04d-4a00dbb1e960 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:27.096301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 916/1824] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:27.097888 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d1f2a-3639-4d2e-876b-a550e1388ff2 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:27.098208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d1f2a-3639-4d2e-876b-a550e1388ff2 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:27.098477 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d1f2a-3639-4d2e-876b-a550e1388ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:27.104599 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 909/1825] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:27.105681 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833d635-534e-4710-a04d-4a00dbb1e960 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:27.117213 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833d635-534e-4710-a04d-4a00dbb1e960 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:27.125572 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb0859-7da2-4e6a-9dd8-f6ad4b4f11ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:27.125572 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb0859-7da2-4e6a-9dd8-f6ad4b4f11ac admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:27.125572 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb0859-7da2-4e6a-9dd8-f6ad4b4f11ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:27.125572 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb0859-7da2-4e6a-9dd8-f6ad4b4f11ac admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:27.126049 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb0859-7da2-4e6a-9dd8-f6ad4b4f11ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:56:27.126049 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb0859-7da2-4e6a-9dd8-f6ad4b4f11ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:27.126894 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb0859-7da2-4e6a-9dd8-f6ad4b4f11ac admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:27.130586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-c19d1f2a-3639-4d2e-876b-a550e1388ff2 None None] MFA Rules not processed for user `0cd276119102459abb595ad040b6c164`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:27.131950 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c19d1f2a-3639-4d2e-876b-a550e1388ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:27.141239 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 910/1826] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:56:27.141239 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb0859-7da2-4e6a-9dd8-f6ad4b4f11ac admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:27.154638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb0859-7da2-4e6a-9dd8-f6ad4b4f11ac admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:27.164960 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d82fd3-e306-47a8-bcb7-ef2387a5d27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:27.165652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d82fd3-e306-47a8-bcb7-ef2387a5d27f admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:27.166114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d82fd3-e306-47a8-bcb7-ef2387a5d27f admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:27.166394 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d82fd3-e306-47a8-bcb7-ef2387a5d27f admin admin] PATH_INFO: `/v3/projects/adf7b604ef874cacb1eb4a2183de1610/users/2ef4616a79ad42d69662a7d9c24dd042/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:27.189353 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d82fd3-e306-47a8-bcb7-ef2387a5d27f admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf7b604ef874cacb1eb4a2183de1610, user_id=2ef4616a79ad42d69662a7d9c24dd042, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:27.193729 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d82fd3-e306-47a8-bcb7-ef2387a5d27f admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:27.220558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 917/1827] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:27.230562 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d1f2a-3639-4d2e-876b-a550e1388ff2 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:27.244092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d1f2a-3639-4d2e-876b-a550e1388ff2 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:27.249079 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277e8aa-24d0-41a8-ae68-476b60163002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:27.253654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277e8aa-24d0-41a8-ae68-476b60163002 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:27.253654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277e8aa-24d0-41a8-ae68-476b60163002 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:27.253654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277e8aa-24d0-41a8-ae68-476b60163002 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:27.253654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277e8aa-24d0-41a8-ae68-476b60163002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:27.253654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277e8aa-24d0-41a8-ae68-476b60163002 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:27.345675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 911/1828] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:27 2022] PUT /identity/v3/projects/adf7b604ef874cacb1eb4a2183de1610/users/2ef4616a79ad42d69662a7d9c24dd042/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:27.345675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d82fd3-e306-47a8-bcb7-ef2387a5d27f admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:27.421856 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d82fd3-e306-47a8-bcb7-ef2387a5d27f admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:27.436273 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47b6bd-70d1-4ba3-846f-032e20ce4c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:27.436916 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47b6bd-70d1-4ba3-846f-032e20ce4c6e admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:27.440132 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 918/1829] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:27 2022] POST /identity/v3/projects => generated 365 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:27.440251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47b6bd-70d1-4ba3-846f-032e20ce4c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:27.440251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47b6bd-70d1-4ba3-846f-032e20ce4c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:27.440430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277e8aa-24d0-41a8-ae68-476b60163002 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:27.440539 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47b6bd-70d1-4ba3-846f-032e20ce4c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:27.440632 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f277e8aa-24d0-41a8-ae68-476b60163002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:27.440717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47b6bd-70d1-4ba3-846f-032e20ce4c6e admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:27.515089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277e8aa-24d0-41a8-ae68-476b60163002 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:27.519865 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820aad4-8508-482c-a199-9951c7c9a1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:27.520505 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820aad4-8508-482c-a199-9951c7c9a1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:27.520781 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820aad4-8508-482c-a199-9951c7c9a1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:27.521050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820aad4-8508-482c-a199-9951c7c9a1eb admin admin] PATH_INFO: `/v3/projects/d76bacdd7c154eac9b12e0debe87fab9` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:27.522157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820aad4-8508-482c-a199-9951c7c9a1eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d76bacdd7c154eac9b12e0debe87fab9)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:27.524155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820aad4-8508-482c-a199-9951c7c9a1eb admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:27.533844 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 912/1830] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:27 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:27.533844 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47b6bd-70d1-4ba3-846f-032e20ce4c6e admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:27.608199 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47b6bd-70d1-4ba3-846f-032e20ce4c6e admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:27.613168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4575f-51bb-4bac-99f7-981d727610aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:27.614382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4575f-51bb-4bac-99f7-981d727610aa admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:27.614755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4575f-51bb-4bac-99f7-981d727610aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:27.615049 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4575f-51bb-4bac-99f7-981d727610aa admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:27.615740 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4575f-51bb-4bac-99f7-981d727610aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:27.617752 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4575f-51bb-4bac-99f7-981d727610aa admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:27.627769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 913/1831] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:27.628556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4575f-51bb-4bac-99f7-981d727610aa admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:27.640369 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4575f-51bb-4bac-99f7-981d727610aa admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:27.640613 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3820aad4-8508-482c-a199-9951c7c9a1eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd76bacdd7c154eac9b12e0debe87fab9', 'request_id': 'req-3820aad4-8508-482c-a199-9951c7c9a1eb'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:27.697102 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9c494-69d7-420e-ad1a-e4c20c7ad5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:27.697708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9c494-69d7-420e-ad1a-e4c20c7ad5c8 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:27.697983 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9c494-69d7-420e-ad1a-e4c20c7ad5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:27.698252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9c494-69d7-420e-ad1a-e4c20c7ad5c8 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:27.698875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9c494-69d7-420e-ad1a-e4c20c7ad5c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:27.700801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9c494-69d7-420e-ad1a-e4c20c7ad5c8 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:27.742363 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3820aad4-8508-482c-a199-9951c7c9a1eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd76bacdd7c154eac9b12e0debe87fab9', 'request_id': 'req-3820aad4-8508-482c-a199-9951c7c9a1eb'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:27.748711 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3820aad4-8508-482c-a199-9951c7c9a1eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd76bacdd7c154eac9b12e0debe87fab9', 'request_id': 'req-3820aad4-8508-482c-a199-9951c7c9a1eb'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:27.760213 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3820aad4-8508-482c-a199-9951c7c9a1eb admin admin] The token cache is being invalidate because project d76bacdd7c154eac9b12e0debe87fab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:27.760518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3820aad4-8508-482c-a199-9951c7c9a1eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:27.761262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3820aad4-8508-482c-a199-9951c7c9a1eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:27.762772 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 919/1832] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:27 2022] DELETE /identity/v3/projects/d76bacdd7c154eac9b12e0debe87fab9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:27.763758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820aad4-8508-482c-a199-9951c7c9a1eb admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:27.765017 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-3820aad4-8508-482c-a199-9951c7c9a1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:27.777218 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820aad4-8508-482c-a199-9951c7c9a1eb admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:27.782035 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43952090-af35-4a38-a7e3-f33e6db84a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:27.782634 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43952090-af35-4a38-a7e3-f33e6db84a42 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:27.782914 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43952090-af35-4a38-a7e3-f33e6db84a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:27.783186 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43952090-af35-4a38-a7e3-f33e6db84a42 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:27.783851 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43952090-af35-4a38-a7e3-f33e6db84a42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:27.786602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43952090-af35-4a38-a7e3-f33e6db84a42 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:27.817534 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 914/1833] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:27 2022] POST /identity/v3/users => generated 283 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:27.818354 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9c494-69d7-420e-ad1a-e4c20c7ad5c8 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:27.819993 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-edf9c494-69d7-420e-ad1a-e4c20c7ad5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:27.831307 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9c494-69d7-420e-ad1a-e4c20c7ad5c8 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:27.836812 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1560fce-84c3-4fea-9be1-a71c3c6b16b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:27.837451 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1560fce-84c3-4fea-9be1-a71c3c6b16b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:27.837729 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1560fce-84c3-4fea-9be1-a71c3c6b16b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:27.838002 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1560fce-84c3-4fea-9be1-a71c3c6b16b0 admin admin] PATH_INFO: `/v3/projects/adf7b604ef874cacb1eb4a2183de1610/users/2ef4616a79ad42d69662a7d9c24dd042/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:27.840009 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1560fce-84c3-4fea-9be1-a71c3c6b16b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf7b604ef874cacb1eb4a2183de1610, user_id=2ef4616a79ad42d69662a7d9c24dd042, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:27.842628 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1560fce-84c3-4fea-9be1-a71c3c6b16b0 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:27.854506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 915/1834] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:27 2022] PUT /identity/v3/projects/adf7b604ef874cacb1eb4a2183de1610/users/2ef4616a79ad42d69662a7d9c24dd042/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:27.855287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1560fce-84c3-4fea-9be1-a71c3c6b16b0 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:27.856967 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d1560fce-84c3-4fea-9be1-a71c3c6b16b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:27.900595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 920/1835] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:27 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:27.904187 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43952090-af35-4a38-a7e3-f33e6db84a42 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:27.905822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-43952090-af35-4a38-a7e3-f33e6db84a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:27.918583 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43952090-af35-4a38-a7e3-f33e6db84a42 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:27.923617 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9705ea7-7a9b-4308-abfe-7e51f7f024f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:27.924236 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9705ea7-7a9b-4308-abfe-7e51f7f024f8 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:27.924514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9705ea7-7a9b-4308-abfe-7e51f7f024f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:27.924789 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9705ea7-7a9b-4308-abfe-7e51f7f024f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:27.925460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9705ea7-7a9b-4308-abfe-7e51f7f024f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:27.927535 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9705ea7-7a9b-4308-abfe-7e51f7f024f8 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:27.931640 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1560fce-84c3-4fea-9be1-a71c3c6b16b0 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:27.936311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca163faa-4baf-49ca-88ff-7d30453961e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:27.936965 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca163faa-4baf-49ca-88ff-7d30453961e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:27.937255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca163faa-4baf-49ca-88ff-7d30453961e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:27.937522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca163faa-4baf-49ca-88ff-7d30453961e7 admin admin] PATH_INFO: `/v3/users/0ab81a2612d346eea82454182943f220` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:27.938427 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 921/1836] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:27.938660 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca163faa-4baf-49ca-88ff-7d30453961e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab81a2612d346eea82454182943f220)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:27.939742 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2c6ad-4ef5-438c-aea7-54bc1c45a4f8 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:27.940027 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2c6ad-4ef5-438c-aea7-54bc1c45a4f8 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:27.940304 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2c6ad-4ef5-438c-aea7-54bc1c45a4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:27.940596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca163faa-4baf-49ca-88ff-7d30453961e7 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:27.968666 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-21f2c6ad-4ef5-438c-aea7-54bc1c45a4f8 None None] MFA Rules not processed for user `2ef4616a79ad42d69662a7d9c24dd042`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:27.969948 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-21f2c6ad-4ef5-438c-aea7-54bc1c45a4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:28.038585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 922/1837] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:28.039357 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2c6ad-4ef5-438c-aea7-54bc1c45a4f8 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:28.049911 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2c6ad-4ef5-438c-aea7-54bc1c45a4f8 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:28.055060 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5c149-aff7-43fb-a8dd-5913d4bb2082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:28.055703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5c149-aff7-43fb-a8dd-5913d4bb2082 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:28.055976 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5c149-aff7-43fb-a8dd-5913d4bb2082 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:28.056248 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5c149-aff7-43fb-a8dd-5913d4bb2082 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:28.056884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5c149-aff7-43fb-a8dd-5913d4bb2082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:28.058492 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5c149-aff7-43fb-a8dd-5913d4bb2082 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:28.068807 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 923/1838] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:28.069729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5c149-aff7-43fb-a8dd-5913d4bb2082 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:28.079069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5c149-aff7-43fb-a8dd-5913d4bb2082 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:28.084306 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b8a20-e4e7-4c5d-9bb6-f3d14e1addb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:28.084877 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b8a20-e4e7-4c5d-9bb6-f3d14e1addb3 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:28.085154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b8a20-e4e7-4c5d-9bb6-f3d14e1addb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:28.085424 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b8a20-e4e7-4c5d-9bb6-f3d14e1addb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:28.086036 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b8a20-e4e7-4c5d-9bb6-f3d14e1addb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:28.087584 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b8a20-e4e7-4c5d-9bb6-f3d14e1addb3 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:28.097026 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 924/1839] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:28.098595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b8a20-e4e7-4c5d-9bb6-f3d14e1addb3 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:28.100338 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-356b8a20-e4e7-4c5d-9bb6-f3d14e1addb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:28.167843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b8a20-e4e7-4c5d-9bb6-f3d14e1addb3 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:28.171419 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78287c-8887-45c3-89e7-6eeb8ccd617b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:28.172055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78287c-8887-45c3-89e7-6eeb8ccd617b service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:28.172333 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78287c-8887-45c3-89e7-6eeb8ccd617b service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:28.172617 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78287c-8887-45c3-89e7-6eeb8ccd617b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:28.181615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78287c-8887-45c3-89e7-6eeb8ccd617b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:28.183040 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78287c-8887-45c3-89e7-6eeb8ccd617b service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:28.194223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 925/1840] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:28.195104 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78287c-8887-45c3-89e7-6eeb8ccd617b service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:28.205755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-ca163faa-4baf-49ca-88ff-7d30453961e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab81a2612d346eea82454182943f220'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:28.208721 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78287c-8887-45c3-89e7-6eeb8ccd617b service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:28.215275 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce021a-5d7b-4d6d-ad01-909dda3e6f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:28.215927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce021a-5d7b-4d6d-ad01-909dda3e6f9a admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:28.216220 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce021a-5d7b-4d6d-ad01-909dda3e6f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:28.216476 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce021a-5d7b-4d6d-ad01-909dda3e6f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:28.217140 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce021a-5d7b-4d6d-ad01-909dda3e6f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:28.218787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce021a-5d7b-4d6d-ad01-909dda3e6f9a admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:28.229516 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 926/1841] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:28.233566 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce021a-5d7b-4d6d-ad01-909dda3e6f9a admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:28.240770 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce021a-5d7b-4d6d-ad01-909dda3e6f9a admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:28.245318 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd42f7-3c37-4b63-9a46-0dd2ae1d6aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:28.245964 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd42f7-3c37-4b63-9a46-0dd2ae1d6aca admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:28.246232 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd42f7-3c37-4b63-9a46-0dd2ae1d6aca admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:28.246500 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd42f7-3c37-4b63-9a46-0dd2ae1d6aca admin admin] PATH_INFO: `/v3/projects/4a721302e2c64801bc4c09a67fc93aae/users/9b6f30e6024d47d6a14bdd1c3b9728e7/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:28.261816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd42f7-3c37-4b63-9a46-0dd2ae1d6aca admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a721302e2c64801bc4c09a67fc93aae, user_id=9b6f30e6024d47d6a14bdd1c3b9728e7, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:28.264860 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd42f7-3c37-4b63-9a46-0dd2ae1d6aca admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:28.424802 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-ca163faa-4baf-49ca-88ff-7d30453961e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab81a2612d346eea82454182943f220'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:28.425521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-ca163faa-4baf-49ca-88ff-7d30453961e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab81a2612d346eea82454182943f220'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:28.432001 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 927/1842] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:28 2022] PUT /identity/v3/projects/4a721302e2c64801bc4c09a67fc93aae/users/9b6f30e6024d47d6a14bdd1c3b9728e7/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:28.443048 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd42f7-3c37-4b63-9a46-0dd2ae1d6aca admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:28.448722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-ca163faa-4baf-49ca-88ff-7d30453961e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab81a2612d346eea82454182943f220'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:28.450227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4acd42f7-3c37-4b63-9a46-0dd2ae1d6aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:28.463320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-ca163faa-4baf-49ca-88ff-7d30453961e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab81a2612d346eea82454182943f220'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:28.470995 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 916/1843] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:27 2022] DELETE /identity/v3/users/0ab81a2612d346eea82454182943f220 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:28.474305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdb61f-25be-42e4-8e47-a5a017762b89 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:28.474305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdb61f-25be-42e4-8e47-a5a017762b89 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:28.474305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdb61f-25be-42e4-8e47-a5a017762b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:28.510249 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-febdb61f-25be-42e4-8e47-a5a017762b89 None None] MFA Rules not processed for user `9b6f30e6024d47d6a14bdd1c3b9728e7`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:28.512582 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-febdb61f-25be-42e4-8e47-a5a017762b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:28.598304 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd42f7-3c37-4b63-9a46-0dd2ae1d6aca admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:28.616556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 917/1844] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:28.617529 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdb61f-25be-42e4-8e47-a5a017762b89 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:28.619724 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-febdb61f-25be-42e4-8e47-a5a017762b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:28.704317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da29be-0620-48e6-b90a-b3892147c642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:28.705873 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdb61f-25be-42e4-8e47-a5a017762b89 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:28.710218 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84e4ef-963a-46b4-a44e-9e5ca04af7fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:28.710907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84e4ef-963a-46b4-a44e-9e5ca04af7fe service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:28.711252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84e4ef-963a-46b4-a44e-9e5ca04af7fe service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:28.711618 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84e4ef-963a-46b4-a44e-9e5ca04af7fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:28.712322 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da29be-0620-48e6-b90a-b3892147c642 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:28.712762 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da29be-0620-48e6-b90a-b3892147c642 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:28.713259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da29be-0620-48e6-b90a-b3892147c642 admin admin] PATH_INFO: `/v3/projects/239ca5384c53438db1ec7cd32c6b90d5/users/0886f4d23b4d474db750918dbc9bdea4/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:28.720296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-6c84e4ef-963a-46b4-a44e-9e5ca04af7fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:28.739323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da29be-0620-48e6-b90a-b3892147c642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=239ca5384c53438db1ec7cd32c6b90d5, user_id=0886f4d23b4d474db750918dbc9bdea4, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:28.743355 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da29be-0620-48e6-b90a-b3892147c642 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:28.791145 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84e4ef-963a-46b4-a44e-9e5ca04af7fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:28.792640 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84e4ef-963a-46b4-a44e-9e5ca04af7fe service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:28.803114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 918/1845] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:28.803940 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84e4ef-963a-46b4-a44e-9e5ca04af7fe service cinder] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:28.805367 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-6c84e4ef-963a-46b4-a44e-9e5ca04af7fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:28.823355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84e4ef-963a-46b4-a44e-9e5ca04af7fe service cinder] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:28.835403 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 928/1846] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:28 2022] PUT /identity/v3/projects/239ca5384c53438db1ec7cd32c6b90d5/users/0886f4d23b4d474db750918dbc9bdea4/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:28.839456 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271b315-4978-4ec1-a8df-042a8a35af55 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:28.840212 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271b315-4978-4ec1-a8df-042a8a35af55 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:28.840500 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271b315-4978-4ec1-a8df-042a8a35af55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:28.899234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-8271b315-4978-4ec1-a8df-042a8a35af55 None None] MFA Rules not processed for user `0886f4d23b4d474db750918dbc9bdea4`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:28.899234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-8271b315-4978-4ec1-a8df-042a8a35af55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:28.928978 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3e1af-f54a-42e3-b6dd-78b50ee3c28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:28.928978 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3e1af-f54a-42e3-b6dd-78b50ee3c28a admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:28.928978 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3e1af-f54a-42e3-b6dd-78b50ee3c28a admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:28.928978 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3e1af-f54a-42e3-b6dd-78b50ee3c28a admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:28.929794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3e1af-f54a-42e3-b6dd-78b50ee3c28a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:28.932578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3e1af-f54a-42e3-b6dd-78b50ee3c28a admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:28.977781 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 929/1847] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:28.982150 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271b315-4978-4ec1-a8df-042a8a35af55 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:28.993682 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271b315-4978-4ec1-a8df-042a8a35af55 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:28.998571 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27d9a0-423b-4108-a6ef-2559132b0a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:28.999213 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27d9a0-423b-4108-a6ef-2559132b0a36 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:28.999488 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27d9a0-423b-4108-a6ef-2559132b0a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:29.000061 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27d9a0-423b-4108-a6ef-2559132b0a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:29.003521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27d9a0-423b-4108-a6ef-2559132b0a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:29.003521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27d9a0-423b-4108-a6ef-2559132b0a36 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:29.007087 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:29.115169 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 919/1848] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:28 2022] POST /identity/v3/projects => generated 363 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:29.115169 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3e1af-f54a-42e3-b6dd-78b50ee3c28a admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:29.115169 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-52e3e1af-f54a-42e3-b6dd-78b50ee3c28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:29.177656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3e1af-f54a-42e3-b6dd-78b50ee3c28a admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:29.182259 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8949e-62c3-42fa-92a2-2adf11362039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:29.182926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8949e-62c3-42fa-92a2-2adf11362039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:29.183201 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8949e-62c3-42fa-92a2-2adf11362039 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:29.183469 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8949e-62c3-42fa-92a2-2adf11362039 admin admin] PATH_INFO: `/v3/projects/ec43047fd8774939b9182699b291c2b0` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:29.184604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8949e-62c3-42fa-92a2-2adf11362039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec43047fd8774939b9182699b291c2b0)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:29.186485 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8949e-62c3-42fa-92a2-2adf11362039 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:29.224223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 930/1849] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:28 2022] POST /identity/v3/projects => generated 385 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:56:29.224223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27d9a0-423b-4108-a6ef-2559132b0a36 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:29.282892 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27d9a0-423b-4108-a6ef-2559132b0a36 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:29.287509 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66ceb9-68c3-4a9a-b04f-fbe61b4a2361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:29.288158 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66ceb9-68c3-4a9a-b04f-fbe61b4a2361 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:29.288442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66ceb9-68c3-4a9a-b04f-fbe61b4a2361 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:29.288717 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66ceb9-68c3-4a9a-b04f-fbe61b4a2361 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:29.289346 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66ceb9-68c3-4a9a-b04f-fbe61b4a2361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:29.291279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66ceb9-68c3-4a9a-b04f-fbe61b4a2361 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:29.348900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-08e8949e-62c3-42fa-92a2-2adf11362039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec43047fd8774939b9182699b291c2b0', 'request_id': 'req-08e8949e-62c3-42fa-92a2-2adf11362039'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:29.434382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 931/1850] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:29 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:29.435329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66ceb9-68c3-4a9a-b04f-fbe61b4a2361 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:29.447051 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66ceb9-68c3-4a9a-b04f-fbe61b4a2361 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:29.456995 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-08e8949e-62c3-42fa-92a2-2adf11362039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec43047fd8774939b9182699b291c2b0', 'request_id': 'req-08e8949e-62c3-42fa-92a2-2adf11362039'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:29.460241 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:29.465682 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-08e8949e-62c3-42fa-92a2-2adf11362039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec43047fd8774939b9182699b291c2b0', 'request_id': 'req-08e8949e-62c3-42fa-92a2-2adf11362039'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:29.478915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-08e8949e-62c3-42fa-92a2-2adf11362039 admin admin] The token cache is being invalidate because project ec43047fd8774939b9182699b291c2b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:29.479415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-08e8949e-62c3-42fa-92a2-2adf11362039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:29.480115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-08e8949e-62c3-42fa-92a2-2adf11362039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:29.481888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 920/1851] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:29 2022] DELETE /identity/v3/projects/ec43047fd8774939b9182699b291c2b0 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:29.485831 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8949e-62c3-42fa-92a2-2adf11362039 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:29.487177 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-08e8949e-62c3-42fa-92a2-2adf11362039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:29.511950 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c35a8a-8b3f-4ee1-aa70-9c924e096eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:29.512593 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c35a8a-8b3f-4ee1-aa70-9c924e096eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:29.512868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c35a8a-8b3f-4ee1-aa70-9c924e096eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:29.513465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c35a8a-8b3f-4ee1-aa70-9c924e096eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:29.514224 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c35a8a-8b3f-4ee1-aa70-9c924e096eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:29.516233 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c35a8a-8b3f-4ee1-aa70-9c924e096eb6 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:29.561044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8949e-62c3-42fa-92a2-2adf11362039 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:29.566123 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821df20a-45ac-4a27-9fdc-71cdcc35b4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:29.566845 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821df20a-45ac-4a27-9fdc-71cdcc35b4fa admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:29.567296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821df20a-45ac-4a27-9fdc-71cdcc35b4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:29.567607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821df20a-45ac-4a27-9fdc-71cdcc35b4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:29.568274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821df20a-45ac-4a27-9fdc-71cdcc35b4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:29.570040 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821df20a-45ac-4a27-9fdc-71cdcc35b4fa admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:29.580332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 921/1852] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:29.581490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d0ae5-27c7-41c7-ac5d-5044c5fa2f63 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:29.581776 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d0ae5-27c7-41c7-ac5d-5044c5fa2f63 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:29.582584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d0ae5-27c7-41c7-ac5d-5044c5fa2f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:29.605850 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-5f3d0ae5-27c7-41c7-ac5d-5044c5fa2f63 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:29.607844 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-5f3d0ae5-27c7-41c7-ac5d-5044c5fa2f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:29.619080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 922/1853] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:29.619920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d0ae5-27c7-41c7-ac5d-5044c5fa2f63 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:29.630524 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d0ae5-27c7-41c7-ac5d-5044c5fa2f63 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:29.637164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc84599-c0d5-4090-9c07-ac09cf649a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:29.637889 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc84599-c0d5-4090-9c07-ac09cf649a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:29.638185 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc84599-c0d5-4090-9c07-ac09cf649a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:29.638432 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc84599-c0d5-4090-9c07-ac09cf649a4a admin admin] PATH_INFO: `/v3/projects/1a23d962bd8c4467839a5222284b8041/users/8c1d46e1ed924925bb965aa43c20c650/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:29.645645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 932/1854] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:29 2022] POST /identity/v3/users => generated 299 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:29.648140 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95738b-15d1-4c01-aeef-df6e18521e18 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:29.648749 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95738b-15d1-4c01-aeef-df6e18521e18 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:29.649150 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95738b-15d1-4c01-aeef-df6e18521e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:29.671877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc84599-c0d5-4090-9c07-ac09cf649a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a23d962bd8c4467839a5222284b8041, user_id=8c1d46e1ed924925bb965aa43c20c650, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:29.674657 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc84599-c0d5-4090-9c07-ac09cf649a4a admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:29.675928 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-be95738b-15d1-4c01-aeef-df6e18521e18 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:29.677401 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-be95738b-15d1-4c01-aeef-df6e18521e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:29.693267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 933/1855] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:29.694322 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95738b-15d1-4c01-aeef-df6e18521e18 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:29.696222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-be95738b-15d1-4c01-aeef-df6e18521e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:29.716548 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95738b-15d1-4c01-aeef-df6e18521e18 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:29.721106 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19da717-8b31-4bc9-a87d-c6021a28dd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:29.721727 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19da717-8b31-4bc9-a87d-c6021a28dd74 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:29.722000 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19da717-8b31-4bc9-a87d-c6021a28dd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:29.722270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19da717-8b31-4bc9-a87d-c6021a28dd74 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:29.724224 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19da717-8b31-4bc9-a87d-c6021a28dd74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:29.725902 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19da717-8b31-4bc9-a87d-c6021a28dd74 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:29.737753 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 934/1856] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:29.740537 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19da717-8b31-4bc9-a87d-c6021a28dd74 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:29.752443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19da717-8b31-4bc9-a87d-c6021a28dd74 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:29.758343 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104c9d2-fb90-4683-a447-7dc3f6d88448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:29.764287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104c9d2-fb90-4683-a447-7dc3f6d88448 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:29.767999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104c9d2-fb90-4683-a447-7dc3f6d88448 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:29.768949 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104c9d2-fb90-4683-a447-7dc3f6d88448 admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:29.777456 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 923/1857] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:29 2022] PUT /identity/v3/projects/1a23d962bd8c4467839a5222284b8041/users/8c1d46e1ed924925bb965aa43c20c650/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:29.778414 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc84599-c0d5-4090-9c07-ac09cf649a4a admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:29.780787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104c9d2-fb90-4683-a447-7dc3f6d88448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:56:29.780787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104c9d2-fb90-4683-a447-7dc3f6d88448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:29.781994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104c9d2-fb90-4683-a447-7dc3f6d88448 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:29.807607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 935/1858] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:56:29.816364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104c9d2-fb90-4683-a447-7dc3f6d88448 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:29.832022 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104c9d2-fb90-4683-a447-7dc3f6d88448 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:29.899576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc84599-c0d5-4090-9c07-ac09cf649a4a admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:29.905116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7c0e1-6f4c-40d7-8f50-8d1ffdc722d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:29.905879 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7c0e1-6f4c-40d7-8f50-8d1ffdc722d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:29.906234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7c0e1-6f4c-40d7-8f50-8d1ffdc722d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:29.906589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7c0e1-6f4c-40d7-8f50-8d1ffdc722d5 admin admin] PATH_INFO: `/v3/projects/404a7ec2404e48df87eb4fcc2ba532d7/users/91c593f341ff456dbaa4e5df674149be/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:29.929671 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7c0e1-6f4c-40d7-8f50-8d1ffdc722d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=404a7ec2404e48df87eb4fcc2ba532d7, user_id=91c593f341ff456dbaa4e5df674149be, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:29.933156 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7c0e1-6f4c-40d7-8f50-8d1ffdc722d5 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:29.985413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eabead-7c4b-4dbe-bc7d-f33c6979797f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:29.986059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eabead-7c4b-4dbe-bc7d-f33c6979797f admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:29.986523 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eabead-7c4b-4dbe-bc7d-f33c6979797f admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:29.987094 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eabead-7c4b-4dbe-bc7d-f33c6979797f admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:29.987926 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eabead-7c4b-4dbe-bc7d-f33c6979797f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:29.989913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eabead-7c4b-4dbe-bc7d-f33c6979797f admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:30.010940 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 936/1859] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:30.012823 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eabead-7c4b-4dbe-bc7d-f33c6979797f admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:30.034501 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eabead-7c4b-4dbe-bc7d-f33c6979797f admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:30.043071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 924/1860] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:29 2022] PUT /identity/v3/projects/404a7ec2404e48df87eb4fcc2ba532d7/users/91c593f341ff456dbaa4e5df674149be/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:30.043071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7c0e1-6f4c-40d7-8f50-8d1ffdc722d5 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:30.142787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1a4f0-a961-4dac-ad99-0b94fe1ee216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:30.143678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1a4f0-a961-4dac-ad99-0b94fe1ee216 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:30.144144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1a4f0-a961-4dac-ad99-0b94fe1ee216 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:30.145413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1a4f0-a961-4dac-ad99-0b94fe1ee216 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:30.145651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1a4f0-a961-4dac-ad99-0b94fe1ee216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:30.149160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7c0e1-6f4c-40d7-8f50-8d1ffdc722d5 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:30.151445 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1a4f0-a961-4dac-ad99-0b94fe1ee216 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:30.154387 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e611e-8f22-4189-a142-862496b46386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:30.155116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e611e-8f22-4189-a142-862496b46386 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:30.155397 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e611e-8f22-4189-a142-862496b46386 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:30.155705 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e611e-8f22-4189-a142-862496b46386 admin admin] PATH_INFO: `/v3/projects/1a23d962bd8c4467839a5222284b8041/users/8c1d46e1ed924925bb965aa43c20c650/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:30.158357 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e611e-8f22-4189-a142-862496b46386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a23d962bd8c4467839a5222284b8041, user_id=8c1d46e1ed924925bb965aa43c20c650, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:30.161825 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e611e-8f22-4189-a142-862496b46386 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:30.173789 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 925/1861] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:30 2022] PUT /identity/v3/projects/1a23d962bd8c4467839a5222284b8041/users/8c1d46e1ed924925bb965aa43c20c650/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:30.175278 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e611e-8f22-4189-a142-862496b46386 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:30.236848 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e611e-8f22-4189-a142-862496b46386 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:30.241715 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e43f3-1f8c-42b2-b513-d98aeed6f339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:30.242333 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e43f3-1f8c-42b2-b513-d98aeed6f339 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:30.243081 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e43f3-1f8c-42b2-b513-d98aeed6f339 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:30.243081 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e43f3-1f8c-42b2-b513-d98aeed6f339 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:30.243502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e43f3-1f8c-42b2-b513-d98aeed6f339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:30.245136 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e43f3-1f8c-42b2-b513-d98aeed6f339 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:30.255484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 926/1862] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:30.257358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd09c3-7c85-4763-a21a-d6dd69eb8ebe None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:30.257661 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd09c3-7c85-4763-a21a-d6dd69eb8ebe None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:30.257932 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd09c3-7c85-4763-a21a-d6dd69eb8ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:30.292966 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-1cbd09c3-7c85-4763-a21a-d6dd69eb8ebe None None] MFA Rules not processed for user `8c1d46e1ed924925bb965aa43c20c650`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:30.294196 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1cbd09c3-7c85-4763-a21a-d6dd69eb8ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:30.297912 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 937/1863] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:30 2022] POST /identity/v3/projects => generated 383 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:30.297912 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1a4f0-a961-4dac-ad99-0b94fe1ee216 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:30.367678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1a4f0-a961-4dac-ad99-0b94fe1ee216 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:30.368381 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:30.374956 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 927/1864] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:30.375206 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6fa65-b559-4f00-aa39-2e64e6ae824c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:30.375821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd09c3-7c85-4763-a21a-d6dd69eb8ebe None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:30.376106 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6fa65-b559-4f00-aa39-2e64e6ae824c admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:30.377083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6fa65-b559-4f00-aa39-2e64e6ae824c admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:30.377083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6fa65-b559-4f00-aa39-2e64e6ae824c admin admin] PATH_INFO: `/v3/projects/404a7ec2404e48df87eb4fcc2ba532d7/users/91c593f341ff456dbaa4e5df674149be/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:30.379015 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d6fa65-b559-4f00-aa39-2e64e6ae824c admin admin] RBAC: Authorizing `identity:create_grant(project_id=404a7ec2404e48df87eb4fcc2ba532d7, user_id=91c593f341ff456dbaa4e5df674149be, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:30.382519 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d6fa65-b559-4f00-aa39-2e64e6ae824c admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:30.387325 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd09c3-7c85-4763-a21a-d6dd69eb8ebe None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:30.393542 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 938/1865] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:30 2022] PUT /identity/v3/projects/404a7ec2404e48df87eb4fcc2ba532d7/users/91c593f341ff456dbaa4e5df674149be/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:30.395125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6fa65-b559-4f00-aa39-2e64e6ae824c admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:30.397130 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-97d6fa65-b559-4f00-aa39-2e64e6ae824c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:30.445860 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a8278-21c0-4fa3-81b0-9f41f2523b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:30.446503 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a8278-21c0-4fa3-81b0-9f41f2523b79 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:30.446758 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a8278-21c0-4fa3-81b0-9f41f2523b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:30.447026 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a8278-21c0-4fa3-81b0-9f41f2523b79 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:30.447687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a8278-21c0-4fa3-81b0-9f41f2523b79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:30.449609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a8278-21c0-4fa3-81b0-9f41f2523b79 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:30.470125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6fa65-b559-4f00-aa39-2e64e6ae824c admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:30.474371 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78ad3b-2d9f-4a56-8562-c695d2cc6a43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:30.474990 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78ad3b-2d9f-4a56-8562-c695d2cc6a43 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:30.475269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78ad3b-2d9f-4a56-8562-c695d2cc6a43 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:30.475590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78ad3b-2d9f-4a56-8562-c695d2cc6a43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:30.534719 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78ad3b-2d9f-4a56-8562-c695d2cc6a43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:30.536373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78ad3b-2d9f-4a56-8562-c695d2cc6a43 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:30.547270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 939/1866] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:30.549383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1bf24-dfb1-4776-afdf-3c86a0195e63 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:30.549927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1bf24-dfb1-4776-afdf-3c86a0195e63 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:30.550233 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1bf24-dfb1-4776-afdf-3c86a0195e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:30.581082 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-e6c1bf24-dfb1-4776-afdf-3c86a0195e63 None None] MFA Rules not processed for user `91c593f341ff456dbaa4e5df674149be`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:30.583077 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-e6c1bf24-dfb1-4776-afdf-3c86a0195e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:30.585015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 928/1867] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:30 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:30.588968 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a8278-21c0-4fa3-81b0-9f41f2523b79 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:30.599556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a8278-21c0-4fa3-81b0-9f41f2523b79 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:30.606664 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9de706-821f-44af-a0cc-19f9e84c645a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:30.607266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9de706-821f-44af-a0cc-19f9e84c645a admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:30.607561 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9de706-821f-44af-a0cc-19f9e84c645a admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:30.607839 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9de706-821f-44af-a0cc-19f9e84c645a admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:30.608483 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9de706-821f-44af-a0cc-19f9e84c645a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:30.610070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9de706-821f-44af-a0cc-19f9e84c645a admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:30.620408 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 929/1868] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:56:30.624517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9de706-821f-44af-a0cc-19f9e84c645a admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:30.636713 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9de706-821f-44af-a0cc-19f9e84c645a admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:30.647658 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fd6ff-7908-4d65-a27e-42ebd480dd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:30.648278 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fd6ff-7908-4d65-a27e-42ebd480dd74 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:30.648717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fd6ff-7908-4d65-a27e-42ebd480dd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:30.648844 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fd6ff-7908-4d65-a27e-42ebd480dd74 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:30.649561 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506fd6ff-7908-4d65-a27e-42ebd480dd74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:30.651194 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506fd6ff-7908-4d65-a27e-42ebd480dd74 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:30.653734 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 940/1869] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:30.666763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 930/1870] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:56:30.667055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1bf24-dfb1-4776-afdf-3c86a0195e63 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:30.668708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-e6c1bf24-dfb1-4776-afdf-3c86a0195e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:30.672035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fd6ff-7908-4d65-a27e-42ebd480dd74 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:30.684304 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fd6ff-7908-4d65-a27e-42ebd480dd74 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:30.684491 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1bf24-dfb1-4776-afdf-3c86a0195e63 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:30.688580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37d14d-7349-4cae-b414-815f2245c0fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:30.689275 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37d14d-7349-4cae-b414-815f2245c0fc service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:30.689679 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37d14d-7349-4cae-b414-815f2245c0fc service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:30.690030 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37d14d-7349-4cae-b414-815f2245c0fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:30.690168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63dae6-52ab-47d4-9232-6f7d84b15469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:30.690812 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63dae6-52ab-47d4-9232-6f7d84b15469 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:30.691149 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63dae6-52ab-47d4-9232-6f7d84b15469 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:30.692578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63dae6-52ab-47d4-9232-6f7d84b15469 admin admin] PATH_INFO: `/v3/projects/989ede746b3a4b7baa5ca51247223ab5/users/5feb2ebb23354a3fb900ce2579a2de7d/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:30.704636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37d14d-7349-4cae-b414-815f2245c0fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:30.708527 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37d14d-7349-4cae-b414-815f2245c0fc service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:30.712017 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63dae6-52ab-47d4-9232-6f7d84b15469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=989ede746b3a4b7baa5ca51247223ab5, user_id=5feb2ebb23354a3fb900ce2579a2de7d, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:30.715133 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63dae6-52ab-47d4-9232-6f7d84b15469 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:30.721348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 941/1871] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:56:30.799972 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 931/1872] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:30 2022] PUT /identity/v3/projects/989ede746b3a4b7baa5ca51247223ab5/users/5feb2ebb23354a3fb900ce2579a2de7d/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:30.815035 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb9811-1c0d-4105-9b52-4a6742316dad None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:30.815381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb9811-1c0d-4105-9b52-4a6742316dad None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:30.815700 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb9811-1c0d-4105-9b52-4a6742316dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:30.849012 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-a0cb9811-1c0d-4105-9b52-4a6742316dad None None] MFA Rules not processed for user `5feb2ebb23354a3fb900ce2579a2de7d`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:30.850334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a0cb9811-1c0d-4105-9b52-4a6742316dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:30.922062 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63dae6-52ab-47d4-9232-6f7d84b15469 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:30.953472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 942/1873] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:56:30.962927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb9811-1c0d-4105-9b52-4a6742316dad None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:31.038103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63dae6-52ab-47d4-9232-6f7d84b15469 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:31.044438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad74fbb-7a5e-4735-be47-fa495fbd8488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:31.045182 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad74fbb-7a5e-4735-be47-fa495fbd8488 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:31.045531 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad74fbb-7a5e-4735-be47-fa495fbd8488 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:31.048462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad74fbb-7a5e-4735-be47-fa495fbd8488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:31.065021 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3ad74fbb-7a5e-4735-be47-fa495fbd8488 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:31.078407 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb9811-1c0d-4105-9b52-4a6742316dad None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:31.084863 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c30442-d773-4d2d-aa0c-75fde5e56eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:31.085859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c30442-d773-4d2d-aa0c-75fde5e56eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:31.086287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c30442-d773-4d2d-aa0c-75fde5e56eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:31.086741 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c30442-d773-4d2d-aa0c-75fde5e56eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:31.087653 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c30442-d773-4d2d-aa0c-75fde5e56eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:31.089850 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c30442-d773-4d2d-aa0c-75fde5e56eb9 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:31.154583 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad74fbb-7a5e-4735-be47-fa495fbd8488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:31.156385 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad74fbb-7a5e-4735-be47-fa495fbd8488 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:31.170482 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 932/1874] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:56:31.214941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 943/1875] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:30 2022] POST /identity/v3/projects => generated 381 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:31.216114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad74fbb-7a5e-4735-be47-fa495fbd8488 service cinder] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:31.230898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad74fbb-7a5e-4735-be47-fa495fbd8488 service cinder] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:31.326746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83517f76-61d7-4550-ac2a-cd8069768423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:31.333482 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83517f76-61d7-4550-ac2a-cd8069768423 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:31.333482 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83517f76-61d7-4550-ac2a-cd8069768423 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:31.333482 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83517f76-61d7-4550-ac2a-cd8069768423 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:31.333482 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83517f76-61d7-4550-ac2a-cd8069768423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:31.333482 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83517f76-61d7-4550-ac2a-cd8069768423 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:31.419499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 933/1876] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:31 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:31.423301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c30442-d773-4d2d-aa0c-75fde5e56eb9 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:31.434451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c30442-d773-4d2d-aa0c-75fde5e56eb9 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:31.439238 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ac35c-7cd7-4149-85e9-8e770931ee52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:31.440042 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ac35c-7cd7-4149-85e9-8e770931ee52 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:31.440322 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ac35c-7cd7-4149-85e9-8e770931ee52 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:31.440597 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ac35c-7cd7-4149-85e9-8e770931ee52 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:31.441250 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ac35c-7cd7-4149-85e9-8e770931ee52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:31.443140 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ac35c-7cd7-4149-85e9-8e770931ee52 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:31.453555 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 944/1877] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:31.458538 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83517f76-61d7-4550-ac2a-cd8069768423 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:31.470821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83517f76-61d7-4550-ac2a-cd8069768423 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:31.476584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa815396-3d3e-4d61-bf06-872b1c875e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:31.477585 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa815396-3d3e-4d61-bf06-872b1c875e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:31.477869 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa815396-3d3e-4d61-bf06-872b1c875e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:31.478140 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa815396-3d3e-4d61-bf06-872b1c875e64 admin admin] PATH_INFO: `/v3/projects/64739dcfb06e4d4aaaeefe4be1af0619/users/31a4429d11014c67bce518baa5229604/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:31.493900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa815396-3d3e-4d61-bf06-872b1c875e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64739dcfb06e4d4aaaeefe4be1af0619, user_id=31a4429d11014c67bce518baa5229604, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:31.496651 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa815396-3d3e-4d61-bf06-872b1c875e64 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:31.594113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 934/1878] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:31 2022] PUT /identity/v3/projects/64739dcfb06e4d4aaaeefe4be1af0619/users/31a4429d11014c67bce518baa5229604/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:31.602773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ac35c-7cd7-4149-85e9-8e770931ee52 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:31.619447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ac35c-7cd7-4149-85e9-8e770931ee52 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:31.677092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc6f4c-f016-4daa-aba2-fe3eb68e212d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:31.677714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc6f4c-f016-4daa-aba2-fe3eb68e212d admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:31.677992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc6f4c-f016-4daa-aba2-fe3eb68e212d admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:31.678260 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc6f4c-f016-4daa-aba2-fe3eb68e212d admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:31.678897 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc6f4c-f016-4daa-aba2-fe3eb68e212d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:31.680771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc6f4c-f016-4daa-aba2-fe3eb68e212d admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:31.691493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 945/1879] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:31.696107 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa815396-3d3e-4d61-bf06-872b1c875e64 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:31.712947 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa815396-3d3e-4d61-bf06-872b1c875e64 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:31.720143 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f30282-498b-49f2-ad97-3f55b865cbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:31.721075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f30282-498b-49f2-ad97-3f55b865cbfe admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:31.721554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f30282-498b-49f2-ad97-3f55b865cbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:31.722321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f30282-498b-49f2-ad97-3f55b865cbfe admin admin] PATH_INFO: `/v3/projects/64739dcfb06e4d4aaaeefe4be1af0619/users/31a4429d11014c67bce518baa5229604/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:31.731386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f30282-498b-49f2-ad97-3f55b865cbfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=64739dcfb06e4d4aaaeefe4be1af0619, user_id=31a4429d11014c67bce518baa5229604, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:31.734697 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f30282-498b-49f2-ad97-3f55b865cbfe admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:31.756321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 935/1880] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:31 2022] PUT /identity/v3/projects/64739dcfb06e4d4aaaeefe4be1af0619/users/31a4429d11014c67bce518baa5229604/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:56:31.768994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcbaa5-5a40-4420-b7b3-7bfd11d71546 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:31.769288 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcbaa5-5a40-4420-b7b3-7bfd11d71546 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:31.770172 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcbaa5-5a40-4420-b7b3-7bfd11d71546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:31.805764 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-bcfcbaa5-5a40-4420-b7b3-7bfd11d71546 None None] MFA Rules not processed for user `31a4429d11014c67bce518baa5229604`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:31.807007 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-bcfcbaa5-5a40-4420-b7b3-7bfd11d71546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:31.894165 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 946/1881] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:31.916352 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:31.935177 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f30282-498b-49f2-ad97-3f55b865cbfe admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:31.998113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f30282-498b-49f2-ad97-3f55b865cbfe admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:32.002045 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0f427-26fb-418d-8417-2369b087c34a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:32.002697 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0f427-26fb-418d-8417-2369b087c34a service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:32.002976 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0f427-26fb-418d-8417-2369b087c34a service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:32.003254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0f427-26fb-418d-8417-2369b087c34a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:32.013791 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0f427-26fb-418d-8417-2369b087c34a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:32.015244 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0f427-26fb-418d-8417-2369b087c34a service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:32.025437 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 936/1882] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:32.256831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4c6c6-300e-480e-aaa3-2fc2653534c0 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:32.257646 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4c6c6-300e-480e-aaa3-2fc2653534c0 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:32.258101 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4c6c6-300e-480e-aaa3-2fc2653534c0 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:32.260619 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 947/1883] 10.222.0.15 () {54 vars in 921 bytes} [Wed Sep 14 19:56:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:56:32.283023 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd59918-bbcd-4ffe-a2d4-5ea6fc70f1b6 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:32.283800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd59918-bbcd-4ffe-a2d4-5ea6fc70f1b6 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:32.284274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd59918-bbcd-4ffe-a2d4-5ea6fc70f1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:32.313640 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-dbd59918-bbcd-4ffe-a2d4-5ea6fc70f1b6 None None] MFA Rules not processed for user `421f6cc846b342918a177d2794eb3db8`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:32.314374 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-dbd59918-bbcd-4ffe-a2d4-5ea6fc70f1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:32.417076 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 937/1884] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Sep 14 19:56:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:32.484778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4c6c6-300e-480e-aaa3-2fc2653534c0 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:32.487200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-d4c4c6c6-300e-480e-aaa3-2fc2653534c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:32.512698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4c6c6-300e-480e-aaa3-2fc2653534c0 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:32.518899 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ba63a-137c-48f9-bda0-b1503cfa6dcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:32.520262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ba63a-137c-48f9-bda0-b1503cfa6dcc service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:32.520453 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ba63a-137c-48f9-bda0-b1503cfa6dcc service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:32.520727 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ba63a-137c-48f9-bda0-b1503cfa6dcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:32.530258 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ba63a-137c-48f9-bda0-b1503cfa6dcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:32.531926 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ba63a-137c-48f9-bda0-b1503cfa6dcc service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:32.545990 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 948/1885] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:32.677888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd59918-bbcd-4ffe-a2d4-5ea6fc70f1b6 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:32.686474 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd59918-bbcd-4ffe-a2d4-5ea6fc70f1b6 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:32.690419 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a18001-33dd-435e-b389-b463682d0bc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:32.691958 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a18001-33dd-435e-b389-b463682d0bc3 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:32.692401 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a18001-33dd-435e-b389-b463682d0bc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:32.693051 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a18001-33dd-435e-b389-b463682d0bc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:32.780779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a18001-33dd-435e-b389-b463682d0bc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:32.782222 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a18001-33dd-435e-b389-b463682d0bc3 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:32.791965 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 938/1886] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:56:32.955644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:33.106198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ba63a-137c-48f9-bda0-b1503cfa6dcc service nova] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:33.120447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ba63a-137c-48f9-bda0-b1503cfa6dcc service nova] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:33.121659 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed7f1f-0695-4779-b74a-d4ff2ad23256 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:33.122265 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed7f1f-0695-4779-b74a-d4ff2ad23256 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:33.122573 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed7f1f-0695-4779-b74a-d4ff2ad23256 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:33.122819 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed7f1f-0695-4779-b74a-d4ff2ad23256 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:33.124585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-9eed7f1f-0695-4779-b74a-d4ff2ad23256 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:33.187525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed7f1f-0695-4779-b74a-d4ff2ad23256 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:33.193517 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed7f1f-0695-4779-b74a-d4ff2ad23256 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:33.198916 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 949/1887] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:33.453432 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:34.205312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:34.664530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a18001-33dd-435e-b389-b463682d0bc3 service cinder] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:34.761662 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a18001-33dd-435e-b389-b463682d0bc3 service cinder] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:34.766947 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93799d3b-ed02-457e-a234-b3f3bc0f3fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:34.767613 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93799d3b-ed02-457e-a234-b3f3bc0f3fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:34.767888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93799d3b-ed02-457e-a234-b3f3bc0f3fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:34.768320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93799d3b-ed02-457e-a234-b3f3bc0f3fd1 admin admin] PATH_INFO: `/v3/users/5feb2ebb23354a3fb900ce2579a2de7d` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:34.769983 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93799d3b-ed02-457e-a234-b3f3bc0f3fd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5feb2ebb23354a3fb900ce2579a2de7d)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:34.772000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93799d3b-ed02-457e-a234-b3f3bc0f3fd1 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:35.089094 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-93799d3b-ed02-457e-a234-b3f3bc0f3fd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5feb2ebb23354a3fb900ce2579a2de7d'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:35.172918 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-93799d3b-ed02-457e-a234-b3f3bc0f3fd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5feb2ebb23354a3fb900ce2579a2de7d'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:35.173602 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-93799d3b-ed02-457e-a234-b3f3bc0f3fd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5feb2ebb23354a3fb900ce2579a2de7d'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:35.183229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-93799d3b-ed02-457e-a234-b3f3bc0f3fd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5feb2ebb23354a3fb900ce2579a2de7d'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:35.203701 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-93799d3b-ed02-457e-a234-b3f3bc0f3fd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5feb2ebb23354a3fb900ce2579a2de7d'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:35.215221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 939/1888] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:34 2022] DELETE /identity/v3/users/5feb2ebb23354a3fb900ce2579a2de7d => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:35.220445 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057b291-d690-45f7-997b-04486d7b577e None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:35.220918 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057b291-d690-45f7-997b-04486d7b577e None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:35.221040 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057b291-d690-45f7-997b-04486d7b577e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:35.242625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-7057b291-d690-45f7-997b-04486d7b577e None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:35.243989 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-7057b291-d690-45f7-997b-04486d7b577e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:35.322127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 950/1889] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:35.331771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93799d3b-ed02-457e-a234-b3f3bc0f3fd1 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:35.333966 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-93799d3b-ed02-457e-a234-b3f3bc0f3fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:35.408243 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93799d3b-ed02-457e-a234-b3f3bc0f3fd1 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:35.411265 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4e31a-3aa7-4a6c-9bee-43a4646ea62b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:35.411925 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4e31a-3aa7-4a6c-9bee-43a4646ea62b service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:35.412196 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4e31a-3aa7-4a6c-9bee-43a4646ea62b service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:35.412493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4e31a-3aa7-4a6c-9bee-43a4646ea62b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:35.422198 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4e31a-3aa7-4a6c-9bee-43a4646ea62b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:35.423702 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4e31a-3aa7-4a6c-9bee-43a4646ea62b service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:35.434284 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 940/1890] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:36.055759 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057b291-d690-45f7-997b-04486d7b577e None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:36.057157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-7057b291-d690-45f7-997b-04486d7b577e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:36.098786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057b291-d690-45f7-997b-04486d7b577e None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:36.117973 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b9ac5-e3fe-475e-bf04-4dba016c3569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:36.119234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b9ac5-e3fe-475e-bf04-4dba016c3569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:36.119709 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b9ac5-e3fe-475e-bf04-4dba016c3569 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:36.119992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b9ac5-e3fe-475e-bf04-4dba016c3569 admin admin] PATH_INFO: `/v3/projects/989ede746b3a4b7baa5ca51247223ab5` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:36.121327 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b9ac5-e3fe-475e-bf04-4dba016c3569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=989ede746b3a4b7baa5ca51247223ab5)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:36.123602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b9ac5-e3fe-475e-bf04-4dba016c3569 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:36.257514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d33b9ac5-e3fe-475e-bf04-4dba016c3569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '989ede746b3a4b7baa5ca51247223ab5', 'request_id': 'req-d33b9ac5-e3fe-475e-bf04-4dba016c3569'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:36.381824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4e31a-3aa7-4a6c-9bee-43a4646ea62b service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:36.393559 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-60c4e31a-3aa7-4a6c-9bee-43a4646ea62b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:36.401357 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4e31a-3aa7-4a6c-9bee-43a4646ea62b service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:36.419338 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d33b9ac5-e3fe-475e-bf04-4dba016c3569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '989ede746b3a4b7baa5ca51247223ab5', 'request_id': 'req-d33b9ac5-e3fe-475e-bf04-4dba016c3569'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:36.426807 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d33b9ac5-e3fe-475e-bf04-4dba016c3569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '989ede746b3a4b7baa5ca51247223ab5', 'request_id': 'req-d33b9ac5-e3fe-475e-bf04-4dba016c3569'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:36.442438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d33b9ac5-e3fe-475e-bf04-4dba016c3569 admin admin] The token cache is being invalidate because project 989ede746b3a4b7baa5ca51247223ab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:36.443025 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d33b9ac5-e3fe-475e-bf04-4dba016c3569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:36.443913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d33b9ac5-e3fe-475e-bf04-4dba016c3569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:36.448933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 951/1891] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:36 2022] DELETE /identity/v3/projects/989ede746b3a4b7baa5ca51247223ab5 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:36.449908 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b9ac5-e3fe-475e-bf04-4dba016c3569 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:36.451787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-d33b9ac5-e3fe-475e-bf04-4dba016c3569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:36.468235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699480b9-1eba-4b77-ac08-0c03aa213863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:36.468880 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699480b9-1eba-4b77-ac08-0c03aa213863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:36.469160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699480b9-1eba-4b77-ac08-0c03aa213863 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:36.469434 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699480b9-1eba-4b77-ac08-0c03aa213863 admin admin] PATH_INFO: `/v3/users/2b313ba48ed8449bbb32a30b17661c19` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:36.470596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699480b9-1eba-4b77-ac08-0c03aa213863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b313ba48ed8449bbb32a30b17661c19)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:36.472647 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699480b9-1eba-4b77-ac08-0c03aa213863 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:36.517099 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b9ac5-e3fe-475e-bf04-4dba016c3569 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:36.522748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264720c-4f34-42d6-b03a-2d8f37ed8112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:36.523461 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264720c-4f34-42d6-b03a-2d8f37ed8112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:36.523871 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264720c-4f34-42d6-b03a-2d8f37ed8112 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:36.524152 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264720c-4f34-42d6-b03a-2d8f37ed8112 admin admin] PATH_INFO: `/v3/users/31a4429d11014c67bce518baa5229604` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:36.525324 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264720c-4f34-42d6-b03a-2d8f37ed8112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a4429d11014c67bce518baa5229604)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:36.527259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264720c-4f34-42d6-b03a-2d8f37ed8112 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:36.650462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:36.766239 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-699480b9-1eba-4b77-ac08-0c03aa213863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b313ba48ed8449bbb32a30b17661c19'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:36.790205 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3264720c-4f34-42d6-b03a-2d8f37ed8112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a4429d11014c67bce518baa5229604'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:36.921658 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-699480b9-1eba-4b77-ac08-0c03aa213863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b313ba48ed8449bbb32a30b17661c19'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:36.927754 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-699480b9-1eba-4b77-ac08-0c03aa213863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b313ba48ed8449bbb32a30b17661c19'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:36.933996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-699480b9-1eba-4b77-ac08-0c03aa213863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b313ba48ed8449bbb32a30b17661c19'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:36.961259 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-699480b9-1eba-4b77-ac08-0c03aa213863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b313ba48ed8449bbb32a30b17661c19'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:36.970872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 941/1892] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:36 2022] DELETE /identity/v3/users/2b313ba48ed8449bbb32a30b17661c19 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:36.977325 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97420479-7cde-4ae7-af1b-db842042630b None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:36.978632 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97420479-7cde-4ae7-af1b-db842042630b None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:36.979654 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97420479-7cde-4ae7-af1b-db842042630b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:37.011161 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3264720c-4f34-42d6-b03a-2d8f37ed8112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a4429d11014c67bce518baa5229604'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:37.012105 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3264720c-4f34-42d6-b03a-2d8f37ed8112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a4429d11014c67bce518baa5229604'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:37.013291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-97420479-7cde-4ae7-af1b-db842042630b None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:37.014268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-97420479-7cde-4ae7-af1b-db842042630b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:37.028758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3264720c-4f34-42d6-b03a-2d8f37ed8112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a4429d11014c67bce518baa5229604'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:37.037559 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3264720c-4f34-42d6-b03a-2d8f37ed8112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a4429d11014c67bce518baa5229604'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:37.042248 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:37.046756 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 952/1893] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:36 2022] DELETE /identity/v3/users/31a4429d11014c67bce518baa5229604 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:37.100070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 942/1894] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:37.116355 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264720c-4f34-42d6-b03a-2d8f37ed8112 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:37.118031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-3264720c-4f34-42d6-b03a-2d8f37ed8112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:37.216097 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264720c-4f34-42d6-b03a-2d8f37ed8112 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:37.221292 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687ff4f-f223-4d3d-9425-6a3258947fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:37.221928 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687ff4f-f223-4d3d-9425-6a3258947fad service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:37.222211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687ff4f-f223-4d3d-9425-6a3258947fad service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:37.222507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687ff4f-f223-4d3d-9425-6a3258947fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:37.337765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687ff4f-f223-4d3d-9425-6a3258947fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:37.340449 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687ff4f-f223-4d3d-9425-6a3258947fad service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:37.355428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 953/1895] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:37.967119 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97420479-7cde-4ae7-af1b-db842042630b None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:37.969392 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-97420479-7cde-4ae7-af1b-db842042630b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:37.993026 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97420479-7cde-4ae7-af1b-db842042630b None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:37.998175 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395d7f6-8fb3-405e-bbb9-8d80d1db1e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:37.998824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395d7f6-8fb3-405e-bbb9-8d80d1db1e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:37.999101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395d7f6-8fb3-405e-bbb9-8d80d1db1e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:37.999537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395d7f6-8fb3-405e-bbb9-8d80d1db1e9f admin admin] PATH_INFO: `/v3/projects/c194a88157374a05bad0d626284de4f0` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:38.001217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395d7f6-8fb3-405e-bbb9-8d80d1db1e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c194a88157374a05bad0d626284de4f0)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:38.003371 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395d7f6-8fb3-405e-bbb9-8d80d1db1e9f admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:38.026616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687ff4f-f223-4d3d-9425-6a3258947fad service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:38.028267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-6687ff4f-f223-4d3d-9425-6a3258947fad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:38.045491 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687ff4f-f223-4d3d-9425-6a3258947fad service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:38.053357 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01be94a-e694-4f97-934c-0203077bc8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:38.054024 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01be94a-e694-4f97-934c-0203077bc8d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:38.054308 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01be94a-e694-4f97-934c-0203077bc8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:38.054582 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01be94a-e694-4f97-934c-0203077bc8d2 admin admin] PATH_INFO: `/v3/projects/64739dcfb06e4d4aaaeefe4be1af0619` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:38.058942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01be94a-e694-4f97-934c-0203077bc8d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64739dcfb06e4d4aaaeefe4be1af0619)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:38.058942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01be94a-e694-4f97-934c-0203077bc8d2 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:38.215378 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-7395d7f6-8fb3-405e-bbb9-8d80d1db1e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c194a88157374a05bad0d626284de4f0', 'request_id': 'req-7395d7f6-8fb3-405e-bbb9-8d80d1db1e9f'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:38.310353 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:38.351703 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-7395d7f6-8fb3-405e-bbb9-8d80d1db1e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c194a88157374a05bad0d626284de4f0', 'request_id': 'req-7395d7f6-8fb3-405e-bbb9-8d80d1db1e9f'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:38.364217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-7395d7f6-8fb3-405e-bbb9-8d80d1db1e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c194a88157374a05bad0d626284de4f0', 'request_id': 'req-7395d7f6-8fb3-405e-bbb9-8d80d1db1e9f'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:38.387829 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a01be94a-e694-4f97-934c-0203077bc8d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64739dcfb06e4d4aaaeefe4be1af0619', 'request_id': 'req-a01be94a-e694-4f97-934c-0203077bc8d2'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:38.397677 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-7395d7f6-8fb3-405e-bbb9-8d80d1db1e9f admin admin] The token cache is being invalidate because project c194a88157374a05bad0d626284de4f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:38.398280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-7395d7f6-8fb3-405e-bbb9-8d80d1db1e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:38.398898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-7395d7f6-8fb3-405e-bbb9-8d80d1db1e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:38.400972 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 943/1896] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:37 2022] DELETE /identity/v3/projects/c194a88157374a05bad0d626284de4f0 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:38.405178 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395d7f6-8fb3-405e-bbb9-8d80d1db1e9f admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:38.405987 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-7395d7f6-8fb3-405e-bbb9-8d80d1db1e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:38.480906 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395d7f6-8fb3-405e-bbb9-8d80d1db1e9f admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:38.498339 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a01be94a-e694-4f97-934c-0203077bc8d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64739dcfb06e4d4aaaeefe4be1af0619', 'request_id': 'req-a01be94a-e694-4f97-934c-0203077bc8d2'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:38.505637 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a01be94a-e694-4f97-934c-0203077bc8d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64739dcfb06e4d4aaaeefe4be1af0619', 'request_id': 'req-a01be94a-e694-4f97-934c-0203077bc8d2'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:38.522698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a01be94a-e694-4f97-934c-0203077bc8d2 admin admin] The token cache is being invalidate because project 64739dcfb06e4d4aaaeefe4be1af0619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:38.523235 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a01be94a-e694-4f97-934c-0203077bc8d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:38.524160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a01be94a-e694-4f97-934c-0203077bc8d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:38.526499 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 954/1897] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:38 2022] DELETE /identity/v3/projects/64739dcfb06e4d4aaaeefe4be1af0619 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:38.532104 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e07e80-90a5-45f4-8430-ec52376c853c None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:38.532876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e07e80-90a5-45f4-8430-ec52376c853c None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:38.534130 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e07e80-90a5-45f4-8430-ec52376c853c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:38.552858 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6949d6-74e1-4592-b8ca-a5fd9cd0a097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:38.555244 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6949d6-74e1-4592-b8ca-a5fd9cd0a097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:38.555244 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6949d6-74e1-4592-b8ca-a5fd9cd0a097 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:38.555244 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6949d6-74e1-4592-b8ca-a5fd9cd0a097 admin admin] PATH_INFO: `/v3/users/2ef4616a79ad42d69662a7d9c24dd042` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:38.561811 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6949d6-74e1-4592-b8ca-a5fd9cd0a097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ef4616a79ad42d69662a7d9c24dd042)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:38.564160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6949d6-74e1-4592-b8ca-a5fd9cd0a097 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:38.565492 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-08e07e80-90a5-45f4-8430-ec52376c853c None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:38.566972 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-08e07e80-90a5-45f4-8430-ec52376c853c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:38.586446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 955/1898] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:56:38.589327 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e439add-2053-4312-9fe8-25c2b1b7c5c7 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:38.590555 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e439add-2053-4312-9fe8-25c2b1b7c5c7 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:38.590834 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e439add-2053-4312-9fe8-25c2b1b7c5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:38.617377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-8e439add-2053-4312-9fe8-25c2b1b7c5c7 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:38.618470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-8e439add-2053-4312-9fe8-25c2b1b7c5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:38.627386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 956/1899] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:38.632003 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e439add-2053-4312-9fe8-25c2b1b7c5c7 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:38.641290 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e439add-2053-4312-9fe8-25c2b1b7c5c7 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:38.647238 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350336a-e3d8-4ac6-a78e-3fd926e9e0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:38.647877 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350336a-e3d8-4ac6-a78e-3fd926e9e0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:38.648177 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350336a-e3d8-4ac6-a78e-3fd926e9e0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:38.648449 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350336a-e3d8-4ac6-a78e-3fd926e9e0a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:38.649127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350336a-e3d8-4ac6-a78e-3fd926e9e0a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:56:38.649514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350336a-e3d8-4ac6-a78e-3fd926e9e0a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:38.651089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350336a-e3d8-4ac6-a78e-3fd926e9e0a2 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:38.663675 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 957/1900] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:56:38.668150 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350336a-e3d8-4ac6-a78e-3fd926e9e0a2 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:38.678324 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350336a-e3d8-4ac6-a78e-3fd926e9e0a2 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:38.683285 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16607b3-9165-4ee3-b033-9a31dc96743b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:38.683931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16607b3-9165-4ee3-b033-9a31dc96743b admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:38.684492 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16607b3-9165-4ee3-b033-9a31dc96743b admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:38.684775 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16607b3-9165-4ee3-b033-9a31dc96743b admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:38.685412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16607b3-9165-4ee3-b033-9a31dc96743b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:38.687595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16607b3-9165-4ee3-b033-9a31dc96743b admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:38.868539 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 958/1901] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:38 2022] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:38.873675 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16607b3-9165-4ee3-b033-9a31dc96743b admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:38.876113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-dc6949d6-74e1-4592-b8ca-a5fd9cd0a097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ef4616a79ad42d69662a7d9c24dd042'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:38.950271 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-dc6949d6-74e1-4592-b8ca-a5fd9cd0a097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ef4616a79ad42d69662a7d9c24dd042'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:38.950951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-dc6949d6-74e1-4592-b8ca-a5fd9cd0a097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ef4616a79ad42d69662a7d9c24dd042'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:38.957534 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16607b3-9165-4ee3-b033-9a31dc96743b admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:38.960429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-dc6949d6-74e1-4592-b8ca-a5fd9cd0a097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ef4616a79ad42d69662a7d9c24dd042'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:38.964969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a939a-3dbe-46fe-a3e3-4467b246deaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:38.965756 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a939a-3dbe-46fe-a3e3-4467b246deaa admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:38.966227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a939a-3dbe-46fe-a3e3-4467b246deaa admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:38.966648 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a939a-3dbe-46fe-a3e3-4467b246deaa admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:38.967657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a939a-3dbe-46fe-a3e3-4467b246deaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:38.969541 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a939a-3dbe-46fe-a3e3-4467b246deaa admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:38.979034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-dc6949d6-74e1-4592-b8ca-a5fd9cd0a097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ef4616a79ad42d69662a7d9c24dd042'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:38.985630 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 944/1902] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:38 2022] DELETE /identity/v3/users/2ef4616a79ad42d69662a7d9c24dd042 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:56:39.087077 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 959/1903] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:38 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:39.088584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6949d6-74e1-4592-b8ca-a5fd9cd0a097 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:39.090203 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-dc6949d6-74e1-4592-b8ca-a5fd9cd0a097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:39.154682 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a939a-3dbe-46fe-a3e3-4467b246deaa admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:39.156866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-b85a939a-3dbe-46fe-a3e3-4467b246deaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:39.185779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6949d6-74e1-4592-b8ca-a5fd9cd0a097 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:39.234944 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea884cb5-4fe1-49a9-b633-14334a2e2aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:39.234944 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea884cb5-4fe1-49a9-b633-14334a2e2aee admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:39.234944 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea884cb5-4fe1-49a9-b633-14334a2e2aee admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:39.234944 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea884cb5-4fe1-49a9-b633-14334a2e2aee admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:39.235468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea884cb5-4fe1-49a9-b633-14334a2e2aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:39.235468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea884cb5-4fe1-49a9-b633-14334a2e2aee admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:39.249668 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 945/1904] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:39.255482 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea884cb5-4fe1-49a9-b633-14334a2e2aee admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:39.292318 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a939a-3dbe-46fe-a3e3-4467b246deaa admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:39.293231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea884cb5-4fe1-49a9-b633-14334a2e2aee admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:39.296657 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fce6e-03ca-491b-8d5b-9adf3d9935c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:39.297945 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fce6e-03ca-491b-8d5b-9adf3d9935c8 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:39.298229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fce6e-03ca-491b-8d5b-9adf3d9935c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:39.298503 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fce6e-03ca-491b-8d5b-9adf3d9935c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:39.300211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301fce6e-03ca-491b-8d5b-9adf3d9935c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:39.307105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301fce6e-03ca-491b-8d5b-9adf3d9935c8 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:39.330313 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 946/1905] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:39.335949 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fce6e-03ca-491b-8d5b-9adf3d9935c8 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:39.357634 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fce6e-03ca-491b-8d5b-9adf3d9935c8 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:39.374383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b04455-d68f-4c7d-970f-16011abf957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:39.376827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b04455-d68f-4c7d-970f-16011abf957d admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:39.377293 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b04455-d68f-4c7d-970f-16011abf957d admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:39.377713 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b04455-d68f-4c7d-970f-16011abf957d admin admin] PATH_INFO: `/v3/projects/97fae6b07feb45d6939fc744cf62b1a7/users/f8e3b168829e4dfeac03ccd8192f7bfe/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:39.416019 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316bbf8-c51f-4ffb-a033-a240a81efc7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:39.416726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316bbf8-c51f-4ffb-a033-a240a81efc7d service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:39.417006 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316bbf8-c51f-4ffb-a033-a240a81efc7d service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:39.417282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316bbf8-c51f-4ffb-a033-a240a81efc7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:39.420269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b04455-d68f-4c7d-970f-16011abf957d admin admin] RBAC: Authorizing `identity:create_grant(project_id=97fae6b07feb45d6939fc744cf62b1a7, user_id=f8e3b168829e4dfeac03ccd8192f7bfe, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:39.423592 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-5316bbf8-c51f-4ffb-a033-a240a81efc7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:39.425160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b04455-d68f-4c7d-970f-16011abf957d admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:39.509254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 947/1906] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:39 2022] PUT /identity/v3/projects/97fae6b07feb45d6939fc744cf62b1a7/users/f8e3b168829e4dfeac03ccd8192f7bfe/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:39.514154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9dabf-c681-4df2-b631-81d17746df52 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:39.515076 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9dabf-c681-4df2-b631-81d17746df52 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:39.515954 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9dabf-c681-4df2-b631-81d17746df52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:39.529100 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316bbf8-c51f-4ffb-a033-a240a81efc7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:39.531179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316bbf8-c51f-4ffb-a033-a240a81efc7d service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:39.543219 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-97c9dabf-c681-4df2-b631-81d17746df52 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:39.544785 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-97c9dabf-c681-4df2-b631-81d17746df52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:39.554685 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 960/1907] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:39.599364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316bbf8-c51f-4ffb-a033-a240a81efc7d service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:39.601148 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-5316bbf8-c51f-4ffb-a033-a240a81efc7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:39.628191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316bbf8-c51f-4ffb-a033-a240a81efc7d service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:39.679604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 948/1908] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:39.693296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9dabf-c681-4df2-b631-81d17746df52 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:39.697022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-97c9dabf-c681-4df2-b631-81d17746df52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:39.765164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:39.777562 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca6469-d015-4561-9b84-53d80ac4c568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:39.778714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca6469-d015-4561-9b84-53d80ac4c568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:39.779049 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca6469-d015-4561-9b84-53d80ac4c568 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:39.779334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca6469-d015-4561-9b84-53d80ac4c568 admin admin] PATH_INFO: `/v3/projects/adf7b604ef874cacb1eb4a2183de1610` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:39.780922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca6469-d015-4561-9b84-53d80ac4c568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adf7b604ef874cacb1eb4a2183de1610)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:39.782930 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca6469-d015-4561-9b84-53d80ac4c568 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:39.790530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9dabf-c681-4df2-b631-81d17746df52 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:39.796417 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bbc5c-089b-4c0d-9db7-5c42ddf86993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:39.797087 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bbc5c-089b-4c0d-9db7-5c42ddf86993 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:39.797441 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bbc5c-089b-4c0d-9db7-5c42ddf86993 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:39.797719 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bbc5c-089b-4c0d-9db7-5c42ddf86993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:39.808714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bbc5c-089b-4c0d-9db7-5c42ddf86993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:39.810183 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bbc5c-089b-4c0d-9db7-5c42ddf86993 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:39.820903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 949/1909] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:56:39.980174 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e4ca6469-d015-4561-9b84-53d80ac4c568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adf7b604ef874cacb1eb4a2183de1610', 'request_id': 'req-e4ca6469-d015-4561-9b84-53d80ac4c568'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:40.104766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e4ca6469-d015-4561-9b84-53d80ac4c568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adf7b604ef874cacb1eb4a2183de1610', 'request_id': 'req-e4ca6469-d015-4561-9b84-53d80ac4c568'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:40.114529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e4ca6469-d015-4561-9b84-53d80ac4c568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adf7b604ef874cacb1eb4a2183de1610', 'request_id': 'req-e4ca6469-d015-4561-9b84-53d80ac4c568'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:40.137997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e4ca6469-d015-4561-9b84-53d80ac4c568 admin admin] The token cache is being invalidate because project adf7b604ef874cacb1eb4a2183de1610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:40.138504 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e4ca6469-d015-4561-9b84-53d80ac4c568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:40.143121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e4ca6469-d015-4561-9b84-53d80ac4c568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:40.146254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 961/1910] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:39 2022] DELETE /identity/v3/projects/adf7b604ef874cacb1eb4a2183de1610 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:40.161053 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc941d0-e0f3-40d4-9702-795a69fcf7f5 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:40.161053 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc941d0-e0f3-40d4-9702-795a69fcf7f5 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:40.161053 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc941d0-e0f3-40d4-9702-795a69fcf7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:40.202765 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-8bc941d0-e0f3-40d4-9702-795a69fcf7f5 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:40.205723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-8bc941d0-e0f3-40d4-9702-795a69fcf7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:40.373667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 950/1911] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:40.382516 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98b9a9-9cba-40ea-9ee4-9603aad673ee None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:40.383070 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98b9a9-9cba-40ea-9ee4-9603aad673ee None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:40.383670 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98b9a9-9cba-40ea-9ee4-9603aad673ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:40.388942 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:40.427592 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-ad98b9a9-9cba-40ea-9ee4-9603aad673ee None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:40.430298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ad98b9a9-9cba-40ea-9ee4-9603aad673ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:40.453806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 962/1912] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:40.458808 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc941d0-e0f3-40d4-9702-795a69fcf7f5 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:40.473913 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc941d0-e0f3-40d4-9702-795a69fcf7f5 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:40.485734 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716daa3-33ee-4ec9-9265-211978e62eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:40.488007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716daa3-33ee-4ec9-9265-211978e62eaa admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:40.489713 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716daa3-33ee-4ec9-9265-211978e62eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:40.490333 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716daa3-33ee-4ec9-9265-211978e62eaa admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:40.491410 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716daa3-33ee-4ec9-9265-211978e62eaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:56:40.492255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716daa3-33ee-4ec9-9265-211978e62eaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:40.496603 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716daa3-33ee-4ec9-9265-211978e62eaa admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:40.516128 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 951/1913] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:56:40.521026 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98b9a9-9cba-40ea-9ee4-9603aad673ee None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:40.545654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98b9a9-9cba-40ea-9ee4-9603aad673ee None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:40.556289 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2af5f-6cf2-444a-ac16-0da7f7b1faa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:40.557104 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2af5f-6cf2-444a-ac16-0da7f7b1faa5 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:40.558438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2af5f-6cf2-444a-ac16-0da7f7b1faa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:40.560415 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2af5f-6cf2-444a-ac16-0da7f7b1faa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:40.561388 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2af5f-6cf2-444a-ac16-0da7f7b1faa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:40.565370 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2af5f-6cf2-444a-ac16-0da7f7b1faa5 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:40.727900 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 963/1914] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:40 2022] POST /identity/v3/projects => generated 387 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:40.732961 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716daa3-33ee-4ec9-9265-211978e62eaa admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:40.750972 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716daa3-33ee-4ec9-9265-211978e62eaa admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:40.831484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933eb56b-9340-423b-b22b-2c0edfbad1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:40.833474 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933eb56b-9340-423b-b22b-2c0edfbad1d0 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:40.833991 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933eb56b-9340-423b-b22b-2c0edfbad1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:40.834404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933eb56b-9340-423b-b22b-2c0edfbad1d0 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:40.835237 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933eb56b-9340-423b-b22b-2c0edfbad1d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:40.837532 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933eb56b-9340-423b-b22b-2c0edfbad1d0 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:41.027251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 952/1915] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:40 2022] POST /identity/v3/users => generated 294 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:41.031490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2af5f-6cf2-444a-ac16-0da7f7b1faa5 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:41.044182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2af5f-6cf2-444a-ac16-0da7f7b1faa5 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:41.049879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47018c60-a17d-4a49-acad-68262ea116ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:41.050634 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47018c60-a17d-4a49-acad-68262ea116ae admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:41.051516 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47018c60-a17d-4a49-acad-68262ea116ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:41.052329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47018c60-a17d-4a49-acad-68262ea116ae admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:41.052793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47018c60-a17d-4a49-acad-68262ea116ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:41.054499 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47018c60-a17d-4a49-acad-68262ea116ae admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:41.069818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 964/1916] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:41.073281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933eb56b-9340-423b-b22b-2c0edfbad1d0 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:41.086895 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933eb56b-9340-423b-b22b-2c0edfbad1d0 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:41.092849 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dc2bf-3210-498b-9e83-32151de67b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:41.093593 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dc2bf-3210-498b-9e83-32151de67b97 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:41.093980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dc2bf-3210-498b-9e83-32151de67b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:41.094341 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dc2bf-3210-498b-9e83-32151de67b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:41.095083 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dc2bf-3210-498b-9e83-32151de67b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:41.098820 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dc2bf-3210-498b-9e83-32151de67b97 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:41.112076 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 953/1917] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:41.116943 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47018c60-a17d-4a49-acad-68262ea116ae admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:41.128529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47018c60-a17d-4a49-acad-68262ea116ae admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:41.134699 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6f8b0-4720-4577-812c-8bb6977e428a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:41.135504 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6f8b0-4720-4577-812c-8bb6977e428a admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:41.135843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6f8b0-4720-4577-812c-8bb6977e428a admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:41.136124 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6f8b0-4720-4577-812c-8bb6977e428a admin admin] PATH_INFO: `/v3/projects/2c93d7956e654997b39ed33ecd1c60ea/users/51cc5c280aee4544bedcfeb9f33dacf6/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:41.158889 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6f8b0-4720-4577-812c-8bb6977e428a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c93d7956e654997b39ed33ecd1c60ea, user_id=51cc5c280aee4544bedcfeb9f33dacf6, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:41.164045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6f8b0-4720-4577-812c-8bb6977e428a admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:41.423899 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 965/1918] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:41 2022] PUT /identity/v3/projects/2c93d7956e654997b39ed33ecd1c60ea/users/51cc5c280aee4544bedcfeb9f33dacf6/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:56:41.435112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0200844-ddd4-4d85-bd1c-5ec498254c27 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:41.435787 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0200844-ddd4-4d85-bd1c-5ec498254c27 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:41.436057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0200844-ddd4-4d85-bd1c-5ec498254c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:41.483457 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-e0200844-ddd4-4d85-bd1c-5ec498254c27 None None] MFA Rules not processed for user `51cc5c280aee4544bedcfeb9f33dacf6`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:41.484914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e0200844-ddd4-4d85-bd1c-5ec498254c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:41.590123 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 954/1919] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:41.594673 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6f8b0-4720-4577-812c-8bb6977e428a admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:41.686887 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6f8b0-4720-4577-812c-8bb6977e428a admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:41.695341 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a0128-c113-4638-bd80-b4b40d69297c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:41.696479 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a0128-c113-4638-bd80-b4b40d69297c admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:41.697031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a0128-c113-4638-bd80-b4b40d69297c admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:41.697665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a0128-c113-4638-bd80-b4b40d69297c admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:41.698457 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a0128-c113-4638-bd80-b4b40d69297c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:41.700965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a0128-c113-4638-bd80-b4b40d69297c admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:41.874446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 966/1920] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:41 2022] POST /identity/v3/projects => generated 387 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:56:41.875614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0200844-ddd4-4d85-bd1c-5ec498254c27 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:41.889497 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0200844-ddd4-4d85-bd1c-5ec498254c27 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:41.995503 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26141a2-8d74-4e0a-9bc7-3d260abd1b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:41.996168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26141a2-8d74-4e0a-9bc7-3d260abd1b68 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:41.996454 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26141a2-8d74-4e0a-9bc7-3d260abd1b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:41.998709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26141a2-8d74-4e0a-9bc7-3d260abd1b68 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:41.998709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26141a2-8d74-4e0a-9bc7-3d260abd1b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:41.999632 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26141a2-8d74-4e0a-9bc7-3d260abd1b68 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:42.160075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 955/1921] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:41 2022] POST /identity/v3/users => generated 300 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:56:42.162447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a0128-c113-4638-bd80-b4b40d69297c admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:42.176782 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a0128-c113-4638-bd80-b4b40d69297c admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:42.182245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d3507-0f03-44bb-95ea-24d4c5b4df6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:42.182959 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d3507-0f03-44bb-95ea-24d4c5b4df6d admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:42.183331 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d3507-0f03-44bb-95ea-24d4c5b4df6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:42.184006 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d3507-0f03-44bb-95ea-24d4c5b4df6d admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:42.184795 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d3507-0f03-44bb-95ea-24d4c5b4df6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:42.186712 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d3507-0f03-44bb-95ea-24d4c5b4df6d admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:42.208980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 967/1922] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:42.210083 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26141a2-8d74-4e0a-9bc7-3d260abd1b68 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:42.225122 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26141a2-8d74-4e0a-9bc7-3d260abd1b68 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:42.240215 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20d425-92b3-4fb6-bb7d-07a3f259ff76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:42.254793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5400-0f99-4cfd-a90b-3e1d8004a1b4 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:42.255105 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5400-0f99-4cfd-a90b-3e1d8004a1b4 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:42.255380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5400-0f99-4cfd-a90b-3e1d8004a1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:42.281894 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20d425-92b3-4fb6-bb7d-07a3f259ff76 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:42.281894 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20d425-92b3-4fb6-bb7d-07a3f259ff76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:42.281894 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20d425-92b3-4fb6-bb7d-07a3f259ff76 admin admin] PATH_INFO: `/v3/projects/ddff917ae4dc43738f6762167399399f/users/fd50016c390f4ceda4c3e88eca78fe49/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:42.298933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-763d5400-0f99-4cfd-a90b-3e1d8004a1b4 None None] MFA Rules not processed for user `f8e3b168829e4dfeac03ccd8192f7bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:42.302119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-763d5400-0f99-4cfd-a90b-3e1d8004a1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:42.309258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20d425-92b3-4fb6-bb7d-07a3f259ff76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddff917ae4dc43738f6762167399399f, user_id=fd50016c390f4ceda4c3e88eca78fe49, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:42.312894 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20d425-92b3-4fb6-bb7d-07a3f259ff76 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:42.444408 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 968/1923] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:56:42.448765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d5400-0f99-4cfd-a90b-3e1d8004a1b4 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:42.450640 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-763d5400-0f99-4cfd-a90b-3e1d8004a1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:42.474241 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 956/1924] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:42 2022] PUT /identity/v3/projects/ddff917ae4dc43738f6762167399399f/users/fd50016c390f4ceda4c3e88eca78fe49/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:42.475614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20d425-92b3-4fb6-bb7d-07a3f259ff76 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:42.480955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d5400-0f99-4cfd-a90b-3e1d8004a1b4 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:42.564153 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530364cf-5b27-4a33-89c0-8493c6ed0e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:42.565355 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530364cf-5b27-4a33-89c0-8493c6ed0e97 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:42.566262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530364cf-5b27-4a33-89c0-8493c6ed0e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:42.566262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530364cf-5b27-4a33-89c0-8493c6ed0e97 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:42.567440 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530364cf-5b27-4a33-89c0-8493c6ed0e97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:42.568449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20d425-92b3-4fb6-bb7d-07a3f259ff76 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:42.570334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530364cf-5b27-4a33-89c0-8493c6ed0e97 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:42.575248 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e53d87-dddb-428e-8166-6b70e9d95ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:42.576007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e53d87-dddb-428e-8166-6b70e9d95ecf admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:42.576367 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e53d87-dddb-428e-8166-6b70e9d95ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:42.576755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e53d87-dddb-428e-8166-6b70e9d95ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:42.577451 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e53d87-dddb-428e-8166-6b70e9d95ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:42.579106 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e53d87-dddb-428e-8166-6b70e9d95ecf admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:42.598233 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 957/1925] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:56:42.598945 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e53d87-dddb-428e-8166-6b70e9d95ecf admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:42.609965 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e53d87-dddb-428e-8166-6b70e9d95ecf admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:42.617542 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a9357-4606-47a9-8bc5-fcb3777452df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:42.617542 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a9357-4606-47a9-8bc5-fcb3777452df admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:42.617542 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a9357-4606-47a9-8bc5-fcb3777452df admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:42.617542 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a9357-4606-47a9-8bc5-fcb3777452df admin admin] PATH_INFO: `/v3/projects/ddff917ae4dc43738f6762167399399f/users/fd50016c390f4ceda4c3e88eca78fe49/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:42.619421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a9357-4606-47a9-8bc5-fcb3777452df admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddff917ae4dc43738f6762167399399f, user_id=fd50016c390f4ceda4c3e88eca78fe49, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:42.622134 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a9357-4606-47a9-8bc5-fcb3777452df admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:42.646633 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 958/1926] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:42 2022] PUT /identity/v3/projects/ddff917ae4dc43738f6762167399399f/users/fd50016c390f4ceda4c3e88eca78fe49/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:56:42.649971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c82bad-5e4d-4281-8a95-ad88c20f30a4 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:42.650511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c82bad-5e4d-4281-8a95-ad88c20f30a4 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:42.650855 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c82bad-5e4d-4281-8a95-ad88c20f30a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:42.675015 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 969/1927] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:42 2022] POST /identity/v3/projects => generated 371 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:42.679873 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530364cf-5b27-4a33-89c0-8493c6ed0e97 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:42.693431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-c9c82bad-5e4d-4281-8a95-ad88c20f30a4 None None] MFA Rules not processed for user `fd50016c390f4ceda4c3e88eca78fe49`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:42.694996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-c9c82bad-5e4d-4281-8a95-ad88c20f30a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:42.788812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530364cf-5b27-4a33-89c0-8493c6ed0e97 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:42.788943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 959/1928] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:42.794644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f40b3d-9b3e-4b7c-9e79-3034c9a1d476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:42.794644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f40b3d-9b3e-4b7c-9e79-3034c9a1d476 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:42.794644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f40b3d-9b3e-4b7c-9e79-3034c9a1d476 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:42.794644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f40b3d-9b3e-4b7c-9e79-3034c9a1d476 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:42.795025 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f40b3d-9b3e-4b7c-9e79-3034c9a1d476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:42.796213 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c82bad-5e4d-4281-8a95-ad88c20f30a4 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:42.797059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f40b3d-9b3e-4b7c-9e79-3034c9a1d476 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:42.798074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-c9c82bad-5e4d-4281-8a95-ad88c20f30a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:42.821785 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c82bad-5e4d-4281-8a95-ad88c20f30a4 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:42.827186 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a718f7-f763-4420-a81c-e81454f9c0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:42.827967 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a718f7-f763-4420-a81c-e81454f9c0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:42.828319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a718f7-f763-4420-a81c-e81454f9c0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:42.828664 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a718f7-f763-4420-a81c-e81454f9c0b5 admin admin] PATH_INFO: `/v3/users/9b6f30e6024d47d6a14bdd1c3b9728e7` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:42.829939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a718f7-f763-4420-a81c-e81454f9c0b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6f30e6024d47d6a14bdd1c3b9728e7)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:42.831954 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a718f7-f763-4420-a81c-e81454f9c0b5 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:42.905198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 970/1929] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:42 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:56:42.905198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f40b3d-9b3e-4b7c-9e79-3034c9a1d476 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:42.905198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-09f40b3d-9b3e-4b7c-9e79-3034c9a1d476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:42.979463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f40b3d-9b3e-4b7c-9e79-3034c9a1d476 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:42.983424 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33e59c-4f03-4276-98e8-6601a6726698 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:42.984222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33e59c-4f03-4276-98e8-6601a6726698 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:42.984611 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33e59c-4f03-4276-98e8-6601a6726698 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:42.984980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33e59c-4f03-4276-98e8-6601a6726698 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:42.994544 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33e59c-4f03-4276-98e8-6601a6726698 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:42.996020 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33e59c-4f03-4276-98e8-6601a6726698 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:43.007992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 971/1930] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:43.008742 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33e59c-4f03-4276-98e8-6601a6726698 service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:43.016848 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-84a718f7-f763-4420-a81c-e81454f9c0b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6f30e6024d47d6a14bdd1c3b9728e7'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:43.027402 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33e59c-4f03-4276-98e8-6601a6726698 service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:43.034080 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe71ef-7e27-4cf7-95c1-99844bf83b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:43.034715 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe71ef-7e27-4cf7-95c1-99844bf83b96 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:43.035636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe71ef-7e27-4cf7-95c1-99844bf83b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:43.035927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe71ef-7e27-4cf7-95c1-99844bf83b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:43.036558 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe71ef-7e27-4cf7-95c1-99844bf83b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:43.038934 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe71ef-7e27-4cf7-95c1-99844bf83b96 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:43.058170 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 972/1931] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:43.058916 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe71ef-7e27-4cf7-95c1-99844bf83b96 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:43.072247 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe71ef-7e27-4cf7-95c1-99844bf83b96 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:43.077102 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902683f2-9718-413b-b67f-f2b714fec549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:43.077723 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902683f2-9718-413b-b67f-f2b714fec549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:43.078009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902683f2-9718-413b-b67f-f2b714fec549 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:43.078335 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902683f2-9718-413b-b67f-f2b714fec549 admin admin] PATH_INFO: `/v3/users/51cc5c280aee4544bedcfeb9f33dacf6` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:43.079458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902683f2-9718-413b-b67f-f2b714fec549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51cc5c280aee4544bedcfeb9f33dacf6)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:43.081393 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902683f2-9718-413b-b67f-f2b714fec549 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:43.121454 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-84a718f7-f763-4420-a81c-e81454f9c0b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6f30e6024d47d6a14bdd1c3b9728e7'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:43.122139 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-84a718f7-f763-4420-a81c-e81454f9c0b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6f30e6024d47d6a14bdd1c3b9728e7'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:43.130402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-84a718f7-f763-4420-a81c-e81454f9c0b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6f30e6024d47d6a14bdd1c3b9728e7'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:43.142318 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-84a718f7-f763-4420-a81c-e81454f9c0b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6f30e6024d47d6a14bdd1c3b9728e7'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:43.149119 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 960/1932] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:42 2022] DELETE /identity/v3/users/9b6f30e6024d47d6a14bdd1c3b9728e7 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:43.150073 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a718f7-f763-4420-a81c-e81454f9c0b5 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:43.151483 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-84a718f7-f763-4420-a81c-e81454f9c0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:43.214503 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a718f7-f763-4420-a81c-e81454f9c0b5 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:43.219464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96cbb6-11aa-4d48-92fc-4caa21879e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:43.220162 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96cbb6-11aa-4d48-92fc-4caa21879e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:43.220438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96cbb6-11aa-4d48-92fc-4caa21879e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:43.220709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96cbb6-11aa-4d48-92fc-4caa21879e8d admin admin] PATH_INFO: `/v3/projects/f1526849340d46fa9fc565f99fe61256/users/3c2a19c731664548bb638381f3b5dc34/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:43.240110 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96cbb6-11aa-4d48-92fc-4caa21879e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1526849340d46fa9fc565f99fe61256, user_id=3c2a19c731664548bb638381f3b5dc34, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:43.245043 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96cbb6-11aa-4d48-92fc-4caa21879e8d admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:43.440855 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 961/1933] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:43 2022] PUT /identity/v3/projects/f1526849340d46fa9fc565f99fe61256/users/3c2a19c731664548bb638381f3b5dc34/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:43.444146 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c4618-f449-475a-a5c3-17718575bf57 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:43.444420 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c4618-f449-475a-a5c3-17718575bf57 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:43.444698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c4618-f449-475a-a5c3-17718575bf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:43.456650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-902683f2-9718-413b-b67f-f2b714fec549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51cc5c280aee4544bedcfeb9f33dacf6'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:43.487637 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-b95c4618-f449-475a-a5c3-17718575bf57 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:43.490331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b95c4618-f449-475a-a5c3-17718575bf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:43.561085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 962/1934] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:43.561948 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c4618-f449-475a-a5c3-17718575bf57 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:43.565350 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-902683f2-9718-413b-b67f-f2b714fec549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51cc5c280aee4544bedcfeb9f33dacf6'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:43.567606 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-902683f2-9718-413b-b67f-f2b714fec549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51cc5c280aee4544bedcfeb9f33dacf6'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:43.575343 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c4618-f449-475a-a5c3-17718575bf57 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:43.580837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217dc70e-dc68-4eec-9eb0-b1462093fdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:43.581480 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dc70e-dc68-4eec-9eb0-b1462093fdf1 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:43.582235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dc70e-dc68-4eec-9eb0-b1462093fdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:43.582520 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dc70e-dc68-4eec-9eb0-b1462093fdf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:43.583207 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217dc70e-dc68-4eec-9eb0-b1462093fdf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:43.584963 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217dc70e-dc68-4eec-9eb0-b1462093fdf1 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:43.585647 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-902683f2-9718-413b-b67f-f2b714fec549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51cc5c280aee4544bedcfeb9f33dacf6'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:43.593456 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-902683f2-9718-413b-b67f-f2b714fec549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51cc5c280aee4544bedcfeb9f33dacf6'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:43.596176 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 963/1935] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:43.597011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217dc70e-dc68-4eec-9eb0-b1462093fdf1 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:43.600215 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-217dc70e-dc68-4eec-9eb0-b1462093fdf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:43.605889 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 973/1936] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:43 2022] DELETE /identity/v3/users/51cc5c280aee4544bedcfeb9f33dacf6 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:43.607059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902683f2-9718-413b-b67f-f2b714fec549 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:43.611986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-902683f2-9718-413b-b67f-f2b714fec549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:43.664846 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217dc70e-dc68-4eec-9eb0-b1462093fdf1 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:43.685741 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902683f2-9718-413b-b67f-f2b714fec549 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:43.695349 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfa3e2-768d-4e50-ae67-d0603e172eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:43.696074 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfa3e2-768d-4e50-ae67-d0603e172eee admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:43.696352 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfa3e2-768d-4e50-ae67-d0603e172eee admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:43.696628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfa3e2-768d-4e50-ae67-d0603e172eee admin admin] PATH_INFO: `/v3/projects/f1526849340d46fa9fc565f99fe61256/users/3c2a19c731664548bb638381f3b5dc34/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:43.698640 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cfa3e2-768d-4e50-ae67-d0603e172eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1526849340d46fa9fc565f99fe61256, user_id=3c2a19c731664548bb638381f3b5dc34, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:43.701349 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cfa3e2-768d-4e50-ae67-d0603e172eee admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:43.712169 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 974/1937] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:43 2022] PUT /identity/v3/projects/f1526849340d46fa9fc565f99fe61256/users/3c2a19c731664548bb638381f3b5dc34/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:43.713755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90a588-f8b7-4b90-8633-b1268ff47ce4 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:43.713865 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90a588-f8b7-4b90-8633-b1268ff47ce4 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:43.714138 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90a588-f8b7-4b90-8633-b1268ff47ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:43.718529 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a9b12-080b-445d-9d63-a33a25c99c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:43.719146 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a9b12-080b-445d-9d63-a33a25c99c8d service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:43.719419 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a9b12-080b-445d-9d63-a33a25c99c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:43.719718 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a9b12-080b-445d-9d63-a33a25c99c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:43.721718 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-417a9b12-080b-445d-9d63-a33a25c99c8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:43.730272 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:43.734956 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a9b12-080b-445d-9d63-a33a25c99c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:43.736968 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a9b12-080b-445d-9d63-a33a25c99c8d service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:43.744782 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-9a90a588-f8b7-4b90-8633-b1268ff47ce4 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:43.746010 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-9a90a588-f8b7-4b90-8633-b1268ff47ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:43.747520 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 964/1938] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:43.810164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 975/1939] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:43.822065 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a9b12-080b-445d-9d63-a33a25c99c8d service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:43.830811 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a9b12-080b-445d-9d63-a33a25c99c8d service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:43.883953 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04227c0-cad7-428e-8d9a-d7b79d379eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:43.884574 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04227c0-cad7-428e-8d9a-d7b79d379eeb service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:43.884854 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04227c0-cad7-428e-8d9a-d7b79d379eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:43.885129 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04227c0-cad7-428e-8d9a-d7b79d379eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:43.899858 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04227c0-cad7-428e-8d9a-d7b79d379eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:43.899858 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04227c0-cad7-428e-8d9a-d7b79d379eeb service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:43.905954 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 965/1940] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:44.025489 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:44.335207 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90a588-f8b7-4b90-8633-b1268ff47ce4 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:44.336861 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-9a90a588-f8b7-4b90-8633-b1268ff47ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:44.350997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90a588-f8b7-4b90-8633-b1268ff47ce4 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:44.356813 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd2ce2-e1ec-4455-be88-37f5f7d5659e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:44.357604 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd2ce2-e1ec-4455-be88-37f5f7d5659e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:44.358164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd2ce2-e1ec-4455-be88-37f5f7d5659e admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:44.358509 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd2ce2-e1ec-4455-be88-37f5f7d5659e admin admin] PATH_INFO: `/v3/projects/4a721302e2c64801bc4c09a67fc93aae` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:44.359749 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd2ce2-e1ec-4455-be88-37f5f7d5659e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a721302e2c64801bc4c09a67fc93aae)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:44.361803 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd2ce2-e1ec-4455-be88-37f5f7d5659e admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:44.516837 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d0cd2ce2-e1ec-4455-be88-37f5f7d5659e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a721302e2c64801bc4c09a67fc93aae', 'request_id': 'req-d0cd2ce2-e1ec-4455-be88-37f5f7d5659e'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:44.546109 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04227c0-cad7-428e-8d9a-d7b79d379eeb service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:44.547729 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-a04227c0-cad7-428e-8d9a-d7b79d379eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:44.561692 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04227c0-cad7-428e-8d9a-d7b79d379eeb service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:44.650264 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc936c-814f-4be3-bb4e-89aaef5077b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:44.651012 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc936c-814f-4be3-bb4e-89aaef5077b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:44.652836 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc936c-814f-4be3-bb4e-89aaef5077b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:44.653363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc936c-814f-4be3-bb4e-89aaef5077b4 admin admin] PATH_INFO: `/v3/projects/2c93d7956e654997b39ed33ecd1c60ea` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:44.654594 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc936c-814f-4be3-bb4e-89aaef5077b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c93d7956e654997b39ed33ecd1c60ea)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:44.656555 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc936c-814f-4be3-bb4e-89aaef5077b4 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:44.681237 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d0cd2ce2-e1ec-4455-be88-37f5f7d5659e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a721302e2c64801bc4c09a67fc93aae', 'request_id': 'req-d0cd2ce2-e1ec-4455-be88-37f5f7d5659e'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:44.688758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d0cd2ce2-e1ec-4455-be88-37f5f7d5659e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a721302e2c64801bc4c09a67fc93aae', 'request_id': 'req-d0cd2ce2-e1ec-4455-be88-37f5f7d5659e'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:44.705493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d0cd2ce2-e1ec-4455-be88-37f5f7d5659e admin admin] The token cache is being invalidate because project 4a721302e2c64801bc4c09a67fc93aae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:44.705784 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d0cd2ce2-e1ec-4455-be88-37f5f7d5659e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:44.706715 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d0cd2ce2-e1ec-4455-be88-37f5f7d5659e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:44.709419 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 976/1941] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:44 2022] DELETE /identity/v3/projects/4a721302e2c64801bc4c09a67fc93aae => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:44.717441 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd2ce2-e1ec-4455-be88-37f5f7d5659e admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:44.719164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-d0cd2ce2-e1ec-4455-be88-37f5f7d5659e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:44.733260 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd2ce2-e1ec-4455-be88-37f5f7d5659e admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:44.738798 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b030c-74c6-436c-9c8e-3a24432fc089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:44.739743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b030c-74c6-436c-9c8e-3a24432fc089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:44.740031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b030c-74c6-436c-9c8e-3a24432fc089 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:44.740361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b030c-74c6-436c-9c8e-3a24432fc089 admin admin] PATH_INFO: `/v3/users/8c1d46e1ed924925bb965aa43c20c650` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:44.741530 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b030c-74c6-436c-9c8e-3a24432fc089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c1d46e1ed924925bb965aa43c20c650)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:44.743782 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b030c-74c6-436c-9c8e-3a24432fc089 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:44.785002 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d2dc936c-814f-4be3-bb4e-89aaef5077b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c93d7956e654997b39ed33ecd1c60ea', 'request_id': 'req-d2dc936c-814f-4be3-bb4e-89aaef5077b4'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:44.853921 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d2dc936c-814f-4be3-bb4e-89aaef5077b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c93d7956e654997b39ed33ecd1c60ea', 'request_id': 'req-d2dc936c-814f-4be3-bb4e-89aaef5077b4'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:44.865866 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d2dc936c-814f-4be3-bb4e-89aaef5077b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c93d7956e654997b39ed33ecd1c60ea', 'request_id': 'req-d2dc936c-814f-4be3-bb4e-89aaef5077b4'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:44.879717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d2dc936c-814f-4be3-bb4e-89aaef5077b4 admin admin] The token cache is being invalidate because project 2c93d7956e654997b39ed33ecd1c60ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:44.880509 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d2dc936c-814f-4be3-bb4e-89aaef5077b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:44.881192 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d2dc936c-814f-4be3-bb4e-89aaef5077b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:44.882742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 966/1942] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:44 2022] DELETE /identity/v3/projects/2c93d7956e654997b39ed33ecd1c60ea => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:44.886677 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc936c-814f-4be3-bb4e-89aaef5077b4 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:44.888047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d2dc936c-814f-4be3-bb4e-89aaef5077b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:44.956287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc936c-814f-4be3-bb4e-89aaef5077b4 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:44.961600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38964e50-db15-4801-b913-0e8c8b7b2868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:44.962244 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38964e50-db15-4801-b913-0e8c8b7b2868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:44.962522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38964e50-db15-4801-b913-0e8c8b7b2868 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:44.962795 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38964e50-db15-4801-b913-0e8c8b7b2868 admin admin] PATH_INFO: `/v3/users/fd50016c390f4ceda4c3e88eca78fe49` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:44.963985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38964e50-db15-4801-b913-0e8c8b7b2868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd50016c390f4ceda4c3e88eca78fe49)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:44.966024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38964e50-db15-4801-b913-0e8c8b7b2868 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:44.970593 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-409b030c-74c6-436c-9c8e-3a24432fc089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c1d46e1ed924925bb965aa43c20c650'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:45.042871 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-409b030c-74c6-436c-9c8e-3a24432fc089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c1d46e1ed924925bb965aa43c20c650'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:45.043597 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-409b030c-74c6-436c-9c8e-3a24432fc089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c1d46e1ed924925bb965aa43c20c650'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:45.058400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-409b030c-74c6-436c-9c8e-3a24432fc089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c1d46e1ed924925bb965aa43c20c650'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:45.067463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-409b030c-74c6-436c-9c8e-3a24432fc089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c1d46e1ed924925bb965aa43c20c650'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:45.077392 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 977/1943] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:44 2022] DELETE /identity/v3/users/8c1d46e1ed924925bb965aa43c20c650 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:45.179060 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b030c-74c6-436c-9c8e-3a24432fc089 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:45.181894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-409b030c-74c6-436c-9c8e-3a24432fc089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:45.260465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b030c-74c6-436c-9c8e-3a24432fc089 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:45.265362 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f307095-9495-4ad6-93a4-46b53323369b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:45.268142 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f307095-9495-4ad6-93a4-46b53323369b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:45.268142 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f307095-9495-4ad6-93a4-46b53323369b admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:45.268142 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f307095-9495-4ad6-93a4-46b53323369b admin admin] PATH_INFO: `/v3/users/0cd276119102459abb595ad040b6c164` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:45.268142 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f307095-9495-4ad6-93a4-46b53323369b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cd276119102459abb595ad040b6c164)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:45.270242 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f307095-9495-4ad6-93a4-46b53323369b admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:45.314271 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-38964e50-db15-4801-b913-0e8c8b7b2868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd50016c390f4ceda4c3e88eca78fe49'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:45.460101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-38964e50-db15-4801-b913-0e8c8b7b2868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd50016c390f4ceda4c3e88eca78fe49'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:45.460756 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-38964e50-db15-4801-b913-0e8c8b7b2868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd50016c390f4ceda4c3e88eca78fe49'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:45.468521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-38964e50-db15-4801-b913-0e8c8b7b2868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd50016c390f4ceda4c3e88eca78fe49'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:45.490783 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-38964e50-db15-4801-b913-0e8c8b7b2868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd50016c390f4ceda4c3e88eca78fe49'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:45.497193 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 967/1944] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:44 2022] DELETE /identity/v3/users/fd50016c390f4ceda4c3e88eca78fe49 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:45.498473 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e2624-9c13-4230-bdde-69b3cb0de6d7 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:45.498755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e2624-9c13-4230-bdde-69b3cb0de6d7 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:45.499029 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e2624-9c13-4230-bdde-69b3cb0de6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:45.552945 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-5f307095-9495-4ad6-93a4-46b53323369b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cd276119102459abb595ad040b6c164'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:45.554011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-4d8e2624-9c13-4230-bdde-69b3cb0de6d7 None None] MFA Rules not processed for user `3c2a19c731664548bb638381f3b5dc34`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:45.555236 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-4d8e2624-9c13-4230-bdde-69b3cb0de6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:45.627157 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 968/1945] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:45.638821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468ee7c-9517-4a10-ad2c-0fc2d1fc2726 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:45.639124 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468ee7c-9517-4a10-ad2c-0fc2d1fc2726 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:45.639400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468ee7c-9517-4a10-ad2c-0fc2d1fc2726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:45.642494 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:45.645574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-5f307095-9495-4ad6-93a4-46b53323369b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cd276119102459abb595ad040b6c164'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:45.646514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-5f307095-9495-4ad6-93a4-46b53323369b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cd276119102459abb595ad040b6c164'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:45.667849 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-f468ee7c-9517-4a10-ad2c-0fc2d1fc2726 None None] MFA Rules not processed for user `f8e3b168829e4dfeac03ccd8192f7bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:45.669349 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f468ee7c-9517-4a10-ad2c-0fc2d1fc2726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:45.679535 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-5f307095-9495-4ad6-93a4-46b53323369b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cd276119102459abb595ad040b6c164'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:45.700105 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-5f307095-9495-4ad6-93a4-46b53323369b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cd276119102459abb595ad040b6c164'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:45.708454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 978/1946] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:45 2022] DELETE /identity/v3/users/0cd276119102459abb595ad040b6c164 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:56:45.711809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f307095-9495-4ad6-93a4-46b53323369b admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:45.713280 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-5f307095-9495-4ad6-93a4-46b53323369b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:45.749771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 969/1947] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:56:45.762442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418a055-7659-4e02-95a2-0778808754bd None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:45.768133 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418a055-7659-4e02-95a2-0778808754bd None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:45.768133 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418a055-7659-4e02-95a2-0778808754bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:45.783180 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-b418a055-7659-4e02-95a2-0778808754bd None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:45.784435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b418a055-7659-4e02-95a2-0778808754bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:45.794737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 970/1948] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:45.795244 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418a055-7659-4e02-95a2-0778808754bd None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:45.796534 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b418a055-7659-4e02-95a2-0778808754bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:45.802940 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f307095-9495-4ad6-93a4-46b53323369b admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:45.809507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a890f2b-df03-4d7e-90f7-3c56cffe692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:45.810256 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a890f2b-df03-4d7e-90f7-3c56cffe692c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:45.810504 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a890f2b-df03-4d7e-90f7-3c56cffe692c admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:45.810701 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a890f2b-df03-4d7e-90f7-3c56cffe692c admin admin] PATH_INFO: `/v3/projects/1a23d962bd8c4467839a5222284b8041` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:45.811875 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a890f2b-df03-4d7e-90f7-3c56cffe692c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a23d962bd8c4467839a5222284b8041)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:45.814158 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a890f2b-df03-4d7e-90f7-3c56cffe692c admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:45.879854 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418a055-7659-4e02-95a2-0778808754bd None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:45.885561 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3298122-c345-40f0-ac1d-53bffb7311a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:45.886188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3298122-c345-40f0-ac1d-53bffb7311a7 service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:45.886468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3298122-c345-40f0-ac1d-53bffb7311a7 service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:45.886744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3298122-c345-40f0-ac1d-53bffb7311a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:45.888643 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b3298122-c345-40f0-ac1d-53bffb7311a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:45.952683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-6a890f2b-df03-4d7e-90f7-3c56cffe692c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a23d962bd8c4467839a5222284b8041', 'request_id': 'req-6a890f2b-df03-4d7e-90f7-3c56cffe692c'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:45.959592 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3298122-c345-40f0-ac1d-53bffb7311a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:45.961276 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3298122-c345-40f0-ac1d-53bffb7311a7 service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:45.970954 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 971/1949] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:45.972793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3298122-c345-40f0-ac1d-53bffb7311a7 service nova] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:45.974209 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b3298122-c345-40f0-ac1d-53bffb7311a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:46.035809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-6a890f2b-df03-4d7e-90f7-3c56cffe692c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a23d962bd8c4467839a5222284b8041', 'request_id': 'req-6a890f2b-df03-4d7e-90f7-3c56cffe692c'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:46.043212 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-6a890f2b-df03-4d7e-90f7-3c56cffe692c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a23d962bd8c4467839a5222284b8041', 'request_id': 'req-6a890f2b-df03-4d7e-90f7-3c56cffe692c'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:46.058914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3298122-c345-40f0-ac1d-53bffb7311a7 service nova] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:46.059874 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-6a890f2b-df03-4d7e-90f7-3c56cffe692c admin admin] The token cache is being invalidate because project 1a23d962bd8c4467839a5222284b8041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:46.060171 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-6a890f2b-df03-4d7e-90f7-3c56cffe692c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:46.060835 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-6a890f2b-df03-4d7e-90f7-3c56cffe692c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:46.062582 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 979/1950] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:45 2022] DELETE /identity/v3/projects/1a23d962bd8c4467839a5222284b8041 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:46.069354 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05498db-7d15-40ff-828b-d529a79e0211 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:46.069640 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05498db-7d15-40ff-828b-d529a79e0211 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:46.069922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05498db-7d15-40ff-828b-d529a79e0211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:46.092112 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-f05498db-7d15-40ff-828b-d529a79e0211 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:46.093431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f05498db-7d15-40ff-828b-d529a79e0211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:46.117073 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d901582-146a-4023-adc1-424ade7ab788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:46.117699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d901582-146a-4023-adc1-424ade7ab788 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:46.117976 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d901582-146a-4023-adc1-424ade7ab788 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:46.118248 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d901582-146a-4023-adc1-424ade7ab788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:46.121963 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-2d901582-146a-4023-adc1-424ade7ab788 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:46.164746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 980/1951] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:56:46.165865 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05498db-7d15-40ff-828b-d529a79e0211 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:46.167205 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f05498db-7d15-40ff-828b-d529a79e0211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:46.181925 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05498db-7d15-40ff-828b-d529a79e0211 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:46.188319 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9aefba-5dfa-4b66-8a88-aa0666c42aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:46.189175 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9aefba-5dfa-4b66-8a88-aa0666c42aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:46.189525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9aefba-5dfa-4b66-8a88-aa0666c42aab admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:46.189914 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9aefba-5dfa-4b66-8a88-aa0666c42aab admin admin] PATH_INFO: `/v3/projects/ddff917ae4dc43738f6762167399399f` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:46.191820 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9aefba-5dfa-4b66-8a88-aa0666c42aab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddff917ae4dc43738f6762167399399f)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:46.195192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9aefba-5dfa-4b66-8a88-aa0666c42aab admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:46.213153 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d901582-146a-4023-adc1-424ade7ab788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:46.215189 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d901582-146a-4023-adc1-424ade7ab788 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:46.227915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 972/1952] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:46.229189 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6921e-b9f1-4e42-824d-502e542930b6 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:46.229474 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6921e-b9f1-4e42-824d-502e542930b6 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:46.229727 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6921e-b9f1-4e42-824d-502e542930b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:46.250267 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-58f6921e-b9f1-4e42-824d-502e542930b6 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:46.251412 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-58f6921e-b9f1-4e42-824d-502e542930b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:46.260369 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 973/1953] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:46.264652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6921e-b9f1-4e42-824d-502e542930b6 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:46.274672 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6921e-b9f1-4e42-824d-502e542930b6 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:46.279891 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd6d55-59be-4378-85e7-b9a297d7987d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:46.280489 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd6d55-59be-4378-85e7-b9a297d7987d admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:46.280765 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd6d55-59be-4378-85e7-b9a297d7987d admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:46.281037 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd6d55-59be-4378-85e7-b9a297d7987d admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:46.281811 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd6d55-59be-4378-85e7-b9a297d7987d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:56:46.282115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd6d55-59be-4378-85e7-b9a297d7987d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:46.283718 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd6d55-59be-4378-85e7-b9a297d7987d admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:46.302229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 974/1954] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:56:46.303392 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd6d55-59be-4378-85e7-b9a297d7987d admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:46.313796 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd6d55-59be-4378-85e7-b9a297d7987d admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:46.320848 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0eda9d-53b4-4c1a-a25f-0c0efb4049af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:46.321548 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eda9d-53b4-4c1a-a25f-0c0efb4049af admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:46.321833 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eda9d-53b4-4c1a-a25f-0c0efb4049af admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:46.322095 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eda9d-53b4-4c1a-a25f-0c0efb4049af admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:46.322800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0eda9d-53b4-4c1a-a25f-0c0efb4049af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:46.325092 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0eda9d-53b4-4c1a-a25f-0c0efb4049af admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:46.340662 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-9a9aefba-5dfa-4b66-8a88-aa0666c42aab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddff917ae4dc43738f6762167399399f', 'request_id': 'req-9a9aefba-5dfa-4b66-8a88-aa0666c42aab'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:46.428182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-9a9aefba-5dfa-4b66-8a88-aa0666c42aab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddff917ae4dc43738f6762167399399f', 'request_id': 'req-9a9aefba-5dfa-4b66-8a88-aa0666c42aab'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:46.434681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-9a9aefba-5dfa-4b66-8a88-aa0666c42aab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddff917ae4dc43738f6762167399399f', 'request_id': 'req-9a9aefba-5dfa-4b66-8a88-aa0666c42aab'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:46.435821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 975/1955] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:46 2022] POST /identity/v3/projects => generated 409 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:46.440062 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0eda9d-53b4-4c1a-a25f-0c0efb4049af admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:46.449173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-9a9aefba-5dfa-4b66-8a88-aa0666c42aab admin admin] The token cache is being invalidate because project ddff917ae4dc43738f6762167399399f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:46.449475 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-9a9aefba-5dfa-4b66-8a88-aa0666c42aab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:46.450175 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-9a9aefba-5dfa-4b66-8a88-aa0666c42aab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:46.451967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 981/1956] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:46 2022] DELETE /identity/v3/projects/ddff917ae4dc43738f6762167399399f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:46.456940 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887da68-e4c1-471c-bd5b-719df525cf09 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:46.458840 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887da68-e4c1-471c-bd5b-719df525cf09 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:46.459127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887da68-e4c1-471c-bd5b-719df525cf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:46.482129 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-1887da68-e4c1-471c-bd5b-719df525cf09 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:46.483371 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-1887da68-e4c1-471c-bd5b-719df525cf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:46.524877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0eda9d-53b4-4c1a-a25f-0c0efb4049af admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:46.530175 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2e347-23d2-4bbe-96d9-1df27a1aaba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:46.530789 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2e347-23d2-4bbe-96d9-1df27a1aaba6 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:46.531478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2e347-23d2-4bbe-96d9-1df27a1aaba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:46.531784 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2e347-23d2-4bbe-96d9-1df27a1aaba6 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:46.532737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2e347-23d2-4bbe-96d9-1df27a1aaba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:46.535747 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2e347-23d2-4bbe-96d9-1df27a1aaba6 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:46.552431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 982/1957] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:56:46.560177 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eab51-2993-4b0e-a4d6-b8e94d4c1514 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:46.560473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eab51-2993-4b0e-a4d6-b8e94d4c1514 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:46.560850 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eab51-2993-4b0e-a4d6-b8e94d4c1514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:46.584984 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-5e4eab51-2993-4b0e-a4d6-b8e94d4c1514 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:46.586732 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-5e4eab51-2993-4b0e-a4d6-b8e94d4c1514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:46.601507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 983/1958] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:46.603268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4eab51-2993-4b0e-a4d6-b8e94d4c1514 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:46.641024 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4eab51-2993-4b0e-a4d6-b8e94d4c1514 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:46.646984 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542ea8d-8420-48fd-b518-e438fcc1edae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:46.648059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542ea8d-8420-48fd-b518-e438fcc1edae admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:46.651537 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542ea8d-8420-48fd-b518-e438fcc1edae admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:46.651537 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542ea8d-8420-48fd-b518-e438fcc1edae admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:46.651537 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542ea8d-8420-48fd-b518-e438fcc1edae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:56:46.651537 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542ea8d-8420-48fd-b518-e438fcc1edae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:46.651959 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542ea8d-8420-48fd-b518-e438fcc1edae admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:46.652599 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 976/1959] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:46 2022] POST /identity/v3/users => generated 305 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:46.657667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2e347-23d2-4bbe-96d9-1df27a1aaba6 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:46.660786 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3fc2e347-23d2-4bbe-96d9-1df27a1aaba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:46.665855 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 984/1960] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:56:46.669896 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542ea8d-8420-48fd-b518-e438fcc1edae admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:46.677193 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2e347-23d2-4bbe-96d9-1df27a1aaba6 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:46.681349 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542ea8d-8420-48fd-b518-e438fcc1edae admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:46.683436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b305c17-1f41-42e1-86d5-2e3ba41a9f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:46.684111 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b305c17-1f41-42e1-86d5-2e3ba41a9f18 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:46.684389 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b305c17-1f41-42e1-86d5-2e3ba41a9f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:46.684666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b305c17-1f41-42e1-86d5-2e3ba41a9f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:46.685322 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b305c17-1f41-42e1-86d5-2e3ba41a9f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:46.686378 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb82297-252d-4a5c-8cd7-80274aab6791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:46.686937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b305c17-1f41-42e1-86d5-2e3ba41a9f18 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:46.687063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb82297-252d-4a5c-8cd7-80274aab6791 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:46.687244 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb82297-252d-4a5c-8cd7-80274aab6791 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:46.687514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb82297-252d-4a5c-8cd7-80274aab6791 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:46.688319 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb82297-252d-4a5c-8cd7-80274aab6791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:46.691899 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb82297-252d-4a5c-8cd7-80274aab6791 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:46.698112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 977/1961] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:46.702102 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b305c17-1f41-42e1-86d5-2e3ba41a9f18 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:46.713608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b305c17-1f41-42e1-86d5-2e3ba41a9f18 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:46.722117 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af408d-4652-43c1-9e97-29db27f38bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:46.723477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af408d-4652-43c1-9e97-29db27f38bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:46.724019 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af408d-4652-43c1-9e97-29db27f38bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:46.724334 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af408d-4652-43c1-9e97-29db27f38bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:46.726456 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af408d-4652-43c1-9e97-29db27f38bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:46.726554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af408d-4652-43c1-9e97-29db27f38bd6 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:46.745641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 978/1962] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:56:46.748067 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:46.749618 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af408d-4652-43c1-9e97-29db27f38bd6 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:46.766875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af408d-4652-43c1-9e97-29db27f38bd6 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:46.766875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8181594-83ae-42c3-8eff-cccd4e4bf5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:46.766875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8181594-83ae-42c3-8eff-cccd4e4bf5db admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:46.768023 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8181594-83ae-42c3-8eff-cccd4e4bf5db admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:46.768023 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8181594-83ae-42c3-8eff-cccd4e4bf5db admin admin] PATH_INFO: `/v3/projects/e2e9ca5cf4924203bb9c2e468c6e3d0d/users/d264df353eb349bc8ee37ec70d35e34a/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:46.785662 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8181594-83ae-42c3-8eff-cccd4e4bf5db admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e9ca5cf4924203bb9c2e468c6e3d0d, user_id=d264df353eb349bc8ee37ec70d35e34a, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:46.789276 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8181594-83ae-42c3-8eff-cccd4e4bf5db admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:46.801836 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 985/1963] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:46 2022] POST /identity/v3/projects => generated 399 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:56:46.805793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb82297-252d-4a5c-8cd7-80274aab6791 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:46.887455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb82297-252d-4a5c-8cd7-80274aab6791 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:46.894990 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b30fb6-c56d-4e08-ad06-3cc8782c3e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:46.896037 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b30fb6-c56d-4e08-ad06-3cc8782c3e62 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:46.896612 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b30fb6-c56d-4e08-ad06-3cc8782c3e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:46.897005 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b30fb6-c56d-4e08-ad06-3cc8782c3e62 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:46.897771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b30fb6-c56d-4e08-ad06-3cc8782c3e62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:46.911210 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b30fb6-c56d-4e08-ad06-3cc8782c3e62 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:46.911301 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 979/1964] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:46 2022] PUT /identity/v3/projects/e2e9ca5cf4924203bb9c2e468c6e3d0d/users/d264df353eb349bc8ee37ec70d35e34a/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:46.917774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c60137-8b62-407e-b56f-af85f2e70e25 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:46.918228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c60137-8b62-407e-b56f-af85f2e70e25 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:46.918509 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c60137-8b62-407e-b56f-af85f2e70e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:46.964343 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-b4c60137-8b62-407e-b56f-af85f2e70e25 None None] MFA Rules not processed for user `d264df353eb349bc8ee37ec70d35e34a`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:46.965932 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b4c60137-8b62-407e-b56f-af85f2e70e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:47.022854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 986/1965] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:46 2022] POST /identity/v3/users => generated 300 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:56:47.022854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b30fb6-c56d-4e08-ad06-3cc8782c3e62 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:47.030252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-37b30fb6-c56d-4e08-ad06-3cc8782c3e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:47.046165 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b30fb6-c56d-4e08-ad06-3cc8782c3e62 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:47.053057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 980/1966] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:46 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:56:47.054902 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c60137-8b62-407e-b56f-af85f2e70e25 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:47.114801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092091e-4b21-4a90-9596-830b0fb4c507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:47.115505 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092091e-4b21-4a90-9596-830b0fb4c507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:47.115858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092091e-4b21-4a90-9596-830b0fb4c507 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:47.116134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092091e-4b21-4a90-9596-830b0fb4c507 admin admin] PATH_INFO: `/v3/projects/a281b5cdc8a04979940d64039ef1ca3b` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:47.117262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092091e-4b21-4a90-9596-830b0fb4c507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a281b5cdc8a04979940d64039ef1ca3b)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:47.119222 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092091e-4b21-4a90-9596-830b0fb4c507 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:47.126089 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c60137-8b62-407e-b56f-af85f2e70e25 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:47.131679 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70120b4-b265-4ebc-8c3d-3d34e2bd3b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:47.132311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70120b4-b265-4ebc-8c3d-3d34e2bd3b94 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:47.132575 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70120b4-b265-4ebc-8c3d-3d34e2bd3b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:47.133025 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70120b4-b265-4ebc-8c3d-3d34e2bd3b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:47.133680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70120b4-b265-4ebc-8c3d-3d34e2bd3b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:47.135975 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70120b4-b265-4ebc-8c3d-3d34e2bd3b94 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:47.147069 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 981/1967] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:47.148098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70120b4-b265-4ebc-8c3d-3d34e2bd3b94 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:47.157956 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70120b4-b265-4ebc-8c3d-3d34e2bd3b94 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:47.163044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494047e-f059-4d8e-a162-8660625acb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:47.166181 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494047e-f059-4d8e-a162-8660625acb55 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:47.166181 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494047e-f059-4d8e-a162-8660625acb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:47.166181 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494047e-f059-4d8e-a162-8660625acb55 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:47.166181 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494047e-f059-4d8e-a162-8660625acb55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:47.166656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494047e-f059-4d8e-a162-8660625acb55 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:47.316640 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-6092091e-4b21-4a90-9596-830b0fb4c507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a281b5cdc8a04979940d64039ef1ca3b', 'request_id': 'req-6092091e-4b21-4a90-9596-830b0fb4c507'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:47.362818 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 982/1968] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:47 2022] POST /identity/v3/projects => generated 409 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:47.368060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494047e-f059-4d8e-a162-8660625acb55 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:47.406724 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-6092091e-4b21-4a90-9596-830b0fb4c507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a281b5cdc8a04979940d64039ef1ca3b', 'request_id': 'req-6092091e-4b21-4a90-9596-830b0fb4c507'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:47.413811 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-6092091e-4b21-4a90-9596-830b0fb4c507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a281b5cdc8a04979940d64039ef1ca3b', 'request_id': 'req-6092091e-4b21-4a90-9596-830b0fb4c507'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:47.426916 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-6092091e-4b21-4a90-9596-830b0fb4c507 admin admin] The token cache is being invalidate because project a281b5cdc8a04979940d64039ef1ca3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:47.427274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-6092091e-4b21-4a90-9596-830b0fb4c507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:47.429036 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-6092091e-4b21-4a90-9596-830b0fb4c507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:47.431156 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 987/1969] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:47 2022] DELETE /identity/v3/projects/a281b5cdc8a04979940d64039ef1ca3b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:47.431408 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092091e-4b21-4a90-9596-830b0fb4c507 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:47.432824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-6092091e-4b21-4a90-9596-830b0fb4c507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:47.465359 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494047e-f059-4d8e-a162-8660625acb55 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:47.471114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb69b4-6aab-4aa3-b0c1-eb92c7876bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:47.472214 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb69b4-6aab-4aa3-b0c1-eb92c7876bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:47.472720 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb69b4-6aab-4aa3-b0c1-eb92c7876bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:47.473836 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb69b4-6aab-4aa3-b0c1-eb92c7876bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:47.474969 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb69b4-6aab-4aa3-b0c1-eb92c7876bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:47.478904 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb69b4-6aab-4aa3-b0c1-eb92c7876bc3 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:47.490026 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 983/1970] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:47.491046 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb69b4-6aab-4aa3-b0c1-eb92c7876bc3 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:47.492814 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-54cb69b4-6aab-4aa3-b0c1-eb92c7876bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:47.506038 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb69b4-6aab-4aa3-b0c1-eb92c7876bc3 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:47.511405 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63ce5e-8b27-4f8b-992b-90602f5dcc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:47.512088 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63ce5e-8b27-4f8b-992b-90602f5dcc60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:47.512369 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63ce5e-8b27-4f8b-992b-90602f5dcc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:47.513715 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63ce5e-8b27-4f8b-992b-90602f5dcc60 admin admin] PATH_INFO: `/v3/users/0886f4d23b4d474db750918dbc9bdea4` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:47.513834 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092091e-4b21-4a90-9596-830b0fb4c507 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:47.514003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63ce5e-8b27-4f8b-992b-90602f5dcc60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0886f4d23b4d474db750918dbc9bdea4)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:47.515965 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63ce5e-8b27-4f8b-992b-90602f5dcc60 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:47.521590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee6b73-91e4-4c09-8f34-7f86a017eca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:47.522219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee6b73-91e4-4c09-8f34-7f86a017eca5 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:47.522507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee6b73-91e4-4c09-8f34-7f86a017eca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:47.522784 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee6b73-91e4-4c09-8f34-7f86a017eca5 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:47.523429 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee6b73-91e4-4c09-8f34-7f86a017eca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:47.525430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee6b73-91e4-4c09-8f34-7f86a017eca5 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:47.621532 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 988/1971] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:47 2022] POST /identity/v3/users => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:47.621532 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee6b73-91e4-4c09-8f34-7f86a017eca5 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:47.623694 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4cee6b73-91e4-4c09-8f34-7f86a017eca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:47.636433 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee6b73-91e4-4c09-8f34-7f86a017eca5 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:47.642586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83847df0-5dd2-4df8-9517-db0b2f5651da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:47.643320 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83847df0-5dd2-4df8-9517-db0b2f5651da admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:47.643641 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83847df0-5dd2-4df8-9517-db0b2f5651da admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:47.643918 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83847df0-5dd2-4df8-9517-db0b2f5651da admin admin] PATH_INFO: `/v3/projects/90fc63bb0a5f416287d384d26e471412/users/1fcc7aec8fe74371ba364ad1a0573418/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:47.659450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83847df0-5dd2-4df8-9517-db0b2f5651da admin admin] RBAC: Authorizing `identity:create_grant(project_id=90fc63bb0a5f416287d384d26e471412, user_id=1fcc7aec8fe74371ba364ad1a0573418, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:47.662929 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83847df0-5dd2-4df8-9517-db0b2f5651da admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:47.743890 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-db63ce5e-8b27-4f8b-992b-90602f5dcc60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0886f4d23b4d474db750918dbc9bdea4'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:47.760001 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 989/1972] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:47 2022] PUT /identity/v3/projects/90fc63bb0a5f416287d384d26e471412/users/1fcc7aec8fe74371ba364ad1a0573418/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:47.770342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83847df0-5dd2-4df8-9517-db0b2f5651da admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:47.839368 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-db63ce5e-8b27-4f8b-992b-90602f5dcc60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0886f4d23b4d474db750918dbc9bdea4'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:47.840208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-db63ce5e-8b27-4f8b-992b-90602f5dcc60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0886f4d23b4d474db750918dbc9bdea4'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:47.851759 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83847df0-5dd2-4df8-9517-db0b2f5651da admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:47.858886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-db63ce5e-8b27-4f8b-992b-90602f5dcc60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0886f4d23b4d474db750918dbc9bdea4'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:47.869131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b300b2b-7bf8-4ef3-a57e-c5a27464fe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:47.869771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b300b2b-7bf8-4ef3-a57e-c5a27464fe3d admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:47.870051 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b300b2b-7bf8-4ef3-a57e-c5a27464fe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:47.871031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b300b2b-7bf8-4ef3-a57e-c5a27464fe3d admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:47.873823 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b300b2b-7bf8-4ef3-a57e-c5a27464fe3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:47.877614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b300b2b-7bf8-4ef3-a57e-c5a27464fe3d admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:47.891045 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-db63ce5e-8b27-4f8b-992b-90602f5dcc60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0886f4d23b4d474db750918dbc9bdea4'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:47.900964 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 990/1973] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:47.905528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6df0d6-29bf-4a29-9afd-863338773458 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:47.905528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6df0d6-29bf-4a29-9afd-863338773458 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:47.905898 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6df0d6-29bf-4a29-9afd-863338773458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:47.909277 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 984/1974] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:47 2022] DELETE /identity/v3/users/0886f4d23b4d474db750918dbc9bdea4 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:47.912781 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63ce5e-8b27-4f8b-992b-90602f5dcc60 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:47.912968 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-db63ce5e-8b27-4f8b-992b-90602f5dcc60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:47.949871 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-ee6df0d6-29bf-4a29-9afd-863338773458 None None] MFA Rules not processed for user `1fcc7aec8fe74371ba364ad1a0573418`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:47.951160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ee6df0d6-29bf-4a29-9afd-863338773458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:48.032730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63ce5e-8b27-4f8b-992b-90602f5dcc60 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:48.042110 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e94ae-eebf-4701-a695-6df84d468590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:48.042788 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e94ae-eebf-4701-a695-6df84d468590 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:48.043069 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e94ae-eebf-4701-a695-6df84d468590 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:48.043347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e94ae-eebf-4701-a695-6df84d468590 admin admin] PATH_INFO: `/v3/projects/d5021320f7d84018b752c4fb94ea8099/users/05300b4ca44344dd8fe8c05d4ebd7bc1/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:48.065389 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e94ae-eebf-4701-a695-6df84d468590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5021320f7d84018b752c4fb94ea8099, user_id=05300b4ca44344dd8fe8c05d4ebd7bc1, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:48.068872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e94ae-eebf-4701-a695-6df84d468590 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:48.091291 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 991/1975] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:47 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:48.095356 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6df0d6-29bf-4a29-9afd-863338773458 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:48.097429 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ee6df0d6-29bf-4a29-9afd-863338773458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:48.127436 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6df0d6-29bf-4a29-9afd-863338773458 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:48.141688 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9dbdf-d16f-495d-8dfe-257e5e128927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:48.144135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9dbdf-d16f-495d-8dfe-257e5e128927 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:48.145786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9dbdf-d16f-495d-8dfe-257e5e128927 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:48.146345 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9dbdf-d16f-495d-8dfe-257e5e128927 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:48.147639 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9dbdf-d16f-495d-8dfe-257e5e128927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:48.151439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9dbdf-d16f-495d-8dfe-257e5e128927 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:48.169548 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 985/1976] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:47 2022] PUT /identity/v3/projects/d5021320f7d84018b752c4fb94ea8099/users/05300b4ca44344dd8fe8c05d4ebd7bc1/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:48.173472 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e94ae-eebf-4701-a695-6df84d468590 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:48.321302 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e94ae-eebf-4701-a695-6df84d468590 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:48.326359 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2fdf2-09a6-4cb9-a71c-03e53e475deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:48.327424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2fdf2-09a6-4cb9-a71c-03e53e475deb admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:48.327736 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2fdf2-09a6-4cb9-a71c-03e53e475deb admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:48.328194 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2fdf2-09a6-4cb9-a71c-03e53e475deb admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:48.328643 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2fdf2-09a6-4cb9-a71c-03e53e475deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:48.330270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2fdf2-09a6-4cb9-a71c-03e53e475deb admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:48.343063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 986/1977] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:48.346689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2fdf2-09a6-4cb9-a71c-03e53e475deb admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:48.356581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:48.375708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 992/1978] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:48 2022] POST /identity/v3/projects => generated 399 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:48.381484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9dbdf-d16f-495d-8dfe-257e5e128927 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:48.381658 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2fdf2-09a6-4cb9-a71c-03e53e475deb admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:48.528158 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9dbdf-d16f-495d-8dfe-257e5e128927 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:48.534284 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b32f27-cc20-4b84-a578-e4080411d06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:48.535732 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b32f27-cc20-4b84-a578-e4080411d06e admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:48.536091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b32f27-cc20-4b84-a578-e4080411d06e admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:48.536403 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b32f27-cc20-4b84-a578-e4080411d06e admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:48.537075 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b32f27-cc20-4b84-a578-e4080411d06e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:48.540085 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b32f27-cc20-4b84-a578-e4080411d06e admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:48.542012 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507be9fd-bc56-48ec-b339-aee302f16598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:48.542875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507be9fd-bc56-48ec-b339-aee302f16598 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:48.543319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507be9fd-bc56-48ec-b339-aee302f16598 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:48.543877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507be9fd-bc56-48ec-b339-aee302f16598 admin admin] PATH_INFO: `/v3/projects/d5021320f7d84018b752c4fb94ea8099/users/05300b4ca44344dd8fe8c05d4ebd7bc1/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:48.553610 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507be9fd-bc56-48ec-b339-aee302f16598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5021320f7d84018b752c4fb94ea8099, user_id=05300b4ca44344dd8fe8c05d4ebd7bc1, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:48.580162 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507be9fd-bc56-48ec-b339-aee302f16598 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:48.603360 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 987/1979] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:48 2022] PUT /identity/v3/projects/d5021320f7d84018b752c4fb94ea8099/users/05300b4ca44344dd8fe8c05d4ebd7bc1/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:56:48.613864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4d1ab-00fc-40b5-9a52-b1b565b0a371 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:48.614230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4d1ab-00fc-40b5-9a52-b1b565b0a371 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:48.614622 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4d1ab-00fc-40b5-9a52-b1b565b0a371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:48.661066 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-3ac4d1ab-00fc-40b5-9a52-b1b565b0a371 None None] MFA Rules not processed for user `05300b4ca44344dd8fe8c05d4ebd7bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:48.662647 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3ac4d1ab-00fc-40b5-9a52-b1b565b0a371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:48.706131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 993/1980] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:48 2022] POST /identity/v3/users => generated 306 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:56:48.710399 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b32f27-cc20-4b84-a578-e4080411d06e admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:48.731168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b32f27-cc20-4b84-a578-e4080411d06e admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:48.768601 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 988/1981] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:48 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:56:48.769663 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4d1ab-00fc-40b5-9a52-b1b565b0a371 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:48.771155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3ac4d1ab-00fc-40b5-9a52-b1b565b0a371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:48.856335 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcff4cf-4541-4629-a21d-7ebad8882a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:48.858009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcff4cf-4541-4629-a21d-7ebad8882a6c admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:48.858528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcff4cf-4541-4629-a21d-7ebad8882a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:48.858921 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcff4cf-4541-4629-a21d-7ebad8882a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:48.859642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcff4cf-4541-4629-a21d-7ebad8882a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:48.861485 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4d1ab-00fc-40b5-9a52-b1b565b0a371 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:48.862108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcff4cf-4541-4629-a21d-7ebad8882a6c admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:48.867369 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceda7fb-4730-44b4-9b85-08bb3e843c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:48.868632 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceda7fb-4730-44b4-9b85-08bb3e843c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:48.869103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceda7fb-4730-44b4-9b85-08bb3e843c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:48.869558 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceda7fb-4730-44b4-9b85-08bb3e843c2e admin admin] PATH_INFO: `/v3/projects/239ca5384c53438db1ec7cd32c6b90d5` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:48.870929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceda7fb-4730-44b4-9b85-08bb3e843c2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=239ca5384c53438db1ec7cd32c6b90d5)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:48.875068 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceda7fb-4730-44b4-9b85-08bb3e843c2e admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:48.879577 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 994/1982] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:48.879577 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcff4cf-4541-4629-a21d-7ebad8882a6c admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:48.881832 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-1dcff4cf-4541-4629-a21d-7ebad8882a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:48.963164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcff4cf-4541-4629-a21d-7ebad8882a6c admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:48.966997 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32bd7e-39f5-454d-96e4-45ec17560405 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:48.967870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32bd7e-39f5-454d-96e4-45ec17560405 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:48.968269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32bd7e-39f5-454d-96e4-45ec17560405 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:48.968573 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32bd7e-39f5-454d-96e4-45ec17560405 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:48.978852 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb32bd7e-39f5-454d-96e4-45ec17560405 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:48.980354 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb32bd7e-39f5-454d-96e4-45ec17560405 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:48.991301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 995/1983] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:48 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:48.992150 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32bd7e-39f5-454d-96e4-45ec17560405 service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:49.007973 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32bd7e-39f5-454d-96e4-45ec17560405 service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:49.018293 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a06ed7-f1c6-4fb9-be39-75e502b5c373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:49.018969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a06ed7-f1c6-4fb9-be39-75e502b5c373 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:49.019383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a06ed7-f1c6-4fb9-be39-75e502b5c373 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:49.019751 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a06ed7-f1c6-4fb9-be39-75e502b5c373 admin admin] PATH_INFO: `/v3/projects/475595b7809d413caae586200785509e/users/3f003e2b222f4e1d87d16fcc985d0910/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:49.038454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a06ed7-f1c6-4fb9-be39-75e502b5c373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=475595b7809d413caae586200785509e, user_id=3f003e2b222f4e1d87d16fcc985d0910, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:49.042014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a06ed7-f1c6-4fb9-be39-75e502b5c373 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:49.053927 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-7ceda7fb-4730-44b4-9b85-08bb3e843c2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '239ca5384c53438db1ec7cd32c6b90d5', 'request_id': 'req-7ceda7fb-4730-44b4-9b85-08bb3e843c2e'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:49.178812 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-7ceda7fb-4730-44b4-9b85-08bb3e843c2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '239ca5384c53438db1ec7cd32c6b90d5', 'request_id': 'req-7ceda7fb-4730-44b4-9b85-08bb3e843c2e'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:49.184970 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 996/1984] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:48 2022] PUT /identity/v3/projects/475595b7809d413caae586200785509e/users/3f003e2b222f4e1d87d16fcc985d0910/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:49.185225 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-7ceda7fb-4730-44b4-9b85-08bb3e843c2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '239ca5384c53438db1ec7cd32c6b90d5', 'request_id': 'req-7ceda7fb-4730-44b4-9b85-08bb3e843c2e'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:49.191645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a06ed7-f1c6-4fb9-be39-75e502b5c373 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:49.198363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-7ceda7fb-4730-44b4-9b85-08bb3e843c2e admin admin] The token cache is being invalidate because project 239ca5384c53438db1ec7cd32c6b90d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:49.198658 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-7ceda7fb-4730-44b4-9b85-08bb3e843c2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:49.199402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-7ceda7fb-4730-44b4-9b85-08bb3e843c2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:49.201211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 989/1985] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:48 2022] DELETE /identity/v3/projects/239ca5384c53438db1ec7cd32c6b90d5 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:49.205048 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceda7fb-4730-44b4-9b85-08bb3e843c2e admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:49.206368 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-7ceda7fb-4730-44b4-9b85-08bb3e843c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:49.261306 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a06ed7-f1c6-4fb9-be39-75e502b5c373 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:49.267140 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7545228-98e7-401e-af47-69832b92372c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:49.267805 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7545228-98e7-401e-af47-69832b92372c admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:49.268101 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7545228-98e7-401e-af47-69832b92372c admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:49.268390 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7545228-98e7-401e-af47-69832b92372c admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:49.269312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7545228-98e7-401e-af47-69832b92372c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:49.272041 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7545228-98e7-401e-af47-69832b92372c admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:49.280135 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceda7fb-4730-44b4-9b85-08bb3e843c2e admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:49.286324 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 997/1986] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:49.287155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8d76e-90a7-4ba2-a40a-1743714b32da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:49.287414 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7545228-98e7-401e-af47-69832b92372c admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:49.303822 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8d76e-90a7-4ba2-a40a-1743714b32da admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:49.303822 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8d76e-90a7-4ba2-a40a-1743714b32da admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:49.303822 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8d76e-90a7-4ba2-a40a-1743714b32da admin admin] PATH_INFO: `/v3/users/91c593f341ff456dbaa4e5df674149be` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:49.304227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c7545228-98e7-401e-af47-69832b92372c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:49.304306 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8d76e-90a7-4ba2-a40a-1743714b32da admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c593f341ff456dbaa4e5df674149be)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:49.304306 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8d76e-90a7-4ba2-a40a-1743714b32da admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:49.304431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7545228-98e7-401e-af47-69832b92372c admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:49.309253 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadeda85-f666-4941-8656-a75dafe56eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:49.310072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadeda85-f666-4941-8656-a75dafe56eff admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:49.310479 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadeda85-f666-4941-8656-a75dafe56eff admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:49.310916 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadeda85-f666-4941-8656-a75dafe56eff admin admin] PATH_INFO: `/v3/projects/475595b7809d413caae586200785509e/users/3f003e2b222f4e1d87d16fcc985d0910/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:49.312941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadeda85-f666-4941-8656-a75dafe56eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=475595b7809d413caae586200785509e, user_id=3f003e2b222f4e1d87d16fcc985d0910, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:49.316005 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadeda85-f666-4941-8656-a75dafe56eff admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:49.333150 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 998/1987] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:49 2022] PUT /identity/v3/projects/475595b7809d413caae586200785509e/users/3f003e2b222f4e1d87d16fcc985d0910/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:49.339932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37656d-293b-4b14-aa5c-e45949e1e3a7 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:49.340221 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37656d-293b-4b14-aa5c-e45949e1e3a7 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:49.340499 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37656d-293b-4b14-aa5c-e45949e1e3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:49.371516 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-1c37656d-293b-4b14-aa5c-e45949e1e3a7 None None] MFA Rules not processed for user `3f003e2b222f4e1d87d16fcc985d0910`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:49.372991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-1c37656d-293b-4b14-aa5c-e45949e1e3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:49.444090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 999/1988] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:49 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:56:49.456886 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37656d-293b-4b14-aa5c-e45949e1e3a7 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:49.458580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-1c37656d-293b-4b14-aa5c-e45949e1e3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:49.521880 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-18b8d76e-90a7-4ba2-a40a-1743714b32da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c593f341ff456dbaa4e5df674149be'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:49.527480 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37656d-293b-4b14-aa5c-e45949e1e3a7 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:49.531412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eef1fa-dc7d-4976-9984-bf9b3d5b6761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:49.532087 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eef1fa-dc7d-4976-9984-bf9b3d5b6761 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:49.532392 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eef1fa-dc7d-4976-9984-bf9b3d5b6761 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:49.532663 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eef1fa-dc7d-4976-9984-bf9b3d5b6761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:49.538643 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:49.543749 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eef1fa-dc7d-4976-9984-bf9b3d5b6761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:49.545320 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eef1fa-dc7d-4976-9984-bf9b3d5b6761 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:49.555387 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1000/1989] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:49 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:56:49.556276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eef1fa-dc7d-4976-9984-bf9b3d5b6761 service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:49.557581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-23eef1fa-dc7d-4976-9984-bf9b3d5b6761 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:49.568602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eef1fa-dc7d-4976-9984-bf9b3d5b6761 service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:49.572218 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce91de-c801-46d8-a448-356bada02f72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:49.577592 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce91de-c801-46d8-a448-356bada02f72 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:49.577592 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce91de-c801-46d8-a448-356bada02f72 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:49.577592 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce91de-c801-46d8-a448-356bada02f72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:49.577592 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-cdce91de-c801-46d8-a448-356bada02f72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:49.595378 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-18b8d76e-90a7-4ba2-a40a-1743714b32da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c593f341ff456dbaa4e5df674149be'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:49.596052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-18b8d76e-90a7-4ba2-a40a-1743714b32da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c593f341ff456dbaa4e5df674149be'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:49.604913 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-18b8d76e-90a7-4ba2-a40a-1743714b32da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c593f341ff456dbaa4e5df674149be'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:49.617675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-18b8d76e-90a7-4ba2-a40a-1743714b32da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c593f341ff456dbaa4e5df674149be'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:49.623794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 990/1990] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:49 2022] DELETE /identity/v3/users/91c593f341ff456dbaa4e5df674149be => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:56:49.635429 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce91de-c801-46d8-a448-356bada02f72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:49.637035 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce91de-c801-46d8-a448-356bada02f72 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:49.647475 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1001/1991] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:49 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:49.823204 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8d76e-90a7-4ba2-a40a-1743714b32da admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:49.824811 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-18b8d76e-90a7-4ba2-a40a-1743714b32da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:49.897972 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8d76e-90a7-4ba2-a40a-1743714b32da admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:49.897972 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83873218-2e2a-4299-b8d9-53482eb12185 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:49.897972 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83873218-2e2a-4299-b8d9-53482eb12185 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:49.897972 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83873218-2e2a-4299-b8d9-53482eb12185 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:49.898391 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83873218-2e2a-4299-b8d9-53482eb12185 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:49.898391 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-83873218-2e2a-4299-b8d9-53482eb12185 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:49.971144 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83873218-2e2a-4299-b8d9-53482eb12185 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:49.973123 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83873218-2e2a-4299-b8d9-53482eb12185 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:49.982986 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 991/1992] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:49 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:50.136261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce91de-c801-46d8-a448-356bada02f72 service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:50.243478 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce91de-c801-46d8-a448-356bada02f72 service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:50.303402 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830ccc3-c43f-432b-86cb-74f0c712cdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:50.304081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830ccc3-c43f-432b-86cb-74f0c712cdd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:50.304364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830ccc3-c43f-432b-86cb-74f0c712cdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:50.304640 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830ccc3-c43f-432b-86cb-74f0c712cdd8 admin admin] PATH_INFO: `/v3/projects/404a7ec2404e48df87eb4fcc2ba532d7` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:50.305784 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830ccc3-c43f-432b-86cb-74f0c712cdd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=404a7ec2404e48df87eb4fcc2ba532d7)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:50.307757 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830ccc3-c43f-432b-86cb-74f0c712cdd8 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:50.456422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-8830ccc3-c43f-432b-86cb-74f0c712cdd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '404a7ec2404e48df87eb4fcc2ba532d7', 'request_id': 'req-8830ccc3-c43f-432b-86cb-74f0c712cdd8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:50.572739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-8830ccc3-c43f-432b-86cb-74f0c712cdd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '404a7ec2404e48df87eb4fcc2ba532d7', 'request_id': 'req-8830ccc3-c43f-432b-86cb-74f0c712cdd8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:50.579158 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-8830ccc3-c43f-432b-86cb-74f0c712cdd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '404a7ec2404e48df87eb4fcc2ba532d7', 'request_id': 'req-8830ccc3-c43f-432b-86cb-74f0c712cdd8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:50.592614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-8830ccc3-c43f-432b-86cb-74f0c712cdd8 admin admin] The token cache is being invalidate because project 404a7ec2404e48df87eb4fcc2ba532d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:50.592931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-8830ccc3-c43f-432b-86cb-74f0c712cdd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:50.593577 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-8830ccc3-c43f-432b-86cb-74f0c712cdd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:50.595298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1002/1993] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:50 2022] DELETE /identity/v3/projects/404a7ec2404e48df87eb4fcc2ba532d7 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:50.601626 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcb4ba-e24e-485a-8dba-edbe536c3bf4 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:50.602224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcb4ba-e24e-485a-8dba-edbe536c3bf4 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:50.602945 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcb4ba-e24e-485a-8dba-edbe536c3bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:50.629385 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-ccfcb4ba-e24e-485a-8dba-edbe536c3bf4 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:50.631670 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ccfcb4ba-e24e-485a-8dba-edbe536c3bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:50.766503 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 992/1994] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:50.775836 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7149e4-e99a-4ddc-b3f0-1c41f8ecb842 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:50.776124 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7149e4-e99a-4ddc-b3f0-1c41f8ecb842 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:50.776400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7149e4-e99a-4ddc-b3f0-1c41f8ecb842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:50.808063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-ff7149e4-e99a-4ddc-b3f0-1c41f8ecb842 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:50.809983 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ff7149e4-e99a-4ddc-b3f0-1c41f8ecb842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:50.820078 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1003/1995] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:50.825487 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcb4ba-e24e-485a-8dba-edbe536c3bf4 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:50.837995 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcb4ba-e24e-485a-8dba-edbe536c3bf4 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:50.861274 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae2028-4df0-41b4-b825-928ca20fbc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:50.862728 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae2028-4df0-41b4-b825-928ca20fbc59 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:50.862728 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae2028-4df0-41b4-b825-928ca20fbc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:50.863508 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae2028-4df0-41b4-b825-928ca20fbc59 admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:50.866021 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae2028-4df0-41b4-b825-928ca20fbc59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:56:50.866446 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae2028-4df0-41b4-b825-928ca20fbc59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:50.870981 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae2028-4df0-41b4-b825-928ca20fbc59 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:50.902261 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 993/1996] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:56:50.905482 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7149e4-e99a-4ddc-b3f0-1c41f8ecb842 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:50.923986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7149e4-e99a-4ddc-b3f0-1c41f8ecb842 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:50.928158 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1501c64-6ead-4a6b-ab87-3baad6028494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:50.928797 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1501c64-6ead-4a6b-ab87-3baad6028494 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:50.929080 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1501c64-6ead-4a6b-ab87-3baad6028494 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:50.929409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1501c64-6ead-4a6b-ab87-3baad6028494 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:50.930059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1501c64-6ead-4a6b-ab87-3baad6028494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:50.932095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1501c64-6ead-4a6b-ab87-3baad6028494 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:51.100434 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1004/1997] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:50 2022] POST /identity/v3/projects => generated 381 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:51.105112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae2028-4df0-41b4-b825-928ca20fbc59 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:51.115775 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae2028-4df0-41b4-b825-928ca20fbc59 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:51.172017 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad412c6-e47d-4022-9835-4867edc58fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:51.172636 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad412c6-e47d-4022-9835-4867edc58fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:51.172928 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad412c6-e47d-4022-9835-4867edc58fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:51.173189 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad412c6-e47d-4022-9835-4867edc58fd6 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:51.173830 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad412c6-e47d-4022-9835-4867edc58fd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:51.176301 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad412c6-e47d-4022-9835-4867edc58fd6 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:51.285500 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:51.387144 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 994/1998] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:51 2022] POST /identity/v3/users => generated 291 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:51.389732 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1501c64-6ead-4a6b-ab87-3baad6028494 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:51.400766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1501c64-6ead-4a6b-ab87-3baad6028494 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:51.405848 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6265609-5007-42e3-8013-262493699139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:51.406462 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6265609-5007-42e3-8013-262493699139 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:51.406738 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6265609-5007-42e3-8013-262493699139 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:51.407013 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6265609-5007-42e3-8013-262493699139 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:51.407696 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6265609-5007-42e3-8013-262493699139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:51.409465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6265609-5007-42e3-8013-262493699139 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:51.438015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad412c6-e47d-4022-9835-4867edc58fd6 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:51.438633 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1005/1999] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:51.460210 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad412c6-e47d-4022-9835-4867edc58fd6 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:51.467216 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa707e1-9a2f-4e61-84f7-aa3719ea2060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:51.469077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa707e1-9a2f-4e61-84f7-aa3719ea2060 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:51.469521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa707e1-9a2f-4e61-84f7-aa3719ea2060 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:51.469937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa707e1-9a2f-4e61-84f7-aa3719ea2060 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:51.471021 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa707e1-9a2f-4e61-84f7-aa3719ea2060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:51.474591 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa707e1-9a2f-4e61-84f7-aa3719ea2060 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:51.494338 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6265609-5007-42e3-8013-262493699139 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:51.501090 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 995/2000] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:51.506338 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6265609-5007-42e3-8013-262493699139 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:51.512285 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90758884-0c95-4787-aa9d-4b06a02bffa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:51.513161 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90758884-0c95-4787-aa9d-4b06a02bffa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:51.513668 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90758884-0c95-4787-aa9d-4b06a02bffa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:51.513981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90758884-0c95-4787-aa9d-4b06a02bffa3 admin admin] PATH_INFO: `/v3/projects/4026dcf1d43e413dad820fc0fd81bf25/users/46f3b5a5bdd14813aeb7db583736c948/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:51.544818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90758884-0c95-4787-aa9d-4b06a02bffa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4026dcf1d43e413dad820fc0fd81bf25, user_id=46f3b5a5bdd14813aeb7db583736c948, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:51.544818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90758884-0c95-4787-aa9d-4b06a02bffa3 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:51.648004 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1006/2001] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:51 2022] PUT /identity/v3/projects/4026dcf1d43e413dad820fc0fd81bf25/users/46f3b5a5bdd14813aeb7db583736c948/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:51.659079 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d847b1b-2ad6-4311-bc17-6031128368b3 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:51.659364 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d847b1b-2ad6-4311-bc17-6031128368b3 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:51.659867 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d847b1b-2ad6-4311-bc17-6031128368b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:51.693858 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-1d847b1b-2ad6-4311-bc17-6031128368b3 None None] MFA Rules not processed for user `46f3b5a5bdd14813aeb7db583736c948`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:51.693858 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1d847b1b-2ad6-4311-bc17-6031128368b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:51.794384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 996/2002] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:51.798866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90758884-0c95-4787-aa9d-4b06a02bffa3 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:51.918783 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90758884-0c95-4787-aa9d-4b06a02bffa3 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:51.924948 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcdd89-7540-48fb-9262-54ab51330b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:51.926663 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcdd89-7540-48fb-9262-54ab51330b7d admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:51.927040 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcdd89-7540-48fb-9262-54ab51330b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:51.927315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcdd89-7540-48fb-9262-54ab51330b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:51.928067 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdcdd89-7540-48fb-9262-54ab51330b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:51.930014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdcdd89-7540-48fb-9262-54ab51330b7d admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:52.070380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1007/2003] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:51 2022] POST /identity/v3/projects => generated 379 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:52.071672 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d847b1b-2ad6-4311-bc17-6031128368b3 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:52.084133 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d847b1b-2ad6-4311-bc17-6031128368b3 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:52.144427 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f10c8f-51ea-44f2-b926-fa4a8cc883f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:52.145076 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f10c8f-51ea-44f2-b926-fa4a8cc883f8 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:52.145357 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f10c8f-51ea-44f2-b926-fa4a8cc883f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:52.145640 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f10c8f-51ea-44f2-b926-fa4a8cc883f8 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:52.146332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f10c8f-51ea-44f2-b926-fa4a8cc883f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:52.148307 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f10c8f-51ea-44f2-b926-fa4a8cc883f8 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:52.308523 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 997/2004] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:52 2022] POST /identity/v3/users => generated 296 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:52.312565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcdd89-7540-48fb-9262-54ab51330b7d admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:52.323641 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcdd89-7540-48fb-9262-54ab51330b7d admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:52.328325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64527a23-534b-4d87-8597-bc4fb615f6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:52.328932 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64527a23-534b-4d87-8597-bc4fb615f6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:52.329214 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64527a23-534b-4d87-8597-bc4fb615f6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:52.329487 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64527a23-534b-4d87-8597-bc4fb615f6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:52.330126 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64527a23-534b-4d87-8597-bc4fb615f6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:52.332310 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64527a23-534b-4d87-8597-bc4fb615f6b1 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:52.342703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1008/2005] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:52.351814 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f10c8f-51ea-44f2-b926-fa4a8cc883f8 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:52.362163 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f10c8f-51ea-44f2-b926-fa4a8cc883f8 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:52.367077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489429fa-166d-4404-98b7-0d024edd0d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:52.367775 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489429fa-166d-4404-98b7-0d024edd0d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:52.368040 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489429fa-166d-4404-98b7-0d024edd0d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:52.368316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489429fa-166d-4404-98b7-0d024edd0d39 admin admin] PATH_INFO: `/v3/projects/46088427fb514682b311db230fc8a60f/users/d1ea42bbd4dd4cb1b18630da3efb6d20/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:52.384329 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489429fa-166d-4404-98b7-0d024edd0d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46088427fb514682b311db230fc8a60f, user_id=d1ea42bbd4dd4cb1b18630da3efb6d20, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:52.387090 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489429fa-166d-4404-98b7-0d024edd0d39 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:52.553004 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 998/2006] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:52 2022] PUT /identity/v3/projects/46088427fb514682b311db230fc8a60f/users/d1ea42bbd4dd4cb1b18630da3efb6d20/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:52.557104 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64527a23-534b-4d87-8597-bc4fb615f6b1 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:52.568647 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64527a23-534b-4d87-8597-bc4fb615f6b1 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:52.672959 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bdd4a-5300-4159-8f72-a711a351434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:52.673762 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bdd4a-5300-4159-8f72-a711a351434b admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:52.674046 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bdd4a-5300-4159-8f72-a711a351434b admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:52.674317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bdd4a-5300-4159-8f72-a711a351434b admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:52.675093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703bdd4a-5300-4159-8f72-a711a351434b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:52.677671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703bdd4a-5300-4159-8f72-a711a351434b admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:52.693621 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1009/2007] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:56:52.694826 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489429fa-166d-4404-98b7-0d024edd0d39 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:52.705059 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489429fa-166d-4404-98b7-0d024edd0d39 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:52.709732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696924c-0f78-4e36-977c-755068242f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:52.710388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696924c-0f78-4e36-977c-755068242f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:52.710663 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696924c-0f78-4e36-977c-755068242f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:52.710928 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696924c-0f78-4e36-977c-755068242f97 admin admin] PATH_INFO: `/v3/projects/46088427fb514682b311db230fc8a60f/users/d1ea42bbd4dd4cb1b18630da3efb6d20/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:52.712838 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696924c-0f78-4e36-977c-755068242f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46088427fb514682b311db230fc8a60f, user_id=d1ea42bbd4dd4cb1b18630da3efb6d20, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:52.715501 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696924c-0f78-4e36-977c-755068242f97 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:52.730016 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 999/2008] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:56:52 2022] PUT /identity/v3/projects/46088427fb514682b311db230fc8a60f/users/d1ea42bbd4dd4cb1b18630da3efb6d20/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:52.740881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b744b5-7157-4d9e-9aea-24f1f5abbfb1 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:52.741167 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b744b5-7157-4d9e-9aea-24f1f5abbfb1 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:52.741496 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b744b5-7157-4d9e-9aea-24f1f5abbfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:52.748697 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:52.778447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-27b744b5-7157-4d9e-9aea-24f1f5abbfb1 None None] MFA Rules not processed for user `d1ea42bbd4dd4cb1b18630da3efb6d20`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:52.779725 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-27b744b5-7157-4d9e-9aea-24f1f5abbfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:52.853525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1010/2009] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:52.867423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696924c-0f78-4e36-977c-755068242f97 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:52.869165 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3696924c-0f78-4e36-977c-755068242f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:52.933844 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696924c-0f78-4e36-977c-755068242f97 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:52.937833 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfca03a-cb63-40cd-bdc3-82f949147393 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:52.938463 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfca03a-cb63-40cd-bdc3-82f949147393 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:52.938990 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfca03a-cb63-40cd-bdc3-82f949147393 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:52.939181 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfca03a-cb63-40cd-bdc3-82f949147393 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:52.949738 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfca03a-cb63-40cd-bdc3-82f949147393 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:52.951199 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfca03a-cb63-40cd-bdc3-82f949147393 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:52.962645 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1000/2010] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:53.944465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b744b5-7157-4d9e-9aea-24f1f5abbfb1 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:54.167828 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b744b5-7157-4d9e-9aea-24f1f5abbfb1 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:54.167828 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d971e-fb95-4f3f-9901-27d5f18c6251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:54.167828 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d971e-fb95-4f3f-9901-27d5f18c6251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:54.167828 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d971e-fb95-4f3f-9901-27d5f18c6251 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:54.168681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d971e-fb95-4f3f-9901-27d5f18c6251 admin admin] PATH_INFO: `/v3/users/46f3b5a5bdd14813aeb7db583736c948` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:54.168681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d971e-fb95-4f3f-9901-27d5f18c6251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46f3b5a5bdd14813aeb7db583736c948)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:54.168681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d971e-fb95-4f3f-9901-27d5f18c6251 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:54.844037 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e94d971e-fb95-4f3f-9901-27d5f18c6251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46f3b5a5bdd14813aeb7db583736c948'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:55.027969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e94d971e-fb95-4f3f-9901-27d5f18c6251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46f3b5a5bdd14813aeb7db583736c948'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:55.031055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e94d971e-fb95-4f3f-9901-27d5f18c6251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46f3b5a5bdd14813aeb7db583736c948'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:55.043812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e94d971e-fb95-4f3f-9901-27d5f18c6251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46f3b5a5bdd14813aeb7db583736c948'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:55.057402 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e94d971e-fb95-4f3f-9901-27d5f18c6251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46f3b5a5bdd14813aeb7db583736c948'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:55.057402 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:55.067128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1011/2011] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:53 2022] DELETE /identity/v3/users/46f3b5a5bdd14813aeb7db583736c948 => generated 0 bytes in 1123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:55.071876 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53638106-8d4e-45db-aae1-188fc33f0e58 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:55.072363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53638106-8d4e-45db-aae1-188fc33f0e58 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:55.072483 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53638106-8d4e-45db-aae1-188fc33f0e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:55.094324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-53638106-8d4e-45db-aae1-188fc33f0e58 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:55.095768 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-53638106-8d4e-45db-aae1-188fc33f0e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:55.181116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1001/2012] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:55.191843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d971e-fb95-4f3f-9901-27d5f18c6251 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:55.197488 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-e94d971e-fb95-4f3f-9901-27d5f18c6251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:55.256297 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d971e-fb95-4f3f-9901-27d5f18c6251 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:55.259883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66599068-390a-4066-84f7-b82ae02aa6b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:55.260501 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66599068-390a-4066-84f7-b82ae02aa6b5 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:55.260779 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66599068-390a-4066-84f7-b82ae02aa6b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:55.261049 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66599068-390a-4066-84f7-b82ae02aa6b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:55.270360 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66599068-390a-4066-84f7-b82ae02aa6b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:55.271822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66599068-390a-4066-84f7-b82ae02aa6b5 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:55.288783 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1012/2013] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:55.894238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53638106-8d4e-45db-aae1-188fc33f0e58 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:55.894238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-53638106-8d4e-45db-aae1-188fc33f0e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:55.905979 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53638106-8d4e-45db-aae1-188fc33f0e58 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:55.911576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7fe97-526c-416f-bd72-c9f79e6ec894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:55.912428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7fe97-526c-416f-bd72-c9f79e6ec894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:55.912879 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7fe97-526c-416f-bd72-c9f79e6ec894 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:55.913311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7fe97-526c-416f-bd72-c9f79e6ec894 admin admin] PATH_INFO: `/v3/users/298619956ec64676aa24441c734641af` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:55.915050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7fe97-526c-416f-bd72-c9f79e6ec894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=298619956ec64676aa24441c734641af)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:55.917405 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7fe97-526c-416f-bd72-c9f79e6ec894 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:56.059200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66599068-390a-4066-84f7-b82ae02aa6b5 service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:56.062277 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-66599068-390a-4066-84f7-b82ae02aa6b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:56.073604 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66599068-390a-4066-84f7-b82ae02aa6b5 service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:56.078317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdcf6c3-1258-4340-ba70-be6003214f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:56.078956 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcf6c3-1258-4340-ba70-be6003214f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:56.079236 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcf6c3-1258-4340-ba70-be6003214f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:56.079585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcf6c3-1258-4340-ba70-be6003214f0c admin admin] PATH_INFO: `/v3/projects/4026dcf1d43e413dad820fc0fd81bf25` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:56.081046 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdcf6c3-1258-4340-ba70-be6003214f0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4026dcf1d43e413dad820fc0fd81bf25)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:56.083242 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdcf6c3-1258-4340-ba70-be6003214f0c admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:56.170630 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-32c7fe97-526c-416f-bd72-c9f79e6ec894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298619956ec64676aa24441c734641af'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:56.242559 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-4fdcf6c3-1258-4340-ba70-be6003214f0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4026dcf1d43e413dad820fc0fd81bf25', 'request_id': 'req-4fdcf6c3-1258-4340-ba70-be6003214f0c'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:56.258489 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-32c7fe97-526c-416f-bd72-c9f79e6ec894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298619956ec64676aa24441c734641af'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:56.259234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-32c7fe97-526c-416f-bd72-c9f79e6ec894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298619956ec64676aa24441c734641af'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:56.268080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-32c7fe97-526c-416f-bd72-c9f79e6ec894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298619956ec64676aa24441c734641af'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:56.281044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-32c7fe97-526c-416f-bd72-c9f79e6ec894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298619956ec64676aa24441c734641af'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:56.287426 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1002/2014] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:55 2022] DELETE /identity/v3/users/298619956ec64676aa24441c734641af => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:56.291985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b451e15-1ccf-4b3d-ac5f-22a096a4eb78 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:56.292451 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b451e15-1ccf-4b3d-ac5f-22a096a4eb78 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:56.292739 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b451e15-1ccf-4b3d-ac5f-22a096a4eb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:56.315727 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-4b451e15-1ccf-4b3d-ac5f-22a096a4eb78 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:56.317564 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-4b451e15-1ccf-4b3d-ac5f-22a096a4eb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:56.393423 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-4fdcf6c3-1258-4340-ba70-be6003214f0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4026dcf1d43e413dad820fc0fd81bf25', 'request_id': 'req-4fdcf6c3-1258-4340-ba70-be6003214f0c'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:56.406245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-4fdcf6c3-1258-4340-ba70-be6003214f0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4026dcf1d43e413dad820fc0fd81bf25', 'request_id': 'req-4fdcf6c3-1258-4340-ba70-be6003214f0c'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:56.409246 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1003/2015] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:56:56.422541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b451e15-1ccf-4b3d-ac5f-22a096a4eb78 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:56.424612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-4b451e15-1ccf-4b3d-ac5f-22a096a4eb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:56.426744 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-4fdcf6c3-1258-4340-ba70-be6003214f0c admin admin] The token cache is being invalidate because project 4026dcf1d43e413dad820fc0fd81bf25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:56.427234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-4fdcf6c3-1258-4340-ba70-be6003214f0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:56.428084 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-4fdcf6c3-1258-4340-ba70-be6003214f0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:56.434270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1013/2016] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:56 2022] DELETE /identity/v3/projects/4026dcf1d43e413dad820fc0fd81bf25 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:56:56.437754 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdcf6c3-1258-4340-ba70-be6003214f0c admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:56.447205 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4fdcf6c3-1258-4340-ba70-be6003214f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:56.473927 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:56.546435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b451e15-1ccf-4b3d-ac5f-22a096a4eb78 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:56.552587 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a4c43-2bac-4edb-8d52-7a001664e0ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:56.553378 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a4c43-2bac-4edb-8d52-7a001664e0ba service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:56.554150 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a4c43-2bac-4edb-8d52-7a001664e0ba service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:56.554576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a4c43-2bac-4edb-8d52-7a001664e0ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:56.557717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b01a4c43-2bac-4edb-8d52-7a001664e0ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:56.579410 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a4c43-2bac-4edb-8d52-7a001664e0ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:56.582761 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a4c43-2bac-4edb-8d52-7a001664e0ba service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:56.601172 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1004/2017] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:56:56.616078 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdcf6c3-1258-4340-ba70-be6003214f0c admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:56.621063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c347b2-7e65-4b4d-b02c-2088270d4aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:56.621771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c347b2-7e65-4b4d-b02c-2088270d4aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:56.621995 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c347b2-7e65-4b4d-b02c-2088270d4aca admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:56.622271 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c347b2-7e65-4b4d-b02c-2088270d4aca admin admin] PATH_INFO: `/v3/users/d1ea42bbd4dd4cb1b18630da3efb6d20` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:56.623428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c347b2-7e65-4b4d-b02c-2088270d4aca admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ea42bbd4dd4cb1b18630da3efb6d20)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:56.625574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c347b2-7e65-4b4d-b02c-2088270d4aca admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:56.915778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-79c347b2-7e65-4b4d-b02c-2088270d4aca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ea42bbd4dd4cb1b18630da3efb6d20'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:57.013676 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:57.015063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-79c347b2-7e65-4b4d-b02c-2088270d4aca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ea42bbd4dd4cb1b18630da3efb6d20'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:57.015063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-79c347b2-7e65-4b4d-b02c-2088270d4aca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ea42bbd4dd4cb1b18630da3efb6d20'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:57.024252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a4c43-2bac-4edb-8d52-7a001664e0ba service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:57.025709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b01a4c43-2bac-4edb-8d52-7a001664e0ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:57.042024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a4c43-2bac-4edb-8d52-7a001664e0ba service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:57.050684 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-79c347b2-7e65-4b4d-b02c-2088270d4aca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ea42bbd4dd4cb1b18630da3efb6d20'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:57.063986 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e7151-4f4f-41c1-b708-d5633f945505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:57.064649 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e7151-4f4f-41c1-b708-d5633f945505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:57.064928 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e7151-4f4f-41c1-b708-d5633f945505 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:57.065198 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e7151-4f4f-41c1-b708-d5633f945505 admin admin] PATH_INFO: `/v3/users/1fcc7aec8fe74371ba364ad1a0573418` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:57.070059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-79c347b2-7e65-4b4d-b02c-2088270d4aca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ea42bbd4dd4cb1b18630da3efb6d20'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:57.072661 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e7151-4f4f-41c1-b708-d5633f945505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fcc7aec8fe74371ba364ad1a0573418)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:57.077989 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e7151-4f4f-41c1-b708-d5633f945505 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:57.089345 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1014/2018] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:56 2022] DELETE /identity/v3/users/d1ea42bbd4dd4cb1b18630da3efb6d20 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:57.362040 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c347b2-7e65-4b4d-b02c-2088270d4aca admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:57.364210 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-79c347b2-7e65-4b4d-b02c-2088270d4aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:57.419822 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-214e7151-4f4f-41c1-b708-d5633f945505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fcc7aec8fe74371ba364ad1a0573418'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:57.466300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c347b2-7e65-4b4d-b02c-2088270d4aca admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:57.473018 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0d047-d1c2-4c53-a99c-47c35942684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:57.474119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0d047-d1c2-4c53-a99c-47c35942684f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:57.474498 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0d047-d1c2-4c53-a99c-47c35942684f admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:57.474900 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0d047-d1c2-4c53-a99c-47c35942684f admin admin] PATH_INFO: `/v3/projects/2783d6eada0c4ba99e57e2bbaae4f3c6` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:57.476396 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0d047-d1c2-4c53-a99c-47c35942684f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2783d6eada0c4ba99e57e2bbaae4f3c6)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:57.478973 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0d047-d1c2-4c53-a99c-47c35942684f admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:57.573771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-214e7151-4f4f-41c1-b708-d5633f945505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fcc7aec8fe74371ba364ad1a0573418'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:57.574553 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-214e7151-4f4f-41c1-b708-d5633f945505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fcc7aec8fe74371ba364ad1a0573418'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:57.582954 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-214e7151-4f4f-41c1-b708-d5633f945505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fcc7aec8fe74371ba364ad1a0573418'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:57.596749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-214e7151-4f4f-41c1-b708-d5633f945505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fcc7aec8fe74371ba364ad1a0573418'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:57.607164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1005/2019] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:57 2022] DELETE /identity/v3/users/1fcc7aec8fe74371ba364ad1a0573418 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:56:57.611913 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95377834-f791-4102-acbe-21af567f92cd None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:57.619307 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95377834-f791-4102-acbe-21af567f92cd None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:57.619307 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95377834-f791-4102-acbe-21af567f92cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:57.640497 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e9b0d047-d1c2-4c53-a99c-47c35942684f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2783d6eada0c4ba99e57e2bbaae4f3c6', 'request_id': 'req-e9b0d047-d1c2-4c53-a99c-47c35942684f'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:57.655663 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-95377834-f791-4102-acbe-21af567f92cd None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:57.657928 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-95377834-f791-4102-acbe-21af567f92cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:57.732818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e9b0d047-d1c2-4c53-a99c-47c35942684f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2783d6eada0c4ba99e57e2bbaae4f3c6', 'request_id': 'req-e9b0d047-d1c2-4c53-a99c-47c35942684f'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:57.740044 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e9b0d047-d1c2-4c53-a99c-47c35942684f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2783d6eada0c4ba99e57e2bbaae4f3c6', 'request_id': 'req-e9b0d047-d1c2-4c53-a99c-47c35942684f'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:57.760754 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e9b0d047-d1c2-4c53-a99c-47c35942684f admin admin] The token cache is being invalidate because project 2783d6eada0c4ba99e57e2bbaae4f3c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:57.761701 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e9b0d047-d1c2-4c53-a99c-47c35942684f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:57.762607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e9b0d047-d1c2-4c53-a99c-47c35942684f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:57.767192 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1006/2021] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:57.768069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1015/2021] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:57 2022] DELETE /identity/v3/projects/2783d6eada0c4ba99e57e2bbaae4f3c6 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:56:57.768844 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95377834-f791-4102-acbe-21af567f92cd None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:57.770839 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-95377834-f791-4102-acbe-21af567f92cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:57.789294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95377834-f791-4102-acbe-21af567f92cd None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:57.796770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a064f-925f-46ba-91b0-e92fd9358d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:57.798401 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a064f-925f-46ba-91b0-e92fd9358d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:57.798745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a064f-925f-46ba-91b0-e92fd9358d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:57.799282 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a064f-925f-46ba-91b0-e92fd9358d5b admin admin] PATH_INFO: `/v3/users/7ab617208dae47eca850e4de563b12ad` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:57.801986 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a064f-925f-46ba-91b0-e92fd9358d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ab617208dae47eca850e4de563b12ad)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:57.805111 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a064f-925f-46ba-91b0-e92fd9358d5b admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:57.809762 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0d047-d1c2-4c53-a99c-47c35942684f admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:57.811668 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-e9b0d047-d1c2-4c53-a99c-47c35942684f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:57.913766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0d047-d1c2-4c53-a99c-47c35942684f admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:57.918338 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42a3fa-cb65-4feb-a5e7-4e4ec183e887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:57.919183 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42a3fa-cb65-4feb-a5e7-4e4ec183e887 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:57.919665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42a3fa-cb65-4feb-a5e7-4e4ec183e887 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:57.920088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42a3fa-cb65-4feb-a5e7-4e4ec183e887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:57.922218 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-be42a3fa-cb65-4feb-a5e7-4e4ec183e887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:57.936182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42a3fa-cb65-4feb-a5e7-4e4ec183e887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:57.937621 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42a3fa-cb65-4feb-a5e7-4e4ec183e887 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:57.948529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1016/2022] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:56:57.990547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42a3fa-cb65-4feb-a5e7-4e4ec183e887 service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:57.992265 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-be42a3fa-cb65-4feb-a5e7-4e4ec183e887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:58.013346 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42a3fa-cb65-4feb-a5e7-4e4ec183e887 service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:58.028339 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec38cb1-0582-4a12-adfe-2b5c9df94c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:58.029361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec38cb1-0582-4a12-adfe-2b5c9df94c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:58.030225 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec38cb1-0582-4a12-adfe-2b5c9df94c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:58.031308 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec38cb1-0582-4a12-adfe-2b5c9df94c77 admin admin] PATH_INFO: `/v3/projects/46088427fb514682b311db230fc8a60f` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:58.033728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec38cb1-0582-4a12-adfe-2b5c9df94c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46088427fb514682b311db230fc8a60f)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:58.041531 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec38cb1-0582-4a12-adfe-2b5c9df94c77 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:58.111261 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-bf7a064f-925f-46ba-91b0-e92fd9358d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ab617208dae47eca850e4de563b12ad'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:58.199426 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-bf7a064f-925f-46ba-91b0-e92fd9358d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ab617208dae47eca850e4de563b12ad'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:58.200560 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-bf7a064f-925f-46ba-91b0-e92fd9358d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ab617208dae47eca850e4de563b12ad'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:58.202871 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bec38cb1-0582-4a12-adfe-2b5c9df94c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46088427fb514682b311db230fc8a60f', 'request_id': 'req-bec38cb1-0582-4a12-adfe-2b5c9df94c77'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:58.212149 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-bf7a064f-925f-46ba-91b0-e92fd9358d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ab617208dae47eca850e4de563b12ad'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:58.229397 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-bf7a064f-925f-46ba-91b0-e92fd9358d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ab617208dae47eca850e4de563b12ad'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:58.237607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1007/2023] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:57 2022] DELETE /identity/v3/users/7ab617208dae47eca850e4de563b12ad => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:56:58.313634 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bec38cb1-0582-4a12-adfe-2b5c9df94c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46088427fb514682b311db230fc8a60f', 'request_id': 'req-bec38cb1-0582-4a12-adfe-2b5c9df94c77'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:58.324633 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bec38cb1-0582-4a12-adfe-2b5c9df94c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46088427fb514682b311db230fc8a60f', 'request_id': 'req-bec38cb1-0582-4a12-adfe-2b5c9df94c77'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:58.350271 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bec38cb1-0582-4a12-adfe-2b5c9df94c77 admin admin] The token cache is being invalidate because project 46088427fb514682b311db230fc8a60f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:58.352051 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bec38cb1-0582-4a12-adfe-2b5c9df94c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:58.352051 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bec38cb1-0582-4a12-adfe-2b5c9df94c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:58.356416 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1017/2024] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:57 2022] DELETE /identity/v3/projects/46088427fb514682b311db230fc8a60f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:56:58.362559 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44656934-ab2d-4594-a138-bae2f8a698e6 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:58.363420 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44656934-ab2d-4594-a138-bae2f8a698e6 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:58.364041 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44656934-ab2d-4594-a138-bae2f8a698e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:58.428426 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-44656934-ab2d-4594-a138-bae2f8a698e6 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:58.430559 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-44656934-ab2d-4594-a138-bae2f8a698e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:58.519476 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1008/2025] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:58.527943 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95619e7b-e16b-4e8b-b631-349f96f0e90f None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:58.528584 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95619e7b-e16b-4e8b-b631-349f96f0e90f None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:58.530712 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95619e7b-e16b-4e8b-b631-349f96f0e90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:58.557490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114fd42-bc92-45ed-ac7c-8bbe42527cac None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:58.558889 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114fd42-bc92-45ed-ac7c-8bbe42527cac None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:58.559172 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114fd42-bc92-45ed-ac7c-8bbe42527cac None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:58.560656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1009/2026] 10.222.0.15 () {54 vars in 921 bytes} [Wed Sep 14 19:56:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:56:58.561984 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-95619e7b-e16b-4e8b-b631-349f96f0e90f None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:58.563316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-95619e7b-e16b-4e8b-b631-349f96f0e90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:58.573333 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1018/2027] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:58.579643 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114fd42-bc92-45ed-ac7c-8bbe42527cac None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:58.586935 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2a8d9-0f71-4065-a49a-12c4c548000c None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:58.587428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2a8d9-0f71-4065-a49a-12c4c548000c None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:58.587957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2a8d9-0f71-4065-a49a-12c4c548000c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:58.606831 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114fd42-bc92-45ed-ac7c-8bbe42527cac None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:58.612626 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-a1f2a8d9-0f71-4065-a49a-12c4c548000c None None] MFA Rules not processed for user `6942a851a69b446e90a2b138f4482465`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:58.613453 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81ba6b-8f4d-4b82-b2da-e0464dd1a998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:58.614274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a1f2a8d9-0f71-4065-a49a-12c4c548000c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:58.614583 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81ba6b-8f4d-4b82-b2da-e0464dd1a998 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:58.615060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81ba6b-8f4d-4b82-b2da-e0464dd1a998 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:58.615506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81ba6b-8f4d-4b82-b2da-e0464dd1a998 admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:58.616358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81ba6b-8f4d-4b82-b2da-e0464dd1a998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:56:58.616849 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81ba6b-8f4d-4b82-b2da-e0464dd1a998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:58.618618 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81ba6b-8f4d-4b82-b2da-e0464dd1a998 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:58.632168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1010/2028] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:56:58.636568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81ba6b-8f4d-4b82-b2da-e0464dd1a998 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:58.648597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81ba6b-8f4d-4b82-b2da-e0464dd1a998 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:58.655854 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0803707-f3e9-48e2-a976-2b7fd81c9a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:58.656638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0803707-f3e9-48e2-a976-2b7fd81c9a0b admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:58.657006 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0803707-f3e9-48e2-a976-2b7fd81c9a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:58.657432 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0803707-f3e9-48e2-a976-2b7fd81c9a0b admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:58.658197 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0803707-f3e9-48e2-a976-2b7fd81c9a0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:58.661199 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0803707-f3e9-48e2-a976-2b7fd81c9a0b admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:58.694241 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1019/2029] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Sep 14 19:56:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:58.695413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2a8d9-0f71-4065-a49a-12c4c548000c None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:58.697310 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a1f2a8d9-0f71-4065-a49a-12c4c548000c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:58.719055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2a8d9-0f71-4065-a49a-12c4c548000c None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:58.724753 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75cbc9-a78c-4252-9a80-01d8cf271bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:58.725416 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75cbc9-a78c-4252-9a80-01d8cf271bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:58.725696 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75cbc9-a78c-4252-9a80-01d8cf271bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:58.729193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75cbc9-a78c-4252-9a80-01d8cf271bfc admin admin] PATH_INFO: `/v3/projects/90fc63bb0a5f416287d384d26e471412` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:58.730374 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75cbc9-a78c-4252-9a80-01d8cf271bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=90fc63bb0a5f416287d384d26e471412)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:58.732380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75cbc9-a78c-4252-9a80-01d8cf271bfc admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:58.799443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1011/2030] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:56:58 2022] POST /identity/v3/projects => generated 361 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:58.801929 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f7cc4-4955-4d55-b638-60d893a159b6 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:58.802749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f7cc4-4955-4d55-b638-60d893a159b6 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:58.802749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f7cc4-4955-4d55-b638-60d893a159b6 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:58.805463 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1012/2031] 10.222.0.15 () {54 vars in 961 bytes} [Wed Sep 14 19:56:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:56:58.806419 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f7cc4-4955-4d55-b638-60d893a159b6 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:58.809909 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-a52f7cc4-4955-4d55-b638-60d893a159b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:58.883626 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-7b75cbc9-a78c-4252-9a80-01d8cf271bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90fc63bb0a5f416287d384d26e471412', 'request_id': 'req-7b75cbc9-a78c-4252-9a80-01d8cf271bfc'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:58.885560 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f7cc4-4955-4d55-b638-60d893a159b6 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:58.950697 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e14ac-6366-4b74-b3e3-8c7c7fd71810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:58.951393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e14ac-6366-4b74-b3e3-8c7c7fd71810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:58.951862 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e14ac-6366-4b74-b3e3-8c7c7fd71810 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:58.952138 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e14ac-6366-4b74-b3e3-8c7c7fd71810 admin admin] PATH_INFO: `/v3/users/3725a8878d78434eb7d94fb413ba8078` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:58.958309 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e14ac-6366-4b74-b3e3-8c7c7fd71810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3725a8878d78434eb7d94fb413ba8078)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:58.958309 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e14ac-6366-4b74-b3e3-8c7c7fd71810 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:58.990235 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-7b75cbc9-a78c-4252-9a80-01d8cf271bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90fc63bb0a5f416287d384d26e471412', 'request_id': 'req-7b75cbc9-a78c-4252-9a80-01d8cf271bfc'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:58.998938 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-7b75cbc9-a78c-4252-9a80-01d8cf271bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90fc63bb0a5f416287d384d26e471412', 'request_id': 'req-7b75cbc9-a78c-4252-9a80-01d8cf271bfc'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:59.015920 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-7b75cbc9-a78c-4252-9a80-01d8cf271bfc admin admin] The token cache is being invalidate because project 90fc63bb0a5f416287d384d26e471412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:59.016279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-7b75cbc9-a78c-4252-9a80-01d8cf271bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:59.016984 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-7b75cbc9-a78c-4252-9a80-01d8cf271bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:59.018533 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1020/2032] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:58 2022] DELETE /identity/v3/projects/90fc63bb0a5f416287d384d26e471412 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:59.020369 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75cbc9-a78c-4252-9a80-01d8cf271bfc admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:59.021793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-7b75cbc9-a78c-4252-9a80-01d8cf271bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:59.038274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75cbc9-a78c-4252-9a80-01d8cf271bfc admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:59.040239 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe99de-e184-4d95-9ea3-d2db2c0f2ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:59.040856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe99de-e184-4d95-9ea3-d2db2c0f2ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:59.041134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe99de-e184-4d95-9ea3-d2db2c0f2ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:59.041428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe99de-e184-4d95-9ea3-d2db2c0f2ea5 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:59.042057 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe99de-e184-4d95-9ea3-d2db2c0f2ea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:59.044005 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe99de-e184-4d95-9ea3-d2db2c0f2ea5 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:59.136594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1021/2033] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:56:59 2022] POST /identity/v3/users => generated 281 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:56:59.136594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260e397-7eeb-4943-9ced-e3d6565ac01c None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:59.136594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260e397-7eeb-4943-9ced-e3d6565ac01c None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:59.136594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260e397-7eeb-4943-9ced-e3d6565ac01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:59.156407 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-b260e397-7eeb-4943-9ced-e3d6565ac01c None None] MFA Rules not processed for user `6942a851a69b446e90a2b138f4482465`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:59.157640 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-b260e397-7eeb-4943-9ced-e3d6565ac01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:59.225372 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1022/2034] 10.222.0.15 () {58 vars in 1058 bytes} [Wed Sep 14 19:56:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:56:59.229150 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260e397-7eeb-4943-9ced-e3d6565ac01c None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:59.231625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-b260e397-7eeb-4943-9ced-e3d6565ac01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:59.238802 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-bb7e14ac-6366-4b74-b3e3-8c7c7fd71810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3725a8878d78434eb7d94fb413ba8078'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:59.248589 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260e397-7eeb-4943-9ced-e3d6565ac01c None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:59.253303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc18c0-c73a-476d-9447-9612ce0126ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:59.258084 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc18c0-c73a-476d-9447-9612ce0126ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:59.258084 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc18c0-c73a-476d-9447-9612ce0126ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:59.258084 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc18c0-c73a-476d-9447-9612ce0126ad admin admin] PATH_INFO: `/v3/projects/f6e91ae8a64a4fa3a91bbf529a5f331d` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:59.258084 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc18c0-c73a-476d-9447-9612ce0126ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e91ae8a64a4fa3a91bbf529a5f331d)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:59.258084 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc18c0-c73a-476d-9447-9612ce0126ad admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:59.448881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-bb7e14ac-6366-4b74-b3e3-8c7c7fd71810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3725a8878d78434eb7d94fb413ba8078'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:59.449467 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-bb7e14ac-6366-4b74-b3e3-8c7c7fd71810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3725a8878d78434eb7d94fb413ba8078'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:59.457562 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-bb7e14ac-6366-4b74-b3e3-8c7c7fd71810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3725a8878d78434eb7d94fb413ba8078'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:59.469151 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-bb7e14ac-6366-4b74-b3e3-8c7c7fd71810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3725a8878d78434eb7d94fb413ba8078'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:59.475609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1013/2035] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:58 2022] DELETE /identity/v3/users/3725a8878d78434eb7d94fb413ba8078 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:59.476436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e14ac-6366-4b74-b3e3-8c7c7fd71810 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:59.504672 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-bb7e14ac-6366-4b74-b3e3-8c7c7fd71810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:59.544703 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e14ac-6366-4b74-b3e3-8c7c7fd71810 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:59.555258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627029a-526f-4d1b-bbbf-8f8ea3719eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:59.555962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627029a-526f-4d1b-bbbf-8f8ea3719eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:59.566769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627029a-526f-4d1b-bbbf-8f8ea3719eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:59.566769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627029a-526f-4d1b-bbbf-8f8ea3719eaf admin admin] PATH_INFO: `/v3/users/3f003e2b222f4e1d87d16fcc985d0910` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:59.566769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627029a-526f-4d1b-bbbf-8f8ea3719eaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f003e2b222f4e1d87d16fcc985d0910)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:59.566769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627029a-526f-4d1b-bbbf-8f8ea3719eaf admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:59.567163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-f5dc18c0-c73a-476d-9447-9612ce0126ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e91ae8a64a4fa3a91bbf529a5f331d', 'request_id': 'req-f5dc18c0-c73a-476d-9447-9612ce0126ad'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:59.702166 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-f5dc18c0-c73a-476d-9447-9612ce0126ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e91ae8a64a4fa3a91bbf529a5f331d', 'request_id': 'req-f5dc18c0-c73a-476d-9447-9612ce0126ad'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:59.709397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-f5dc18c0-c73a-476d-9447-9612ce0126ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e91ae8a64a4fa3a91bbf529a5f331d', 'request_id': 'req-f5dc18c0-c73a-476d-9447-9612ce0126ad'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:59.730413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-f5dc18c0-c73a-476d-9447-9612ce0126ad admin admin] The token cache is being invalidate because project f6e91ae8a64a4fa3a91bbf529a5f331d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:56:59.733719 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-f5dc18c0-c73a-476d-9447-9612ce0126ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:59.733719 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-f5dc18c0-c73a-476d-9447-9612ce0126ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:59.733719 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1023/2036] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:56:59 2022] DELETE /identity/v3/projects/f6e91ae8a64a4fa3a91bbf529a5f331d => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:59.733969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc18c0-c73a-476d-9447-9612ce0126ad admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:59.735166 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f5dc18c0-c73a-476d-9447-9612ce0126ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:59.799636 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-1627029a-526f-4d1b-bbbf-8f8ea3719eaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f003e2b222f4e1d87d16fcc985d0910'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:59.801976 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc18c0-c73a-476d-9447-9612ce0126ad admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:59.806940 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992394e2-f116-4c7a-9c96-edf8e6538591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:59.807845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992394e2-f116-4c7a-9c96-edf8e6538591 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:59.808123 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992394e2-f116-4c7a-9c96-edf8e6538591 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:59.808390 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992394e2-f116-4c7a-9c96-edf8e6538591 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:59.809036 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992394e2-f116-4c7a-9c96-edf8e6538591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:59.810678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992394e2-f116-4c7a-9c96-edf8e6538591 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:59.821563 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1024/2037] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:56:59.822375 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992394e2-f116-4c7a-9c96-edf8e6538591 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:59.824106 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-992394e2-f116-4c7a-9c96-edf8e6538591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:59.876744 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:59.894562 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992394e2-f116-4c7a-9c96-edf8e6538591 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:59.899895 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cdcbd-5b40-4ed2-93f2-15ca4d4a7a93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6942a851a69b446e90a2b138f4482465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:59.900587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cdcbd-5b40-4ed2-93f2-15ca4d4a7a93 service placement] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:59.901131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cdcbd-5b40-4ed2-93f2-15ca4d4a7a93 service placement] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:59.901409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cdcbd-5b40-4ed2-93f2-15ca4d4a7a93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:59.903156 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-b21cdcbd-5b40-4ed2-93f2-15ca4d4a7a93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:59.907873 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-1627029a-526f-4d1b-bbbf-8f8ea3719eaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f003e2b222f4e1d87d16fcc985d0910'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:59.908437 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-1627029a-526f-4d1b-bbbf-8f8ea3719eaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f003e2b222f4e1d87d16fcc985d0910'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:59.914817 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21cdcbd-5b40-4ed2-93f2-15ca4d4a7a93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:59.916436 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21cdcbd-5b40-4ed2-93f2-15ca4d4a7a93 service placement] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:59.919410 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-1627029a-526f-4d1b-bbbf-8f8ea3719eaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f003e2b222f4e1d87d16fcc985d0910'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:59.928251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1025/2038] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:56:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:56:59.928974 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cdcbd-5b40-4ed2-93f2-15ca4d4a7a93 service placement] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:56:59.930317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-b21cdcbd-5b40-4ed2-93f2-15ca4d4a7a93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:56:59.947655 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cdcbd-5b40-4ed2-93f2-15ca4d4a7a93 service placement] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:56:59.947799 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-1627029a-526f-4d1b-bbbf-8f8ea3719eaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f003e2b222f4e1d87d16fcc985d0910'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:56:59.953370 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2721b-aa3e-40b4-8107-cb60df865af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:56:59.954029 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2721b-aa3e-40b4-8107-cb60df865af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:59.954300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2721b-aa3e-40b4-8107-cb60df865af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:59.954573 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2721b-aa3e-40b4-8107-cb60df865af4 admin admin] PATH_INFO: `/v3/users/d264df353eb349bc8ee37ec70d35e34a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:59.955849 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1014/2039] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:59 2022] DELETE /identity/v3/users/3f003e2b222f4e1d87d16fcc985d0910 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:56:59.958264 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b00829-c5aa-49f0-82a9-e70b36871b39 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:56:59.958610 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b00829-c5aa-49f0-82a9-e70b36871b39 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:56:59.958948 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b00829-c5aa-49f0-82a9-e70b36871b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:56:59.959290 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2721b-aa3e-40b4-8107-cb60df865af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d264df353eb349bc8ee37ec70d35e34a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:56:59.961581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2721b-aa3e-40b4-8107-cb60df865af4 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:56:59.981171 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-e9b00829-c5aa-49f0-82a9-e70b36871b39 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:56:59.982586 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e9b00829-c5aa-49f0-82a9-e70b36871b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:00.050259 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1015/2040] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:00.051385 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b00829-c5aa-49f0-82a9-e70b36871b39 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:00.053009 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e9b00829-c5aa-49f0-82a9-e70b36871b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:00.066031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b00829-c5aa-49f0-82a9-e70b36871b39 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:00.070860 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37082de0-245c-4ebc-bd24-77fa0771cdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:00.071475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37082de0-245c-4ebc-bd24-77fa0771cdaa admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:00.071791 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37082de0-245c-4ebc-bd24-77fa0771cdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:00.072070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37082de0-245c-4ebc-bd24-77fa0771cdaa admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:00.072718 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37082de0-245c-4ebc-bd24-77fa0771cdaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:00.074324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37082de0-245c-4ebc-bd24-77fa0771cdaa admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:00.085821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1016/2041] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:00.086804 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37082de0-245c-4ebc-bd24-77fa0771cdaa admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:00.088557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-37082de0-245c-4ebc-bd24-77fa0771cdaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:00.102339 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37082de0-245c-4ebc-bd24-77fa0771cdaa admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:00.107707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c52668-a46f-443a-8a93-ebb4cd817449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:00.108318 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c52668-a46f-443a-8a93-ebb4cd817449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:00.108594 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c52668-a46f-443a-8a93-ebb4cd817449 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:00.108863 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c52668-a46f-443a-8a93-ebb4cd817449 admin admin] PATH_INFO: `/v3/projects/765bf146aae44c958e81386b67c3afa3` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:00.109981 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c52668-a46f-443a-8a93-ebb4cd817449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=765bf146aae44c958e81386b67c3afa3)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:00.112077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c52668-a46f-443a-8a93-ebb4cd817449 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:00.190231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-81c2721b-aa3e-40b4-8107-cb60df865af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd264df353eb349bc8ee37ec70d35e34a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:00.237202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b9c52668-a46f-443a-8a93-ebb4cd817449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765bf146aae44c958e81386b67c3afa3', 'request_id': 'req-b9c52668-a46f-443a-8a93-ebb4cd817449'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:00.269454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-81c2721b-aa3e-40b4-8107-cb60df865af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd264df353eb349bc8ee37ec70d35e34a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:00.270815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-81c2721b-aa3e-40b4-8107-cb60df865af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd264df353eb349bc8ee37ec70d35e34a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:00.289153 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-81c2721b-aa3e-40b4-8107-cb60df865af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd264df353eb349bc8ee37ec70d35e34a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:00.296954 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-81c2721b-aa3e-40b4-8107-cb60df865af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd264df353eb349bc8ee37ec70d35e34a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:00.298791 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:00.303705 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1026/2042] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:56:59 2022] DELETE /identity/v3/users/d264df353eb349bc8ee37ec70d35e34a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:00.305039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc40b64-052f-4d23-9cf4-baa32ba5a6a8 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:00.305484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc40b64-052f-4d23-9cf4-baa32ba5a6a8 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:00.305767 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc40b64-052f-4d23-9cf4-baa32ba5a6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:00.326922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-9cc40b64-052f-4d23-9cf4-baa32ba5a6a8 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:00.328178 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-9cc40b64-052f-4d23-9cf4-baa32ba5a6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:00.336119 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b9c52668-a46f-443a-8a93-ebb4cd817449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765bf146aae44c958e81386b67c3afa3', 'request_id': 'req-b9c52668-a46f-443a-8a93-ebb4cd817449'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:00.344286 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b9c52668-a46f-443a-8a93-ebb4cd817449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765bf146aae44c958e81386b67c3afa3', 'request_id': 'req-b9c52668-a46f-443a-8a93-ebb4cd817449'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:00.358564 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b9c52668-a46f-443a-8a93-ebb4cd817449 admin admin] The token cache is being invalidate because project 765bf146aae44c958e81386b67c3afa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:00.358862 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b9c52668-a46f-443a-8a93-ebb4cd817449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:00.359576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b9c52668-a46f-443a-8a93-ebb4cd817449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:00.365602 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1017/2043] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:00 2022] DELETE /identity/v3/projects/765bf146aae44c958e81386b67c3afa3 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:00.383476 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c52668-a46f-443a-8a93-ebb4cd817449 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:00.384839 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b9c52668-a46f-443a-8a93-ebb4cd817449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:00.422159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1027/2044] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:00.423332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69e1e9-1cff-4b61-b5cf-c1f2fa7af91c None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:00.423649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69e1e9-1cff-4b61-b5cf-c1f2fa7af91c None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:00.423923 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69e1e9-1cff-4b61-b5cf-c1f2fa7af91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:00.446656 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-4e69e1e9-1cff-4b61-b5cf-c1f2fa7af91c None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:00.447902 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4e69e1e9-1cff-4b61-b5cf-c1f2fa7af91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:00.456835 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1028/2045] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:00.458730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52dc60-3971-4950-867a-d518f3476c58 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:00.459017 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52dc60-3971-4950-867a-d518f3476c58 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:00.459423 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52dc60-3971-4950-867a-d518f3476c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:00.489754 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-4c52dc60-3971-4950-867a-d518f3476c58 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:00.490407 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c52668-a46f-443a-8a93-ebb4cd817449 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:00.490886 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4c52dc60-3971-4950-867a-d518f3476c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:00.495609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996aad56-138c-4025-a773-13b353789618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:00.496334 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996aad56-138c-4025-a773-13b353789618 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:00.496610 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996aad56-138c-4025-a773-13b353789618 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:00.497352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996aad56-138c-4025-a773-13b353789618 admin admin] PATH_INFO: `/v3/projects/fdb4cb1314464f7383658d030fcb7c77/users/7e46cb485a504375b9b36334272f8f53/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:00.508880 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1029/2046] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:00.510389 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52dc60-3971-4950-867a-d518f3476c58 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:00.521358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996aad56-138c-4025-a773-13b353789618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb4cb1314464f7383658d030fcb7c77, user_id=7e46cb485a504375b9b36334272f8f53, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:00.522461 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52dc60-3971-4950-867a-d518f3476c58 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:00.525297 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996aad56-138c-4025-a773-13b353789618 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:00.527261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf71f41-999a-4b2f-b2ad-2fc1f51ca8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:00.527902 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf71f41-999a-4b2f-b2ad-2fc1f51ca8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:00.528186 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf71f41-999a-4b2f-b2ad-2fc1f51ca8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:00.528460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf71f41-999a-4b2f-b2ad-2fc1f51ca8c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:00.529163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf71f41-999a-4b2f-b2ad-2fc1f51ca8c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:57:00.529496 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf71f41-999a-4b2f-b2ad-2fc1f51ca8c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:00.531145 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf71f41-999a-4b2f-b2ad-2fc1f51ca8c1 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:00.547573 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1030/2047] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:57:00.547573 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf71f41-999a-4b2f-b2ad-2fc1f51ca8c1 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:00.548153 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-edf71f41-999a-4b2f-b2ad-2fc1f51ca8c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:00.607407 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf71f41-999a-4b2f-b2ad-2fc1f51ca8c1 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:00.611408 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ff6e7-a913-411a-a1e0-1c115b6098a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:00.612057 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ff6e7-a913-411a-a1e0-1c115b6098a7 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:00.612339 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ff6e7-a913-411a-a1e0-1c115b6098a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:00.612750 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ff6e7-a913-411a-a1e0-1c115b6098a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:00.622690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ff6e7-a913-411a-a1e0-1c115b6098a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:00.624158 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ff6e7-a913-411a-a1e0-1c115b6098a7 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:00.634302 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1031/2048] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:00.635201 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ff6e7-a913-411a-a1e0-1c115b6098a7 service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:00.636407 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1018/2049] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:00 2022] PUT /identity/v3/projects/fdb4cb1314464f7383658d030fcb7c77/users/7e46cb485a504375b9b36334272f8f53/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:00.636831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-907ff6e7-a913-411a-a1e0-1c115b6098a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:00.638100 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc6a35-7f8f-45b5-9bbd-84503692357c None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:00.638441 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc6a35-7f8f-45b5-9bbd-84503692357c None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:00.638656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc6a35-7f8f-45b5-9bbd-84503692357c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:00.651844 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ff6e7-a913-411a-a1e0-1c115b6098a7 service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:00.660620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-5cfc6a35-7f8f-45b5-9bbd-84503692357c None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:00.662722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-5cfc6a35-7f8f-45b5-9bbd-84503692357c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:00.720624 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52b284-c0f0-48ff-8a2b-ddd4b7f945ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:00.721580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52b284-c0f0-48ff-8a2b-ddd4b7f945ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:00.721762 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52b284-c0f0-48ff-8a2b-ddd4b7f945ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:00.722893 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52b284-c0f0-48ff-8a2b-ddd4b7f945ba admin admin] PATH_INFO: `/v3/projects/475595b7809d413caae586200785509e` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:00.724352 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52b284-c0f0-48ff-8a2b-ddd4b7f945ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=475595b7809d413caae586200785509e)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:00.726418 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52b284-c0f0-48ff-8a2b-ddd4b7f945ba admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:00.737096 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1019/2050] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:00.738953 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc6a35-7f8f-45b5-9bbd-84503692357c None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:00.751385 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc6a35-7f8f-45b5-9bbd-84503692357c None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:00.756832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb54543-69eb-48bb-ae2b-62b6fd47c735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:00.757451 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb54543-69eb-48bb-ae2b-62b6fd47c735 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:00.757728 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb54543-69eb-48bb-ae2b-62b6fd47c735 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:00.757999 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb54543-69eb-48bb-ae2b-62b6fd47c735 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:00.758637 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb54543-69eb-48bb-ae2b-62b6fd47c735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:00.760580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb54543-69eb-48bb-ae2b-62b6fd47c735 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:00.847408 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bc52b284-c0f0-48ff-8a2b-ddd4b7f945ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '475595b7809d413caae586200785509e', 'request_id': 'req-bc52b284-c0f0-48ff-8a2b-ddd4b7f945ba'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:00.896800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1020/2051] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:00 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:00.896800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401f339-6b52-4005-9fa5-ef29c66b999d None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:00.896800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401f339-6b52-4005-9fa5-ef29c66b999d None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:00.896800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401f339-6b52-4005-9fa5-ef29c66b999d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:00.923818 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-f401f339-6b52-4005-9fa5-ef29c66b999d None None] MFA Rules not processed for user `7e46cb485a504375b9b36334272f8f53`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:00.925073 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f401f339-6b52-4005-9fa5-ef29c66b999d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:00.994345 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1021/2052] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:00.998770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401f339-6b52-4005-9fa5-ef29c66b999d None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:01.035652 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bc52b284-c0f0-48ff-8a2b-ddd4b7f945ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '475595b7809d413caae586200785509e', 'request_id': 'req-bc52b284-c0f0-48ff-8a2b-ddd4b7f945ba'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:01.036689 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bc52b284-c0f0-48ff-8a2b-ddd4b7f945ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '475595b7809d413caae586200785509e', 'request_id': 'req-bc52b284-c0f0-48ff-8a2b-ddd4b7f945ba'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:01.050107 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bc52b284-c0f0-48ff-8a2b-ddd4b7f945ba admin admin] The token cache is being invalidate because project 475595b7809d413caae586200785509e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:01.050594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bc52b284-c0f0-48ff-8a2b-ddd4b7f945ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:01.051320 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bc52b284-c0f0-48ff-8a2b-ddd4b7f945ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:01.053092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1032/2053] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:00 2022] DELETE /identity/v3/projects/475595b7809d413caae586200785509e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:01.056457 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52b284-c0f0-48ff-8a2b-ddd4b7f945ba admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:01.056457 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-bc52b284-c0f0-48ff-8a2b-ddd4b7f945ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:01.062358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401f339-6b52-4005-9fa5-ef29c66b999d None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:01.067059 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791492a3-7c13-4c2f-b74c-bc0b831743ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:01.067700 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791492a3-7c13-4c2f-b74c-bc0b831743ac admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:01.067980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791492a3-7c13-4c2f-b74c-bc0b831743ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:01.068251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791492a3-7c13-4c2f-b74c-bc0b831743ac admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:01.068900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791492a3-7c13-4c2f-b74c-bc0b831743ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:57:01.069203 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791492a3-7c13-4c2f-b74c-bc0b831743ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:01.070789 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791492a3-7c13-4c2f-b74c-bc0b831743ac admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:01.082909 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1022/2054] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:57:01.083766 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791492a3-7c13-4c2f-b74c-bc0b831743ac admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:01.085436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-791492a3-7c13-4c2f-b74c-bc0b831743ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:01.124871 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52b284-c0f0-48ff-8a2b-ddd4b7f945ba admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:01.130706 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28769e0-3ae9-4e10-89cd-c89bcdd2a972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:01.131331 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28769e0-3ae9-4e10-89cd-c89bcdd2a972 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:01.135823 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28769e0-3ae9-4e10-89cd-c89bcdd2a972 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:01.135823 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28769e0-3ae9-4e10-89cd-c89bcdd2a972 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:01.135823 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28769e0-3ae9-4e10-89cd-c89bcdd2a972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:01.135823 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28769e0-3ae9-4e10-89cd-c89bcdd2a972 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:01.144660 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791492a3-7c13-4c2f-b74c-bc0b831743ac admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:01.148386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcbce1a-ae4f-4a97-8e89-6ce3dd13085b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:01.148983 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbce1a-ae4f-4a97-8e89-6ce3dd13085b service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:01.149257 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbce1a-ae4f-4a97-8e89-6ce3dd13085b service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:01.149526 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbce1a-ae4f-4a97-8e89-6ce3dd13085b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:01.151267 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ffcbce1a-ae4f-4a97-8e89-6ce3dd13085b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:01.163188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbce1a-ae4f-4a97-8e89-6ce3dd13085b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:01.164728 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbce1a-ae4f-4a97-8e89-6ce3dd13085b service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:01.176455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1023/2055] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:01.176455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ab396-8504-45a8-8ce0-944e79219be2 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:01.176455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ab396-8504-45a8-8ce0-944e79219be2 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:01.176455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ab396-8504-45a8-8ce0-944e79219be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:01.209695 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-e93ab396-8504-45a8-8ce0-944e79219be2 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:01.211759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e93ab396-8504-45a8-8ce0-944e79219be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:01.222543 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1024/2056] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:01.223558 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ab396-8504-45a8-8ce0-944e79219be2 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:01.225827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e93ab396-8504-45a8-8ce0-944e79219be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:01.239991 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ab396-8504-45a8-8ce0-944e79219be2 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:01.244904 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a72f61-822d-4b97-8aaf-45e784e2fbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:01.245548 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a72f61-822d-4b97-8aaf-45e784e2fbd9 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:01.245822 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a72f61-822d-4b97-8aaf-45e784e2fbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:01.246094 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a72f61-822d-4b97-8aaf-45e784e2fbd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:01.246734 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a72f61-822d-4b97-8aaf-45e784e2fbd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:01.248690 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a72f61-822d-4b97-8aaf-45e784e2fbd9 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:01.291124 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1033/2057] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:01 2022] POST /identity/v3/users => generated 292 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:01.292317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28769e0-3ae9-4e10-89cd-c89bcdd2a972 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:01.294950 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-b28769e0-3ae9-4e10-89cd-c89bcdd2a972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:01.309571 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28769e0-3ae9-4e10-89cd-c89bcdd2a972 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:01.314306 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f5d6b-b100-4f24-9817-996655f5727d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:01.314937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f5d6b-b100-4f24-9817-996655f5727d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:01.315214 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f5d6b-b100-4f24-9817-996655f5727d admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:01.315481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f5d6b-b100-4f24-9817-996655f5727d admin admin] PATH_INFO: `/v3/projects/e2e9ca5cf4924203bb9c2e468c6e3d0d` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:01.316756 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f5d6b-b100-4f24-9817-996655f5727d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2e9ca5cf4924203bb9c2e468c6e3d0d)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:01.318646 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f5d6b-b100-4f24-9817-996655f5727d admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:01.403014 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1025/2058] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:01 2022] POST /identity/v3/projects => generated 393 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:01.403014 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e343fc-5078-45b6-8618-eb3a854e130e None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:01.403014 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e343fc-5078-45b6-8618-eb3a854e130e None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:01.403014 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e343fc-5078-45b6-8618-eb3a854e130e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:01.422400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-90e343fc-5078-45b6-8618-eb3a854e130e None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:01.423640 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-90e343fc-5078-45b6-8618-eb3a854e130e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:01.460533 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-163f5d6b-b100-4f24-9817-996655f5727d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e9ca5cf4924203bb9c2e468c6e3d0d', 'request_id': 'req-163f5d6b-b100-4f24-9817-996655f5727d'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:01.486339 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1026/2059] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:01.487350 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e343fc-5078-45b6-8618-eb3a854e130e None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:01.499699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e343fc-5078-45b6-8618-eb3a854e130e None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:01.553780 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-163f5d6b-b100-4f24-9817-996655f5727d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e9ca5cf4924203bb9c2e468c6e3d0d', 'request_id': 'req-163f5d6b-b100-4f24-9817-996655f5727d'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:01.562858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-163f5d6b-b100-4f24-9817-996655f5727d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e9ca5cf4924203bb9c2e468c6e3d0d', 'request_id': 'req-163f5d6b-b100-4f24-9817-996655f5727d'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:01.565013 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dd01d-7eed-4e93-878c-ae43ad3f1c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:01.566049 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dd01d-7eed-4e93-878c-ae43ad3f1c8d admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:01.566432 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dd01d-7eed-4e93-878c-ae43ad3f1c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:01.566806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dd01d-7eed-4e93-878c-ae43ad3f1c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:01.570016 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7dd01d-7eed-4e93-878c-ae43ad3f1c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:01.573249 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7dd01d-7eed-4e93-878c-ae43ad3f1c8d admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:01.581182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-163f5d6b-b100-4f24-9817-996655f5727d admin admin] The token cache is being invalidate because project e2e9ca5cf4924203bb9c2e468c6e3d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:01.582922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-163f5d6b-b100-4f24-9817-996655f5727d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:01.584218 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-163f5d6b-b100-4f24-9817-996655f5727d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:01.592206 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1034/2060] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:01 2022] DELETE /identity/v3/projects/e2e9ca5cf4924203bb9c2e468c6e3d0d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:01.592206 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f5d6b-b100-4f24-9817-996655f5727d admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:01.592409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1027/2061] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:01.592409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dd01d-7eed-4e93-878c-ae43ad3f1c8d admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:01.592409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-2a7dd01d-7eed-4e93-878c-ae43ad3f1c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:01.592665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-163f5d6b-b100-4f24-9817-996655f5727d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:01.605054 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dd01d-7eed-4e93-878c-ae43ad3f1c8d admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:01.607415 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f5d6b-b100-4f24-9817-996655f5727d admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:01.610182 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbfd7d-21ee-4343-9e3f-3fa5fe195e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:01.610797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbfd7d-21ee-4343-9e3f-3fa5fe195e25 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:01.611080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbfd7d-21ee-4343-9e3f-3fa5fe195e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:01.611357 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbfd7d-21ee-4343-9e3f-3fa5fe195e25 admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:01.612030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbfd7d-21ee-4343-9e3f-3fa5fe195e25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:57:01.612351 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbfd7d-21ee-4343-9e3f-3fa5fe195e25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:01.612855 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a39f40-0cd3-4aba-9c53-5bcf2f5597b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:01.613705 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a39f40-0cd3-4aba-9c53-5bcf2f5597b2 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:01.614069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a39f40-0cd3-4aba-9c53-5bcf2f5597b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:01.614301 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbfd7d-21ee-4343-9e3f-3fa5fe195e25 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:01.614653 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a39f40-0cd3-4aba-9c53-5bcf2f5597b2 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:01.615358 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a39f40-0cd3-4aba-9c53-5bcf2f5597b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:01.617679 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a39f40-0cd3-4aba-9c53-5bcf2f5597b2 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:01.631574 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1028/2062] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:57:01.632673 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbfd7d-21ee-4343-9e3f-3fa5fe195e25 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:01.634916 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3ffbfd7d-21ee-4343-9e3f-3fa5fe195e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:01.650351 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbfd7d-21ee-4343-9e3f-3fa5fe195e25 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:01.655418 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ab46f-a160-4940-b129-e8aea133d15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:01.656123 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ab46f-a160-4940-b129-e8aea133d15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:01.656404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ab46f-a160-4940-b129-e8aea133d15c admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:01.656677 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ab46f-a160-4940-b129-e8aea133d15c admin admin] PATH_INFO: `/v3/users/05300b4ca44344dd8fe8c05d4ebd7bc1` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:01.657886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ab46f-a160-4940-b129-e8aea133d15c admin admin] RBAC: Authorizing `identity:delete_user(user_id=05300b4ca44344dd8fe8c05d4ebd7bc1)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:01.660627 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ab46f-a160-4940-b129-e8aea133d15c admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:01.725397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1035/2063] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:01 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:01.725397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a39f40-0cd3-4aba-9c53-5bcf2f5597b2 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:01.725397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-47a39f40-0cd3-4aba-9c53-5bcf2f5597b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:01.737475 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a39f40-0cd3-4aba-9c53-5bcf2f5597b2 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:01.742577 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34fc17-634b-47b2-a00d-889466b440d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:01.743189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34fc17-634b-47b2-a00d-889466b440d8 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:01.743462 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34fc17-634b-47b2-a00d-889466b440d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:01.743766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34fc17-634b-47b2-a00d-889466b440d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:01.744407 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34fc17-634b-47b2-a00d-889466b440d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:01.745977 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34fc17-634b-47b2-a00d-889466b440d8 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:01.757414 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1036/2064] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:01.758010 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34fc17-634b-47b2-a00d-889466b440d8 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:01.768173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34fc17-634b-47b2-a00d-889466b440d8 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:01.773532 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d975475-403f-44c0-a383-615cb3c97120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:01.774126 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d975475-403f-44c0-a383-615cb3c97120 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:01.776306 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d975475-403f-44c0-a383-615cb3c97120 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:01.776306 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d975475-403f-44c0-a383-615cb3c97120 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:01.776306 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d975475-403f-44c0-a383-615cb3c97120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:01.777278 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d975475-403f-44c0-a383-615cb3c97120 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:01.863432 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1037/2065] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:01 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:01.864434 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d975475-403f-44c0-a383-615cb3c97120 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:01.925235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f61ab46f-a160-4940-b129-e8aea133d15c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05300b4ca44344dd8fe8c05d4ebd7bc1'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:01.927361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d975475-403f-44c0-a383-615cb3c97120 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:01.932254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa5b53-9782-4e36-8d3d-f96d4957a840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:01.932876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa5b53-9782-4e36-8d3d-f96d4957a840 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:01.933185 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa5b53-9782-4e36-8d3d-f96d4957a840 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:01.933459 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa5b53-9782-4e36-8d3d-f96d4957a840 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:01.934130 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa5b53-9782-4e36-8d3d-f96d4957a840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:01.935839 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa5b53-9782-4e36-8d3d-f96d4957a840 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:01.951518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1038/2066] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:01.952575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa5b53-9782-4e36-8d3d-f96d4957a840 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:01.963365 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa5b53-9782-4e36-8d3d-f96d4957a840 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:01.968315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45178527-a619-4347-86a7-b1537a9a9f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:01.968948 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45178527-a619-4347-86a7-b1537a9a9f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:01.969237 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45178527-a619-4347-86a7-b1537a9a9f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:01.969521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45178527-a619-4347-86a7-b1537a9a9f6d admin admin] PATH_INFO: `/v3/projects/397fb21e56ec4d91a3524463ae6ffa7f/users/6796773e4eda4141a0952dbbcd37616a/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:01.984693 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45178527-a619-4347-86a7-b1537a9a9f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=397fb21e56ec4d91a3524463ae6ffa7f, user_id=6796773e4eda4141a0952dbbcd37616a, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:01.987398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45178527-a619-4347-86a7-b1537a9a9f6d admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:02.126997 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f61ab46f-a160-4940-b129-e8aea133d15c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05300b4ca44344dd8fe8c05d4ebd7bc1'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:02.127658 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f61ab46f-a160-4940-b129-e8aea133d15c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05300b4ca44344dd8fe8c05d4ebd7bc1'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:02.135966 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f61ab46f-a160-4940-b129-e8aea133d15c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05300b4ca44344dd8fe8c05d4ebd7bc1'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:02.149318 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f61ab46f-a160-4940-b129-e8aea133d15c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05300b4ca44344dd8fe8c05d4ebd7bc1'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:02.155273 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1029/2067] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:57:01 2022] DELETE /identity/v3/users/05300b4ca44344dd8fe8c05d4ebd7bc1 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:02.156072 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ab46f-a160-4940-b129-e8aea133d15c admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:02.157395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f61ab46f-a160-4940-b129-e8aea133d15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:02.194624 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:02.208893 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1039/2068] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:01 2022] PUT /identity/v3/projects/397fb21e56ec4d91a3524463ae6ffa7f/users/6796773e4eda4141a0952dbbcd37616a/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:02.209915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45178527-a619-4347-86a7-b1537a9a9f6d admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:02.212875 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-45178527-a619-4347-86a7-b1537a9a9f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:02.230999 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ab46f-a160-4940-b129-e8aea133d15c admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:02.299083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45178527-a619-4347-86a7-b1537a9a9f6d admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:02.304645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d05dc5-bf6d-440f-8793-ba2e2d6e9330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:02.305383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d05dc5-bf6d-440f-8793-ba2e2d6e9330 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:02.305667 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d05dc5-bf6d-440f-8793-ba2e2d6e9330 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:02.308801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d05dc5-bf6d-440f-8793-ba2e2d6e9330 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:02.308801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d05dc5-bf6d-440f-8793-ba2e2d6e9330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:02.308977 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739252e-1fcc-4ad6-8c1a-b5b775f75a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:02.308977 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739252e-1fcc-4ad6-8c1a-b5b775f75a8e admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:02.308977 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739252e-1fcc-4ad6-8c1a-b5b775f75a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:02.308977 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739252e-1fcc-4ad6-8c1a-b5b775f75a8e admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:02.309249 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d05dc5-bf6d-440f-8793-ba2e2d6e9330 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:02.309319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739252e-1fcc-4ad6-8c1a-b5b775f75a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:02.310639 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739252e-1fcc-4ad6-8c1a-b5b775f75a8e admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:02.319183 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1040/2069] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:02.320529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e10a4-bbea-4c99-bcb8-6be3cbc4be53 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:02.320820 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e10a4-bbea-4c99-bcb8-6be3cbc4be53 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:02.321098 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e10a4-bbea-4c99-bcb8-6be3cbc4be53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:02.348367 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-e24e10a4-bbea-4c99-bcb8-6be3cbc4be53 None None] MFA Rules not processed for user `6796773e4eda4141a0952dbbcd37616a`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:02.349647 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-e24e10a4-bbea-4c99-bcb8-6be3cbc4be53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:02.414125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1041/2070] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:02.415007 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e10a4-bbea-4c99-bcb8-6be3cbc4be53 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:02.426214 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e10a4-bbea-4c99-bcb8-6be3cbc4be53 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:02.434315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c0785-4cbd-415e-a21b-7ac335de1b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:02.435021 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c0785-4cbd-415e-a21b-7ac335de1b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:02.435303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c0785-4cbd-415e-a21b-7ac335de1b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:02.435602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c0785-4cbd-415e-a21b-7ac335de1b70 admin admin] PATH_INFO: `/v3/projects/2dedc4b54c7b43e0a67f1447b89993ea/users/7e631060d3e0499d8df476f0b5096b3b/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:02.454102 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c0785-4cbd-415e-a21b-7ac335de1b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dedc4b54c7b43e0a67f1447b89993ea, user_id=7e631060d3e0499d8df476f0b5096b3b, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:02.459871 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c0785-4cbd-415e-a21b-7ac335de1b70 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:02.466349 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1030/2071] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:02 2022] POST /identity/v3/users => generated 289 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:02.467493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739252e-1fcc-4ad6-8c1a-b5b775f75a8e admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:02.474935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d739252e-1fcc-4ad6-8c1a-b5b775f75a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:02.489316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739252e-1fcc-4ad6-8c1a-b5b775f75a8e admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:02.495893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fb921-23c0-403d-afea-d2c7b1daa106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:02.496646 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fb921-23c0-403d-afea-d2c7b1daa106 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:02.496989 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fb921-23c0-403d-afea-d2c7b1daa106 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:02.497265 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fb921-23c0-403d-afea-d2c7b1daa106 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:02.497971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865fb921-23c0-403d-afea-d2c7b1daa106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:02.499956 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865fb921-23c0-403d-afea-d2c7b1daa106 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:02.621008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1042/2072] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:02 2022] PUT /identity/v3/projects/2dedc4b54c7b43e0a67f1447b89993ea/users/7e631060d3e0499d8df476f0b5096b3b/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:02.623727 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1031/2073] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:02 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:02.623901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c0785-4cbd-415e-a21b-7ac335de1b70 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:02.627811 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004b842-ce54-40f0-b7f1-3a7b89ec5cea None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:02.628126 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004b842-ce54-40f0-b7f1-3a7b89ec5cea None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:02.628974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004b842-ce54-40f0-b7f1-3a7b89ec5cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:02.648149 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-a004b842-ce54-40f0-b7f1-3a7b89ec5cea None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:02.649399 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-a004b842-ce54-40f0-b7f1-3a7b89ec5cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:02.699977 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c0785-4cbd-415e-a21b-7ac335de1b70 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:02.716521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:02.716858 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1032/2074] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:02.720152 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004b842-ce54-40f0-b7f1-3a7b89ec5cea None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:02.731437 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004b842-ce54-40f0-b7f1-3a7b89ec5cea None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:02.737327 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb00d3-7394-43b0-b3fe-b344302fad39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:02.738658 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb00d3-7394-43b0-b3fe-b344302fad39 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:02.739157 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb00d3-7394-43b0-b3fe-b344302fad39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:02.739507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb00d3-7394-43b0-b3fe-b344302fad39 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:02.740844 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb00d3-7394-43b0-b3fe-b344302fad39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:02.742628 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb00d3-7394-43b0-b3fe-b344302fad39 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:02.781493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dc834-6d50-4c11-955e-07c5d9dd0774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:02.782124 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dc834-6d50-4c11-955e-07c5d9dd0774 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:02.782419 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dc834-6d50-4c11-955e-07c5d9dd0774 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:02.782686 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dc834-6d50-4c11-955e-07c5d9dd0774 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:02.783367 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dc834-6d50-4c11-955e-07c5d9dd0774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:02.786209 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dc834-6d50-4c11-955e-07c5d9dd0774 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:02.796394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1043/2075] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:02.797279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dc834-6d50-4c11-955e-07c5d9dd0774 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:02.798915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-cc3dc834-6d50-4c11-955e-07c5d9dd0774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:02.812639 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dc834-6d50-4c11-955e-07c5d9dd0774 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:02.818214 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d766a-4758-48af-94fa-7050ea9bf05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:02.818859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d766a-4758-48af-94fa-7050ea9bf05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:02.819124 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d766a-4758-48af-94fa-7050ea9bf05d admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:02.819423 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d766a-4758-48af-94fa-7050ea9bf05d admin admin] PATH_INFO: `/v3/projects/d5021320f7d84018b752c4fb94ea8099` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:02.820588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d766a-4758-48af-94fa-7050ea9bf05d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5021320f7d84018b752c4fb94ea8099)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:02.822510 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d766a-4758-48af-94fa-7050ea9bf05d admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:02.881025 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1033/2076] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:02 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:02.881925 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb00d3-7394-43b0-b3fe-b344302fad39 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:02.883604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-08eb00d3-7394-43b0-b3fe-b344302fad39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:02.942686 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb00d3-7394-43b0-b3fe-b344302fad39 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:02.946453 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fac980-d8b8-4e6e-9d0f-b43da28a0719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:02.947078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fac980-d8b8-4e6e-9d0f-b43da28a0719 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:02.947372 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fac980-d8b8-4e6e-9d0f-b43da28a0719 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:02.947659 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fac980-d8b8-4e6e-9d0f-b43da28a0719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:02.957069 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fac980-d8b8-4e6e-9d0f-b43da28a0719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:02.958683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fac980-d8b8-4e6e-9d0f-b43da28a0719 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:02.968771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1034/2077] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:02.983428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fac980-d8b8-4e6e-9d0f-b43da28a0719 service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:02.983428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fac980-d8b8-4e6e-9d0f-b43da28a0719 service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:02.984420 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff9360-a73c-48dc-870d-d550fc395f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:02.985740 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff9360-a73c-48dc-870d-d550fc395f5a admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:02.986033 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff9360-a73c-48dc-870d-d550fc395f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:02.986314 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff9360-a73c-48dc-870d-d550fc395f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:02.986967 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff9360-a73c-48dc-870d-d550fc395f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:02.989259 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff9360-a73c-48dc-870d-d550fc395f5a admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:03.001085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1035/2078] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:03.001085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff9360-a73c-48dc-870d-d550fc395f5a admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:03.011070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff9360-a73c-48dc-870d-d550fc395f5a admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:03.015774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deec4d9-9c3b-4dff-8934-6a2f5031f9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:03.016411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deec4d9-9c3b-4dff-8934-6a2f5031f9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:03.023286 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deec4d9-9c3b-4dff-8934-6a2f5031f9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:03.023286 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deec4d9-9c3b-4dff-8934-6a2f5031f9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:03.023286 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deec4d9-9c3b-4dff-8934-6a2f5031f9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:03.023286 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deec4d9-9c3b-4dff-8934-6a2f5031f9c6 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:03.033394 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1036/2079] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:03.033394 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deec4d9-9c3b-4dff-8934-6a2f5031f9c6 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:03.043817 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deec4d9-9c3b-4dff-8934-6a2f5031f9c6 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:03.049140 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e2fae-0ebc-463a-b7f6-15d511e2345c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:03.050030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e2fae-0ebc-463a-b7f6-15d511e2345c admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:03.051081 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e2fae-0ebc-463a-b7f6-15d511e2345c admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:03.051513 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e2fae-0ebc-463a-b7f6-15d511e2345c admin admin] PATH_INFO: `/v3/projects/5dc2524b9da54bb5bcdd0d143a161f02/users/ffe90bd71b584c0893de5587ceee05f3/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:03.068337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-fe2d766a-4758-48af-94fa-7050ea9bf05d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5021320f7d84018b752c4fb94ea8099', 'request_id': 'req-fe2d766a-4758-48af-94fa-7050ea9bf05d'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:03.071266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e2fae-0ebc-463a-b7f6-15d511e2345c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc2524b9da54bb5bcdd0d143a161f02, user_id=ffe90bd71b584c0893de5587ceee05f3, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:03.074015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e2fae-0ebc-463a-b7f6-15d511e2345c admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:03.279227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-fe2d766a-4758-48af-94fa-7050ea9bf05d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5021320f7d84018b752c4fb94ea8099', 'request_id': 'req-fe2d766a-4758-48af-94fa-7050ea9bf05d'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:03.298031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-fe2d766a-4758-48af-94fa-7050ea9bf05d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5021320f7d84018b752c4fb94ea8099', 'request_id': 'req-fe2d766a-4758-48af-94fa-7050ea9bf05d'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:03.298236 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1037/2080] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:03 2022] PUT /identity/v3/projects/5dc2524b9da54bb5bcdd0d143a161f02/users/ffe90bd71b584c0893de5587ceee05f3/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:03.298236 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e2fae-0ebc-463a-b7f6-15d511e2345c admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:03.327906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-fe2d766a-4758-48af-94fa-7050ea9bf05d admin admin] The token cache is being invalidate because project d5021320f7d84018b752c4fb94ea8099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:03.328440 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-fe2d766a-4758-48af-94fa-7050ea9bf05d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:03.329342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-fe2d766a-4758-48af-94fa-7050ea9bf05d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:03.332312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1044/2081] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:02 2022] DELETE /identity/v3/projects/d5021320f7d84018b752c4fb94ea8099 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:03.334244 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500ecb4-0c13-4544-8f7e-f0afe6de639b None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:03.338621 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500ecb4-0c13-4544-8f7e-f0afe6de639b None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:03.338621 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500ecb4-0c13-4544-8f7e-f0afe6de639b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:03.365915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-d500ecb4-0c13-4544-8f7e-f0afe6de639b None None] MFA Rules not processed for user `ffe90bd71b584c0893de5587ceee05f3`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:03.367409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-d500ecb4-0c13-4544-8f7e-f0afe6de639b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:03.384443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e2fae-0ebc-463a-b7f6-15d511e2345c admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:03.389087 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53319742-b643-41d9-95ee-44ac8c0a63bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:03.389754 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53319742-b643-41d9-95ee-44ac8c0a63bc admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:03.390033 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53319742-b643-41d9-95ee-44ac8c0a63bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:03.390307 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53319742-b643-41d9-95ee-44ac8c0a63bc admin admin] PATH_INFO: `/v3/projects/ac7bf7ce56a94094a5f7ca9db6c6c31d/users/eff13ff93a6243ba944d90de5f07e6b5/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:03.406005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53319742-b643-41d9-95ee-44ac8c0a63bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac7bf7ce56a94094a5f7ca9db6c6c31d, user_id=eff13ff93a6243ba944d90de5f07e6b5, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:03.409241 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53319742-b643-41d9-95ee-44ac8c0a63bc admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:03.442760 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1045/2082] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:03.444203 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7773be8-2772-4324-9222-e69c71697647 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:03.444554 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7773be8-2772-4324-9222-e69c71697647 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:03.444890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7773be8-2772-4324-9222-e69c71697647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:03.471042 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-e7773be8-2772-4324-9222-e69c71697647 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:03.473541 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-e7773be8-2772-4324-9222-e69c71697647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:03.491803 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1046/2083] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:03.491803 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7773be8-2772-4324-9222-e69c71697647 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:03.493623 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-e7773be8-2772-4324-9222-e69c71697647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:03.501087 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1038/2084] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:03 2022] PUT /identity/v3/projects/ac7bf7ce56a94094a5f7ca9db6c6c31d/users/eff13ff93a6243ba944d90de5f07e6b5/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:03.503142 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f202a14-2e4b-40a1-acf2-d257cb579e67 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:03.503761 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f202a14-2e4b-40a1-acf2-d257cb579e67 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:03.504434 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f202a14-2e4b-40a1-acf2-d257cb579e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:03.535648 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-3f202a14-2e4b-40a1-acf2-d257cb579e67 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:03.540257 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3f202a14-2e4b-40a1-acf2-d257cb579e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:03.602662 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7773be8-2772-4324-9222-e69c71697647 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:03.605895 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1039/2085] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:03.607434 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f202a14-2e4b-40a1-acf2-d257cb579e67 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:03.610825 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3f202a14-2e4b-40a1-acf2-d257cb579e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:03.623252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f202a14-2e4b-40a1-acf2-d257cb579e67 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:03.628287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4acd8-20ce-4251-b168-6ed42ba02303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:03.628900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4acd8-20ce-4251-b168-6ed42ba02303 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:03.629373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4acd8-20ce-4251-b168-6ed42ba02303 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:03.629652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4acd8-20ce-4251-b168-6ed42ba02303 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:03.630311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4acd8-20ce-4251-b168-6ed42ba02303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:03.631976 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4acd8-20ce-4251-b168-6ed42ba02303 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:03.645809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1040/2086] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:03.645809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4acd8-20ce-4251-b168-6ed42ba02303 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:03.655831 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4acd8-20ce-4251-b168-6ed42ba02303 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:03.657570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526f0d0-6f0d-4250-b022-280ea5b49906 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2faa7ffc99948478ec7b81842139078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:03.658189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526f0d0-6f0d-4250-b022-280ea5b49906 service glance] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:03.658469 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526f0d0-6f0d-4250-b022-280ea5b49906 service glance] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:03.658747 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526f0d0-6f0d-4250-b022-280ea5b49906 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:03.661455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec5867-4846-4bf7-b934-68c4f32879e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:03.662053 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec5867-4846-4bf7-b934-68c4f32879e9 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:03.662338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec5867-4846-4bf7-b934-68c4f32879e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:03.662759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec5867-4846-4bf7-b934-68c4f32879e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:03.666702 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec5867-4846-4bf7-b934-68c4f32879e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:57:03.666702 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec5867-4846-4bf7-b934-68c4f32879e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:03.666702 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec5867-4846-4bf7-b934-68c4f32879e9 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:03.678487 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1041/2087] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:57:03.679411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec5867-4846-4bf7-b934-68c4f32879e9 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:03.692130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec5867-4846-4bf7-b934-68c4f32879e9 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:03.705106 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa495d06-ff1f-43c3-9bfe-b57b02f6577b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:03.707125 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa495d06-ff1f-43c3-9bfe-b57b02f6577b admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:03.707125 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa495d06-ff1f-43c3-9bfe-b57b02f6577b admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:03.707125 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa495d06-ff1f-43c3-9bfe-b57b02f6577b admin admin] PATH_INFO: `/v3/projects/ac7bf7ce56a94094a5f7ca9db6c6c31d/users/eff13ff93a6243ba944d90de5f07e6b5/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:03.709384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa495d06-ff1f-43c3-9bfe-b57b02f6577b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac7bf7ce56a94094a5f7ca9db6c6c31d, user_id=eff13ff93a6243ba944d90de5f07e6b5, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:03.712182 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa495d06-ff1f-43c3-9bfe-b57b02f6577b admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:03.724902 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526f0d0-6f0d-4250-b022-280ea5b49906 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:03.728200 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1042/2088] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:03 2022] PUT /identity/v3/projects/ac7bf7ce56a94094a5f7ca9db6c6c31d/users/eff13ff93a6243ba944d90de5f07e6b5/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:03.729426 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa495d06-ff1f-43c3-9bfe-b57b02f6577b admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:03.735653 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526f0d0-6f0d-4250-b022-280ea5b49906 service glance] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:03.748887 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1047/2089] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:03.750463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f592f-c70c-44e0-ae17-cc381184c697 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:03.750900 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f592f-c70c-44e0-ae17-cc381184c697 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:03.751317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f592f-c70c-44e0-ae17-cc381184c697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:03.811447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-9c8f592f-c70c-44e0-ae17-cc381184c697 None None] MFA Rules not processed for user `eff13ff93a6243ba944d90de5f07e6b5`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:03.813454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-9c8f592f-c70c-44e0-ae17-cc381184c697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:03.818203 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa495d06-ff1f-43c3-9bfe-b57b02f6577b admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:03.824782 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef879ac-91fa-4216-a79e-8ff4162ac0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:03.825409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef879ac-91fa-4216-a79e-8ff4162ac0ac admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:03.825685 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef879ac-91fa-4216-a79e-8ff4162ac0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:03.825951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef879ac-91fa-4216-a79e-8ff4162ac0ac admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:03.827082 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef879ac-91fa-4216-a79e-8ff4162ac0ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:03.829696 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef879ac-91fa-4216-a79e-8ff4162ac0ac admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:03.903901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1048/2090] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:03.919437 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1043/2091] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:03 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:03.927170 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f592f-c70c-44e0-ae17-cc381184c697 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:03.943492 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f592f-c70c-44e0-ae17-cc381184c697 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:04.010184 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724d466-9095-46e3-b7e3-71ed46771338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:04.010826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724d466-9095-46e3-b7e3-71ed46771338 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:04.011274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724d466-9095-46e3-b7e3-71ed46771338 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:04.011572 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724d466-9095-46e3-b7e3-71ed46771338 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:04.012235 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724d466-9095-46e3-b7e3-71ed46771338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:04.014337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724d466-9095-46e3-b7e3-71ed46771338 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:04.236350 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1049/2092] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:03 2022] POST /identity/v3/users => generated 290 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:04.241680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef879ac-91fa-4216-a79e-8ff4162ac0ac admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:04.252284 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef879ac-91fa-4216-a79e-8ff4162ac0ac admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:04.257134 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9ed20-7aca-4ba4-a172-5f38393c3803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:04.257733 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9ed20-7aca-4ba4-a172-5f38393c3803 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:04.258012 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9ed20-7aca-4ba4-a172-5f38393c3803 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:04.258286 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9ed20-7aca-4ba4-a172-5f38393c3803 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:04.258925 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9ed20-7aca-4ba4-a172-5f38393c3803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:04.260551 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9ed20-7aca-4ba4-a172-5f38393c3803 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:04.276847 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1044/2093] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:04.278874 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724d466-9095-46e3-b7e3-71ed46771338 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:04.292069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724d466-9095-46e3-b7e3-71ed46771338 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:04.299309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265035b7-f5fd-4da4-bfaf-3f49fa635e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:04.302507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265035b7-f5fd-4da4-bfaf-3f49fa635e81 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:04.302507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265035b7-f5fd-4da4-bfaf-3f49fa635e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:04.302507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265035b7-f5fd-4da4-bfaf-3f49fa635e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:04.302507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265035b7-f5fd-4da4-bfaf-3f49fa635e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:04.305249 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265035b7-f5fd-4da4-bfaf-3f49fa635e81 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:04.319340 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1050/2094] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:04.323228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9ed20-7aca-4ba4-a172-5f38393c3803 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:04.334044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9ed20-7aca-4ba4-a172-5f38393c3803 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:04.340684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c259188-41d7-4b57-8eb1-90884c493c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:04.345280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c259188-41d7-4b57-8eb1-90884c493c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:04.345487 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c259188-41d7-4b57-8eb1-90884c493c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:04.345732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c259188-41d7-4b57-8eb1-90884c493c9b admin admin] PATH_INFO: `/v3/projects/3c8627cefedb41389b0446751c93dd62/users/7a2d1fd9d0bd476a907bb51748355ac9/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:04.358574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265035b7-f5fd-4da4-bfaf-3f49fa635e81 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:04.361111 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-265035b7-f5fd-4da4-bfaf-3f49fa635e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:04.366248 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c259188-41d7-4b57-8eb1-90884c493c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8627cefedb41389b0446751c93dd62, user_id=7a2d1fd9d0bd476a907bb51748355ac9, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:04.369828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c259188-41d7-4b57-8eb1-90884c493c9b admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:04.423236 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265035b7-f5fd-4da4-bfaf-3f49fa635e81 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:04.427375 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c590d9f-abc9-4c46-a8a1-2891c4b3a0ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:04.428050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c590d9f-abc9-4c46-a8a1-2891c4b3a0ff service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:04.428365 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c590d9f-abc9-4c46-a8a1-2891c4b3a0ff service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:04.428642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c590d9f-abc9-4c46-a8a1-2891c4b3a0ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:04.476590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1045/2095] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:04 2022] PUT /identity/v3/projects/3c8627cefedb41389b0446751c93dd62/users/7a2d1fd9d0bd476a907bb51748355ac9/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:04.488042 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16863193-ca85-4911-95af-68fe7bfb7cd8 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:04.488353 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16863193-ca85-4911-95af-68fe7bfb7cd8 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:04.488624 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16863193-ca85-4911-95af-68fe7bfb7cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:04.506595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c590d9f-abc9-4c46-a8a1-2891c4b3a0ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:04.508127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c590d9f-abc9-4c46-a8a1-2891c4b3a0ff service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:04.519853 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-16863193-ca85-4911-95af-68fe7bfb7cd8 None None] MFA Rules not processed for user `7a2d1fd9d0bd476a907bb51748355ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:04.521050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-16863193-ca85-4911-95af-68fe7bfb7cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:04.521784 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1051/2096] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:04 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:57:04.602642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1046/2097] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:57:04.607513 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c590d9f-abc9-4c46-a8a1-2891c4b3a0ff service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:04.619377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c590d9f-abc9-4c46-a8a1-2891c4b3a0ff service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:04.684556 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994d586-210b-45be-9e5f-5b24e0883123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:04.684805 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994d586-210b-45be-9e5f-5b24e0883123 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:04.685063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994d586-210b-45be-9e5f-5b24e0883123 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:04.685338 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994d586-210b-45be-9e5f-5b24e0883123 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:04.685993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b994d586-210b-45be-9e5f-5b24e0883123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:04.687925 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b994d586-210b-45be-9e5f-5b24e0883123 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:04.785137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1052/2098] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:04 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:04.789257 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16863193-ca85-4911-95af-68fe7bfb7cd8 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:04.808735 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16863193-ca85-4911-95af-68fe7bfb7cd8 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:04.834940 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994d586-210b-45be-9e5f-5b24e0883123 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:04.941485 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12da06-748b-4dac-ba7e-c9252e066910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:04.942224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12da06-748b-4dac-ba7e-c9252e066910 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:04.942506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12da06-748b-4dac-ba7e-c9252e066910 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:04.942778 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12da06-748b-4dac-ba7e-c9252e066910 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:04.944258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12da06-748b-4dac-ba7e-c9252e066910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:04.946264 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994d586-210b-45be-9e5f-5b24e0883123 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:04.948555 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12da06-748b-4dac-ba7e-c9252e066910 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:04.961721 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea4655-efde-4ddd-9313-aba9d6698e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:04.961913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea4655-efde-4ddd-9313-aba9d6698e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:04.962129 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea4655-efde-4ddd-9313-aba9d6698e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:04.962387 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea4655-efde-4ddd-9313-aba9d6698e70 admin admin] PATH_INFO: `/v3/users/6796773e4eda4141a0952dbbcd37616a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:04.965805 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea4655-efde-4ddd-9313-aba9d6698e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6796773e4eda4141a0952dbbcd37616a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:04.968207 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea4655-efde-4ddd-9313-aba9d6698e70 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:05.084194 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1047/2099] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:04 2022] POST /identity/v3/users => generated 289 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:05.087979 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12da06-748b-4dac-ba7e-c9252e066910 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:05.099490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12da06-748b-4dac-ba7e-c9252e066910 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:05.106203 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cacf25-feab-45f7-97a6-8c94018d86cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:05.113267 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cacf25-feab-45f7-97a6-8c94018d86cb admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:05.113267 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cacf25-feab-45f7-97a6-8c94018d86cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:05.113267 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cacf25-feab-45f7-97a6-8c94018d86cb admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:05.113267 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cacf25-feab-45f7-97a6-8c94018d86cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:05.113267 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cacf25-feab-45f7-97a6-8c94018d86cb admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:05.126691 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1048/2100] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:05.131125 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cacf25-feab-45f7-97a6-8c94018d86cb admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:05.141733 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cacf25-feab-45f7-97a6-8c94018d86cb admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:05.148834 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941073d-6f5d-45fa-80de-9cb639546083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:05.153562 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941073d-6f5d-45fa-80de-9cb639546083 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:05.153562 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941073d-6f5d-45fa-80de-9cb639546083 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:05.153562 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941073d-6f5d-45fa-80de-9cb639546083 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:05.153562 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0941073d-6f5d-45fa-80de-9cb639546083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:05.153562 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0941073d-6f5d-45fa-80de-9cb639546083 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:05.163986 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1049/2101] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:57:05.168215 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941073d-6f5d-45fa-80de-9cb639546083 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:05.179332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941073d-6f5d-45fa-80de-9cb639546083 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:05.185444 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38351a3-8a5d-42ed-830d-ecfcabbd7002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:05.186096 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38351a3-8a5d-42ed-830d-ecfcabbd7002 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:05.186370 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38351a3-8a5d-42ed-830d-ecfcabbd7002 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:05.187759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38351a3-8a5d-42ed-830d-ecfcabbd7002 admin admin] PATH_INFO: `/v3/projects/a7009a8975414f8a80f1f12412a40415/users/600d52e300924dc88726c3ef4da51cab/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:05.202401 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38351a3-8a5d-42ed-830d-ecfcabbd7002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7009a8975414f8a80f1f12412a40415, user_id=600d52e300924dc88726c3ef4da51cab, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:05.205171 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38351a3-8a5d-42ed-830d-ecfcabbd7002 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:05.314026 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1050/2102] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:05 2022] PUT /identity/v3/projects/a7009a8975414f8a80f1f12412a40415/users/600d52e300924dc88726c3ef4da51cab/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:57:05.326170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e1078-3ddf-4736-9d84-d352163fa200 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:05.326529 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e1078-3ddf-4736-9d84-d352163fa200 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:05.326886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e1078-3ddf-4736-9d84-d352163fa200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:05.342179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:05.372098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-ec5e1078-3ddf-4736-9d84-d352163fa200 None None] MFA Rules not processed for user `600d52e300924dc88726c3ef4da51cab`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:05.373855 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ec5e1078-3ddf-4736-9d84-d352163fa200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:05.380311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-cfea4655-efde-4ddd-9313-aba9d6698e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6796773e4eda4141a0952dbbcd37616a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:05.463433 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-cfea4655-efde-4ddd-9313-aba9d6698e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6796773e4eda4141a0952dbbcd37616a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:05.463433 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-cfea4655-efde-4ddd-9313-aba9d6698e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6796773e4eda4141a0952dbbcd37616a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:05.489383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-cfea4655-efde-4ddd-9313-aba9d6698e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6796773e4eda4141a0952dbbcd37616a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:05.521799 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-cfea4655-efde-4ddd-9313-aba9d6698e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6796773e4eda4141a0952dbbcd37616a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:05.523968 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1051/2103] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:57:05.529868 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e1078-3ddf-4736-9d84-d352163fa200 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:05.537993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1053/2104] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:57:04 2022] DELETE /identity/v3/users/6796773e4eda4141a0952dbbcd37616a => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:57:05.538775 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea4655-efde-4ddd-9313-aba9d6698e70 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:05.543501 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-cfea4655-efde-4ddd-9313-aba9d6698e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:05.610528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e1078-3ddf-4736-9d84-d352163fa200 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:05.616267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea4655-efde-4ddd-9313-aba9d6698e70 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:05.621800 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178c7a7-17bb-4749-92de-9fa9238cf8cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:05.622622 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178c7a7-17bb-4749-92de-9fa9238cf8cc service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:05.622904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178c7a7-17bb-4749-92de-9fa9238cf8cc service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:05.623397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178c7a7-17bb-4749-92de-9fa9238cf8cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:05.629885 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-0178c7a7-17bb-4749-92de-9fa9238cf8cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:05.636208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:05.751275 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178c7a7-17bb-4749-92de-9fa9238cf8cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:05.758059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178c7a7-17bb-4749-92de-9fa9238cf8cc service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:05.766523 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120b3b9-f24d-4806-a095-eae4c24a8e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:05.769607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120b3b9-f24d-4806-a095-eae4c24a8e51 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:05.770068 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120b3b9-f24d-4806-a095-eae4c24a8e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:05.770342 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120b3b9-f24d-4806-a095-eae4c24a8e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:05.770999 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120b3b9-f24d-4806-a095-eae4c24a8e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:05.773088 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120b3b9-f24d-4806-a095-eae4c24a8e51 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:05.784086 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1054/2105] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:05.785759 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175be8b-9b2e-4503-a31d-ae9d36abc560 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:05.786055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175be8b-9b2e-4503-a31d-ae9d36abc560 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:05.786342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175be8b-9b2e-4503-a31d-ae9d36abc560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:05.810601 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-3175be8b-9b2e-4503-a31d-ae9d36abc560 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:05.811867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-3175be8b-9b2e-4503-a31d-ae9d36abc560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:05.821428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1055/2106] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:05.833650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175be8b-9b2e-4503-a31d-ae9d36abc560 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:05.835506 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-3175be8b-9b2e-4503-a31d-ae9d36abc560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:05.924693 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175be8b-9b2e-4503-a31d-ae9d36abc560 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:05.931415 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b13412-85fe-4b9d-848f-2971b157c72c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:05.932112 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b13412-85fe-4b9d-848f-2971b157c72c service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:05.932578 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b13412-85fe-4b9d-848f-2971b157c72c service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:05.932788 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b13412-85fe-4b9d-848f-2971b157c72c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:05.949050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b13412-85fe-4b9d-848f-2971b157c72c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:05.950642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b13412-85fe-4b9d-848f-2971b157c72c service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:05.971092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1056/2107] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:57:05.986072 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1052/2108] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:05 2022] POST /identity/v3/projects => generated 379 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:05.986830 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b13412-85fe-4b9d-848f-2971b157c72c service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:05.989277 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-62b13412-85fe-4b9d-848f-2971b157c72c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:06.021701 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b13412-85fe-4b9d-848f-2971b157c72c service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:06.101419 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb86d4-380f-4e2a-bdc6-ec5d18bf9409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:06.102058 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb86d4-380f-4e2a-bdc6-ec5d18bf9409 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:06.102346 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb86d4-380f-4e2a-bdc6-ec5d18bf9409 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:06.102620 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb86d4-380f-4e2a-bdc6-ec5d18bf9409 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:06.103575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb86d4-380f-4e2a-bdc6-ec5d18bf9409 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:06.105631 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb86d4-380f-4e2a-bdc6-ec5d18bf9409 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:06.410996 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1057/2109] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:05 2022] POST /identity/v3/users => generated 296 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:06.422980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120b3b9-f24d-4806-a095-eae4c24a8e51 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:06.438973 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120b3b9-f24d-4806-a095-eae4c24a8e51 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:06.449373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea62cb-a73a-4af9-a70a-775eae4fdde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:06.450076 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea62cb-a73a-4af9-a70a-775eae4fdde0 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:06.450348 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea62cb-a73a-4af9-a70a-775eae4fdde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:06.450619 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea62cb-a73a-4af9-a70a-775eae4fdde0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:06.451854 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea62cb-a73a-4af9-a70a-775eae4fdde0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:06.455273 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea62cb-a73a-4af9-a70a-775eae4fdde0 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:06.481266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1053/2110] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:06.483396 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb86d4-380f-4e2a-bdc6-ec5d18bf9409 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:06.504784 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb86d4-380f-4e2a-bdc6-ec5d18bf9409 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:06.512037 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938b8e9-6aed-4f44-9e8a-f5217907c4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:06.513112 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938b8e9-6aed-4f44-9e8a-f5217907c4ed admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:06.513756 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938b8e9-6aed-4f44-9e8a-f5217907c4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:06.514067 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938b8e9-6aed-4f44-9e8a-f5217907c4ed admin admin] PATH_INFO: `/v3/projects/9685aef2c16e4c3b8a053637951c8a77/users/ba9d4a604a3a486c8ab9e424d19ff0c4/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:06.532756 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938b8e9-6aed-4f44-9e8a-f5217907c4ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=9685aef2c16e4c3b8a053637951c8a77, user_id=ba9d4a604a3a486c8ab9e424d19ff0c4, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:06.542467 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938b8e9-6aed-4f44-9e8a-f5217907c4ed admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:06.694111 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea62cb-a73a-4af9-a70a-775eae4fdde0 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:06.697314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1058/2111] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:06 2022] PUT /identity/v3/projects/9685aef2c16e4c3b8a053637951c8a77/users/ba9d4a604a3a486c8ab9e424d19ff0c4/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:57:06.705607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea62cb-a73a-4af9-a70a-775eae4fdde0 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:06.773333 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e81d8c-f4af-4c9f-9e95-550ad896a0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:06.774180 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e81d8c-f4af-4c9f-9e95-550ad896a0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:06.774277 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e81d8c-f4af-4c9f-9e95-550ad896a0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:06.774601 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e81d8c-f4af-4c9f-9e95-550ad896a0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:06.775263 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e81d8c-f4af-4c9f-9e95-550ad896a0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:06.776972 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e81d8c-f4af-4c9f-9e95-550ad896a0d3 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:06.787462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1054/2112] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:06.792003 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938b8e9-6aed-4f44-9e8a-f5217907c4ed admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:06.807980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938b8e9-6aed-4f44-9e8a-f5217907c4ed admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:06.813358 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13405824-781c-48dd-a809-0a8f7aec531b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:06.814288 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13405824-781c-48dd-a809-0a8f7aec531b admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:06.814570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13405824-781c-48dd-a809-0a8f7aec531b admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:06.814848 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13405824-781c-48dd-a809-0a8f7aec531b admin admin] PATH_INFO: `/v3/projects/9685aef2c16e4c3b8a053637951c8a77/users/ba9d4a604a3a486c8ab9e424d19ff0c4/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:06.821882 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13405824-781c-48dd-a809-0a8f7aec531b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9685aef2c16e4c3b8a053637951c8a77, user_id=ba9d4a604a3a486c8ab9e424d19ff0c4, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:06.827182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13405824-781c-48dd-a809-0a8f7aec531b admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:06.850376 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1059/2113] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:06 2022] PUT /identity/v3/projects/9685aef2c16e4c3b8a053637951c8a77/users/ba9d4a604a3a486c8ab9e424d19ff0c4/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:06.863633 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d96499-894e-4307-b212-a65f8d9cf288 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:06.863900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d96499-894e-4307-b212-a65f8d9cf288 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:06.864144 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d96499-894e-4307-b212-a65f8d9cf288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:06.867282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13405824-781c-48dd-a809-0a8f7aec531b admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:06.870184 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-13405824-781c-48dd-a809-0a8f7aec531b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:06.968340 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-e4d96499-894e-4307-b212-a65f8d9cf288 None None] MFA Rules not processed for user `ba9d4a604a3a486c8ab9e424d19ff0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:06.969836 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e4d96499-894e-4307-b212-a65f8d9cf288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:07.056939 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13405824-781c-48dd-a809-0a8f7aec531b admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:07.063172 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d940369-19d3-4513-b7a9-f113310b4375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:07.064019 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d940369-19d3-4513-b7a9-f113310b4375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:07.064368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d940369-19d3-4513-b7a9-f113310b4375 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:07.064617 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d940369-19d3-4513-b7a9-f113310b4375 admin admin] PATH_INFO: `/v3/projects/397fb21e56ec4d91a3524463ae6ffa7f` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:07.067915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d940369-19d3-4513-b7a9-f113310b4375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=397fb21e56ec4d91a3524463ae6ffa7f)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:07.081203 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d940369-19d3-4513-b7a9-f113310b4375 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:07.209028 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1055/2114] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:07.220501 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d96499-894e-4307-b212-a65f8d9cf288 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:07.220501 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e4d96499-894e-4307-b212-a65f8d9cf288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:07.276469 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2d940369-19d3-4513-b7a9-f113310b4375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '397fb21e56ec4d91a3524463ae6ffa7f', 'request_id': 'req-2d940369-19d3-4513-b7a9-f113310b4375'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:07.339036 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d96499-894e-4307-b212-a65f8d9cf288 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:07.355842 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2d940369-19d3-4513-b7a9-f113310b4375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '397fb21e56ec4d91a3524463ae6ffa7f', 'request_id': 'req-2d940369-19d3-4513-b7a9-f113310b4375'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:07.364351 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2d940369-19d3-4513-b7a9-f113310b4375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '397fb21e56ec4d91a3524463ae6ffa7f', 'request_id': 'req-2d940369-19d3-4513-b7a9-f113310b4375'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:07.407286 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2d940369-19d3-4513-b7a9-f113310b4375 admin admin] The token cache is being invalidate because project 397fb21e56ec4d91a3524463ae6ffa7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:07.409949 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2d940369-19d3-4513-b7a9-f113310b4375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:07.412583 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2d940369-19d3-4513-b7a9-f113310b4375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:07.418953 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1060/2115] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:06 2022] DELETE /identity/v3/projects/397fb21e56ec4d91a3524463ae6ffa7f => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:07.420191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d940369-19d3-4513-b7a9-f113310b4375 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:07.423111 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2d940369-19d3-4513-b7a9-f113310b4375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:07.464947 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990dae07-2524-436a-90aa-4ecd70f0cbae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:07.465939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dae07-2524-436a-90aa-4ecd70f0cbae service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:07.466537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dae07-2524-436a-90aa-4ecd70f0cbae service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:07.467348 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dae07-2524-436a-90aa-4ecd70f0cbae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:07.469484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-990dae07-2524-436a-90aa-4ecd70f0cbae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:07.570288 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d940369-19d3-4513-b7a9-f113310b4375 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:07.573228 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:07.583351 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34a18d-3e6f-4c46-98f1-e68275514df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:07.584055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34a18d-3e6f-4c46-98f1-e68275514df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:07.584343 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34a18d-3e6f-4c46-98f1-e68275514df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:07.584648 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34a18d-3e6f-4c46-98f1-e68275514df0 admin admin] PATH_INFO: `/v3/users/eff13ff93a6243ba944d90de5f07e6b5` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:07.585862 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34a18d-3e6f-4c46-98f1-e68275514df0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eff13ff93a6243ba944d90de5f07e6b5)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:07.587867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34a18d-3e6f-4c46-98f1-e68275514df0 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:07.590523 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990dae07-2524-436a-90aa-4ecd70f0cbae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:07.592269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990dae07-2524-436a-90aa-4ecd70f0cbae service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:07.603693 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1056/2116] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:07.757259 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990dae07-2524-436a-90aa-4ecd70f0cbae service cinder] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:07.758795 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-990dae07-2524-436a-90aa-4ecd70f0cbae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:07.776002 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990dae07-2524-436a-90aa-4ecd70f0cbae service cinder] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:07.782527 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d303b2e-4afa-4b44-91cf-497b57590196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:07.783244 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d303b2e-4afa-4b44-91cf-497b57590196 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:07.784086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d303b2e-4afa-4b44-91cf-497b57590196 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:07.784722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d303b2e-4afa-4b44-91cf-497b57590196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:07.787889 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-9d303b2e-4afa-4b44-91cf-497b57590196 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:07.858156 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-ce34a18d-3e6f-4c46-98f1-e68275514df0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eff13ff93a6243ba944d90de5f07e6b5'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:07.873563 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d303b2e-4afa-4b44-91cf-497b57590196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:07.875044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d303b2e-4afa-4b44-91cf-497b57590196 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:07.886872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1057/2117] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:57:07.979058 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-ce34a18d-3e6f-4c46-98f1-e68275514df0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eff13ff93a6243ba944d90de5f07e6b5'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:07.979765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-ce34a18d-3e6f-4c46-98f1-e68275514df0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eff13ff93a6243ba944d90de5f07e6b5'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:08.002433 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-ce34a18d-3e6f-4c46-98f1-e68275514df0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eff13ff93a6243ba944d90de5f07e6b5'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:08.011771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-ce34a18d-3e6f-4c46-98f1-e68275514df0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eff13ff93a6243ba944d90de5f07e6b5'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:08.018463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1061/2118] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:57:07 2022] DELETE /identity/v3/users/eff13ff93a6243ba944d90de5f07e6b5 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:08.590626 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d303b2e-4afa-4b44-91cf-497b57590196 service cinder] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:08.610195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d303b2e-4afa-4b44-91cf-497b57590196 service cinder] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:08.686942 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be50f2f-6f9c-4311-8058-67d9b52632fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:08.687776 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be50f2f-6f9c-4311-8058-67d9b52632fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:08.687963 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be50f2f-6f9c-4311-8058-67d9b52632fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:08.688889 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be50f2f-6f9c-4311-8058-67d9b52632fb admin admin] PATH_INFO: `/v3/projects/ac7bf7ce56a94094a5f7ca9db6c6c31d` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:08.693515 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be50f2f-6f9c-4311-8058-67d9b52632fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac7bf7ce56a94094a5f7ca9db6c6c31d)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:08.693515 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be50f2f-6f9c-4311-8058-67d9b52632fb admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:08.868046 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5be50f2f-6f9c-4311-8058-67d9b52632fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac7bf7ce56a94094a5f7ca9db6c6c31d', 'request_id': 'req-5be50f2f-6f9c-4311-8058-67d9b52632fb'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:08.958232 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5be50f2f-6f9c-4311-8058-67d9b52632fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac7bf7ce56a94094a5f7ca9db6c6c31d', 'request_id': 'req-5be50f2f-6f9c-4311-8058-67d9b52632fb'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:08.966793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5be50f2f-6f9c-4311-8058-67d9b52632fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac7bf7ce56a94094a5f7ca9db6c6c31d', 'request_id': 'req-5be50f2f-6f9c-4311-8058-67d9b52632fb'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:08.979761 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5be50f2f-6f9c-4311-8058-67d9b52632fb admin admin] The token cache is being invalidate because project ac7bf7ce56a94094a5f7ca9db6c6c31d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:08.980359 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5be50f2f-6f9c-4311-8058-67d9b52632fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:08.981287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5be50f2f-6f9c-4311-8058-67d9b52632fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:08.983282 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1058/2119] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:08 2022] DELETE /identity/v3/projects/ac7bf7ce56a94094a5f7ca9db6c6c31d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:08.989961 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc6f1b-c599-4dd2-9287-1b653da3ed9f None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:08.990786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc6f1b-c599-4dd2-9287-1b653da3ed9f None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:08.991136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc6f1b-c599-4dd2-9287-1b653da3ed9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:09.032860 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-b4fc6f1b-c599-4dd2-9287-1b653da3ed9f None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:09.035042 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-b4fc6f1b-c599-4dd2-9287-1b653da3ed9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:09.150593 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1062/2120] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:09.158280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451df05a-ffc5-43fe-9a3c-b2fedb6d1c75 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:09.158570 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451df05a-ffc5-43fe-9a3c-b2fedb6d1c75 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:09.158846 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451df05a-ffc5-43fe-9a3c-b2fedb6d1c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:09.208023 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-451df05a-ffc5-43fe-9a3c-b2fedb6d1c75 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:09.225709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-451df05a-ffc5-43fe-9a3c-b2fedb6d1c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:09.247587 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1059/2121] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:09.249924 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc6f1b-c599-4dd2-9287-1b653da3ed9f None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:09.267500 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc6f1b-c599-4dd2-9287-1b653da3ed9f None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:09.276783 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5d859-1bf2-4e5f-a8ea-34ce2d41022d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:09.276783 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5d859-1bf2-4e5f-a8ea-34ce2d41022d admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:09.276783 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5d859-1bf2-4e5f-a8ea-34ce2d41022d admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:09.276783 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5d859-1bf2-4e5f-a8ea-34ce2d41022d admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:09.277168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5d859-1bf2-4e5f-a8ea-34ce2d41022d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:57:09.277168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5d859-1bf2-4e5f-a8ea-34ce2d41022d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:09.277168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5d859-1bf2-4e5f-a8ea-34ce2d41022d admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:09.297298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1063/2122] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:57:09.303247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:09.305031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451df05a-ffc5-43fe-9a3c-b2fedb6d1c75 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:09.314525 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451df05a-ffc5-43fe-9a3c-b2fedb6d1c75 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:09.325504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8f4b3-ec76-4db8-8232-13e029204723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:09.326144 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8f4b3-ec76-4db8-8232-13e029204723 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:09.326427 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8f4b3-ec76-4db8-8232-13e029204723 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:09.326698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8f4b3-ec76-4db8-8232-13e029204723 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:09.327575 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8f4b3-ec76-4db8-8232-13e029204723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:09.330095 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8f4b3-ec76-4db8-8232-13e029204723 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:09.455569 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1060/2123] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:09 2022] POST /identity/v3/projects => generated 393 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:09.455906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5d859-1bf2-4e5f-a8ea-34ce2d41022d admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:09.474543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5d859-1bf2-4e5f-a8ea-34ce2d41022d admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:09.584426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bac3c9-08a1-46e7-bb21-8731812ca79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:09.586898 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bac3c9-08a1-46e7-bb21-8731812ca79d admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:09.587362 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bac3c9-08a1-46e7-bb21-8731812ca79d admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:09.587780 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bac3c9-08a1-46e7-bb21-8731812ca79d admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:09.588609 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bac3c9-08a1-46e7-bb21-8731812ca79d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:09.591011 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bac3c9-08a1-46e7-bb21-8731812ca79d admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:09.706978 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1064/2124] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:09 2022] POST /identity/v3/users => generated 297 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:57:09.709781 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8f4b3-ec76-4db8-8232-13e029204723 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:09.746244 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8f4b3-ec76-4db8-8232-13e029204723 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:09.752705 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077d84c-9b54-416a-b009-c5c62eb346aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:09.754524 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077d84c-9b54-416a-b009-c5c62eb346aa admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:09.754820 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077d84c-9b54-416a-b009-c5c62eb346aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:09.755085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077d84c-9b54-416a-b009-c5c62eb346aa admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:09.756191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077d84c-9b54-416a-b009-c5c62eb346aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:09.757999 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077d84c-9b54-416a-b009-c5c62eb346aa admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:09.771252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1061/2125] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:09.778903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bac3c9-08a1-46e7-bb21-8731812ca79d admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:09.782019 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:09.799831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bac3c9-08a1-46e7-bb21-8731812ca79d admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:09.805919 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c385bf3-06ad-40f3-b536-19fc487b4314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:09.806630 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c385bf3-06ad-40f3-b536-19fc487b4314 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:09.807139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c385bf3-06ad-40f3-b536-19fc487b4314 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:09.807282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c385bf3-06ad-40f3-b536-19fc487b4314 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:09.808043 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c385bf3-06ad-40f3-b536-19fc487b4314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:09.809717 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c385bf3-06ad-40f3-b536-19fc487b4314 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:09.836895 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1065/2126] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:09.841125 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077d84c-9b54-416a-b009-c5c62eb346aa admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:09.856230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077d84c-9b54-416a-b009-c5c62eb346aa admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:09.865046 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9496f65-c218-4a4c-8dc8-6e7a2b0017e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:09.866512 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9496f65-c218-4a4c-8dc8-6e7a2b0017e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:09.866962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9496f65-c218-4a4c-8dc8-6e7a2b0017e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:09.867605 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9496f65-c218-4a4c-8dc8-6e7a2b0017e5 admin admin] PATH_INFO: `/v3/projects/2cc62c3947dd45808ca45049dbd3ecea/users/b91ea7ebade74e72b1b8983834300508/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:09.901700 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9496f65-c218-4a4c-8dc8-6e7a2b0017e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc62c3947dd45808ca45049dbd3ecea, user_id=b91ea7ebade74e72b1b8983834300508, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:09.906084 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9496f65-c218-4a4c-8dc8-6e7a2b0017e5 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:10.036322 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1062/2127] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:09 2022] PUT /identity/v3/projects/2cc62c3947dd45808ca45049dbd3ecea/users/b91ea7ebade74e72b1b8983834300508/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:10.047208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aa658-af94-4d8a-b4a0-86bbe0d526f8 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:10.047695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aa658-af94-4d8a-b4a0-86bbe0d526f8 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:10.047968 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aa658-af94-4d8a-b4a0-86bbe0d526f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:10.131761 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-008aa658-af94-4d8a-b4a0-86bbe0d526f8 None None] MFA Rules not processed for user `b91ea7ebade74e72b1b8983834300508`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:10.133145 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-008aa658-af94-4d8a-b4a0-86bbe0d526f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:10.268011 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1066/2128] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:10.272896 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9496f65-c218-4a4c-8dc8-6e7a2b0017e5 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:10.407676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9496f65-c218-4a4c-8dc8-6e7a2b0017e5 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:10.414355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e9381-ece3-4bfe-a649-d6f583f219a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:10.415170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e9381-ece3-4bfe-a649-d6f583f219a0 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:10.415711 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e9381-ece3-4bfe-a649-d6f583f219a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:10.416199 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e9381-ece3-4bfe-a649-d6f583f219a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:10.417267 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e9381-ece3-4bfe-a649-d6f583f219a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:10.420000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e9381-ece3-4bfe-a649-d6f583f219a0 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:10.542565 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1063/2129] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:10 2022] POST /identity/v3/projects => generated 393 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:10.546302 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008aa658-af94-4d8a-b4a0-86bbe0d526f8 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:10.567173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008aa658-af94-4d8a-b4a0-86bbe0d526f8 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:10.688035 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e9340-5dc7-42cd-a7a5-99e1b22b0638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:10.693836 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e9340-5dc7-42cd-a7a5-99e1b22b0638 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:10.694347 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e9340-5dc7-42cd-a7a5-99e1b22b0638 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:10.694638 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e9340-5dc7-42cd-a7a5-99e1b22b0638 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:10.695360 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e9340-5dc7-42cd-a7a5-99e1b22b0638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:10.697500 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e9340-5dc7-42cd-a7a5-99e1b22b0638 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:10.801106 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1067/2130] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:10 2022] POST /identity/v3/users => generated 303 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:10.803952 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e9381-ece3-4bfe-a649-d6f583f219a0 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:10.821476 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e9381-ece3-4bfe-a649-d6f583f219a0 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:10.832387 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430a64c-040b-44e0-be59-b3549cf25744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:10.837005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430a64c-040b-44e0-be59-b3549cf25744 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:10.837363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430a64c-040b-44e0-be59-b3549cf25744 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:10.837752 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430a64c-040b-44e0-be59-b3549cf25744 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:10.839045 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430a64c-040b-44e0-be59-b3549cf25744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:10.841263 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430a64c-040b-44e0-be59-b3549cf25744 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:10.845660 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119eeea8-c662-4da9-a789-5e023697ca30 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:10.846011 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119eeea8-c662-4da9-a789-5e023697ca30 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:10.846397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119eeea8-c662-4da9-a789-5e023697ca30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:10.854688 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1064/2131] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:57:10.859517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430a64c-040b-44e0-be59-b3549cf25744 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:10.871203 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430a64c-040b-44e0-be59-b3549cf25744 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:10.876311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4ff66-1ca2-4bed-9810-42e926d6d564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:10.877043 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4ff66-1ca2-4bed-9810-42e926d6d564 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:10.877357 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4ff66-1ca2-4bed-9810-42e926d6d564 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:10.877691 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4ff66-1ca2-4bed-9810-42e926d6d564 admin admin] PATH_INFO: `/v3/projects/ace0ce88c9834409820a3d393341915a/users/0f754d115722464d836b1c35789a6aa3/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:10.891487 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-119eeea8-c662-4da9-a789-5e023697ca30 None None] MFA Rules not processed for user `7e631060d3e0499d8df476f0b5096b3b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:10.896878 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-119eeea8-c662-4da9-a789-5e023697ca30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:10.903180 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4ff66-1ca2-4bed-9810-42e926d6d564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace0ce88c9834409820a3d393341915a, user_id=0f754d115722464d836b1c35789a6aa3, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:10.907477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4ff66-1ca2-4bed-9810-42e926d6d564 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:11.019808 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1068/2132] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:11.032848 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c518d-bfea-479e-a1de-1b94561b1977 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:11.033156 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c518d-bfea-479e-a1de-1b94561b1977 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:11.033436 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c518d-bfea-479e-a1de-1b94561b1977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:11.041076 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1065/2133] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:10 2022] PUT /identity/v3/projects/ace0ce88c9834409820a3d393341915a/users/0f754d115722464d836b1c35789a6aa3/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:57:11.044220 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4ff66-1ca2-4bed-9810-42e926d6d564 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:11.108965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-589c518d-bfea-479e-a1de-1b94561b1977 None None] MFA Rules not processed for user `7e631060d3e0499d8df476f0b5096b3b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:11.115645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-589c518d-bfea-479e-a1de-1b94561b1977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:11.187309 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4ff66-1ca2-4bed-9810-42e926d6d564 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:11.194396 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bda271-0283-4495-bb44-eeeca07d4ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:11.195591 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bda271-0283-4495-bb44-eeeca07d4ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:11.196583 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bda271-0283-4495-bb44-eeeca07d4ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:11.197778 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bda271-0283-4495-bb44-eeeca07d4ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:11.199283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bda271-0283-4495-bb44-eeeca07d4ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:11.202049 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bda271-0283-4495-bb44-eeeca07d4ea0 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:11.213242 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1069/2134] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:11.225330 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c518d-bfea-479e-a1de-1b94561b1977 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:11.228588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-589c518d-bfea-479e-a1de-1b94561b1977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:11.230800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1066/2135] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:11.232149 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bda271-0283-4495-bb44-eeeca07d4ea0 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:11.248762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bda271-0283-4495-bb44-eeeca07d4ea0 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:11.256642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923522c0-81f7-4000-9665-b144f7d24cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:11.257389 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923522c0-81f7-4000-9665-b144f7d24cab admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:11.257864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923522c0-81f7-4000-9665-b144f7d24cab admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:11.258285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923522c0-81f7-4000-9665-b144f7d24cab admin admin] PATH_INFO: `/v3/projects/ace0ce88c9834409820a3d393341915a/users/0f754d115722464d836b1c35789a6aa3/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:11.261010 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923522c0-81f7-4000-9665-b144f7d24cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace0ce88c9834409820a3d393341915a, user_id=0f754d115722464d836b1c35789a6aa3, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:11.265110 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923522c0-81f7-4000-9665-b144f7d24cab admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:11.283091 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1067/2136] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:11 2022] PUT /identity/v3/projects/ace0ce88c9834409820a3d393341915a/users/0f754d115722464d836b1c35789a6aa3/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:11.297577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c61fbb-08e1-464e-a2f6-fb81e2e48c99 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:11.297868 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c61fbb-08e1-464e-a2f6-fb81e2e48c99 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:11.298145 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c61fbb-08e1-464e-a2f6-fb81e2e48c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:11.364063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-10c61fbb-08e1-464e-a2f6-fb81e2e48c99 None None] MFA Rules not processed for user `0f754d115722464d836b1c35789a6aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:11.364657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c518d-bfea-479e-a1de-1b94561b1977 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:11.365932 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-10c61fbb-08e1-464e-a2f6-fb81e2e48c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:11.454668 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742c0d9-add7-4bae-ae83-8ee1a1c9e76d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:11.454668 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742c0d9-add7-4bae-ae83-8ee1a1c9e76d service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:11.454668 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742c0d9-add7-4bae-ae83-8ee1a1c9e76d service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:11.454668 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742c0d9-add7-4bae-ae83-8ee1a1c9e76d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:11.494804 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1068/2137] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:11 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:11.523126 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742c0d9-add7-4bae-ae83-8ee1a1c9e76d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:11.525173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742c0d9-add7-4bae-ae83-8ee1a1c9e76d service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:11.536562 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1070/2138] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:11 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:11.599428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c61fbb-08e1-464e-a2f6-fb81e2e48c99 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:11.604102 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-10c61fbb-08e1-464e-a2f6-fb81e2e48c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:11.716142 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c61fbb-08e1-464e-a2f6-fb81e2e48c99 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:11.723139 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46caa3b-0bfd-4ab3-8e42-13bfbc1fb432 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:11.723139 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46caa3b-0bfd-4ab3-8e42-13bfbc1fb432 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:11.723139 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46caa3b-0bfd-4ab3-8e42-13bfbc1fb432 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:11.725657 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46caa3b-0bfd-4ab3-8e42-13bfbc1fb432 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:11.738505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46caa3b-0bfd-4ab3-8e42-13bfbc1fb432 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:11.740016 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46caa3b-0bfd-4ab3-8e42-13bfbc1fb432 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:11.755737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1069/2139] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:11 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:11.931167 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742c0d9-add7-4bae-ae83-8ee1a1c9e76d service nova] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:11.933593 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-e742c0d9-add7-4bae-ae83-8ee1a1c9e76d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:11.953658 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742c0d9-add7-4bae-ae83-8ee1a1c9e76d service nova] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:11.974913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20029b89-ce75-4c23-9733-10b4c5ebe7c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:11.974913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20029b89-ce75-4c23-9733-10b4c5ebe7c1 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:11.974913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20029b89-ce75-4c23-9733-10b4c5ebe7c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:11.974913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20029b89-ce75-4c23-9733-10b4c5ebe7c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:12.070770 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20029b89-ce75-4c23-9733-10b4c5ebe7c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:12.072536 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20029b89-ce75-4c23-9733-10b4c5ebe7c1 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:12.086092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1071/2140] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:11 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:12.547451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:12.618252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2e6bb-e9ec-42eb-a60e-aa56a05a8219 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:12.618822 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2e6bb-e9ec-42eb-a60e-aa56a05a8219 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:12.619498 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2e6bb-e9ec-42eb-a60e-aa56a05a8219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:12.641502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-cbe2e6bb-e9ec-42eb-a60e-aa56a05a8219 None None] MFA Rules not processed for user `7e631060d3e0499d8df476f0b5096b3b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:12.644624 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-cbe2e6bb-e9ec-42eb-a60e-aa56a05a8219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:12.651307 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1070/2141] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:13.260353 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:13.521946 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20029b89-ce75-4c23-9733-10b4c5ebe7c1 service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:13.532598 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-20029b89-ce75-4c23-9733-10b4c5ebe7c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:13.656144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20029b89-ce75-4c23-9733-10b4c5ebe7c1 service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:13.665041 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749d2b7-68ac-4f02-9181-db553f2daf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:13.665883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749d2b7-68ac-4f02-9181-db553f2daf1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:13.666174 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749d2b7-68ac-4f02-9181-db553f2daf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:13.666451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749d2b7-68ac-4f02-9181-db553f2daf1d admin admin] PATH_INFO: `/v3/users/7a2d1fd9d0bd476a907bb51748355ac9` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:13.669709 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749d2b7-68ac-4f02-9181-db553f2daf1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a2d1fd9d0bd476a907bb51748355ac9)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:13.671967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749d2b7-68ac-4f02-9181-db553f2daf1d admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:14.111480 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1749d2b7-68ac-4f02-9181-db553f2daf1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a2d1fd9d0bd476a907bb51748355ac9'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:14.421589 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1749d2b7-68ac-4f02-9181-db553f2daf1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a2d1fd9d0bd476a907bb51748355ac9'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:14.436628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1749d2b7-68ac-4f02-9181-db553f2daf1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a2d1fd9d0bd476a907bb51748355ac9'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:14.444999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1749d2b7-68ac-4f02-9181-db553f2daf1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a2d1fd9d0bd476a907bb51748355ac9'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:14.452305 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1749d2b7-68ac-4f02-9181-db553f2daf1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a2d1fd9d0bd476a907bb51748355ac9'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:14.459057 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1072/2142] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:57:13 2022] DELETE /identity/v3/users/7a2d1fd9d0bd476a907bb51748355ac9 => generated 0 bytes in 937 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:14.463311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf33bdb-0a98-4bbf-9417-2a7b36bb42d1 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:14.464819 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf33bdb-0a98-4bbf-9417-2a7b36bb42d1 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:14.464819 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf33bdb-0a98-4bbf-9417-2a7b36bb42d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:14.484853 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-8bf33bdb-0a98-4bbf-9417-2a7b36bb42d1 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:14.486217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-8bf33bdb-0a98-4bbf-9417-2a7b36bb42d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:14.563202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1071/2143] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:14.573641 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749d2b7-68ac-4f02-9181-db553f2daf1d admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:14.575182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-1749d2b7-68ac-4f02-9181-db553f2daf1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:14.672290 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749d2b7-68ac-4f02-9181-db553f2daf1d admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:14.677019 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5561c3b-f4be-4f67-b9a6-8d0d91004fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:14.678187 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5561c3b-f4be-4f67-b9a6-8d0d91004fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:14.678187 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5561c3b-f4be-4f67-b9a6-8d0d91004fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:14.678408 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5561c3b-f4be-4f67-b9a6-8d0d91004fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:14.690070 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5561c3b-f4be-4f67-b9a6-8d0d91004fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:14.691632 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5561c3b-f4be-4f67-b9a6-8d0d91004fa1 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:14.712947 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1073/2144] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:15.529065 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf33bdb-0a98-4bbf-9417-2a7b36bb42d1 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:15.531118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-8bf33bdb-0a98-4bbf-9417-2a7b36bb42d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:15.545436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf33bdb-0a98-4bbf-9417-2a7b36bb42d1 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:15.553909 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65305c2e-b039-41ec-aac1-58bfe7e9e33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:15.554650 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65305c2e-b039-41ec-aac1-58bfe7e9e33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:15.571076 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65305c2e-b039-41ec-aac1-58bfe7e9e33a admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:15.571076 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65305c2e-b039-41ec-aac1-58bfe7e9e33a admin admin] PATH_INFO: `/v3/projects/3c8627cefedb41389b0446751c93dd62` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:15.571076 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65305c2e-b039-41ec-aac1-58bfe7e9e33a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8627cefedb41389b0446751c93dd62)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:15.571076 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65305c2e-b039-41ec-aac1-58bfe7e9e33a admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:15.717433 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-65305c2e-b039-41ec-aac1-58bfe7e9e33a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8627cefedb41389b0446751c93dd62', 'request_id': 'req-65305c2e-b039-41ec-aac1-58bfe7e9e33a'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:15.846849 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-65305c2e-b039-41ec-aac1-58bfe7e9e33a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8627cefedb41389b0446751c93dd62', 'request_id': 'req-65305c2e-b039-41ec-aac1-58bfe7e9e33a'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:15.860937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-65305c2e-b039-41ec-aac1-58bfe7e9e33a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8627cefedb41389b0446751c93dd62', 'request_id': 'req-65305c2e-b039-41ec-aac1-58bfe7e9e33a'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:15.874082 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-65305c2e-b039-41ec-aac1-58bfe7e9e33a admin admin] The token cache is being invalidate because project 3c8627cefedb41389b0446751c93dd62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:15.874551 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-65305c2e-b039-41ec-aac1-58bfe7e9e33a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:15.875255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-65305c2e-b039-41ec-aac1-58bfe7e9e33a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:15.876940 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1072/2145] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:15 2022] DELETE /identity/v3/projects/3c8627cefedb41389b0446751c93dd62 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:15.881848 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5561c3b-f4be-4f67-b9a6-8d0d91004fa1 service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:15.892118 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5561c3b-f4be-4f67-b9a6-8d0d91004fa1 service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:15.958580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d3c51-bad8-41da-a2d2-c083aecb90b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:15.959260 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d3c51-bad8-41da-a2d2-c083aecb90b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:15.959713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d3c51-bad8-41da-a2d2-c083aecb90b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:15.960117 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d3c51-bad8-41da-a2d2-c083aecb90b3 admin admin] PATH_INFO: `/v3/users/600d52e300924dc88726c3ef4da51cab` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:15.961276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d3c51-bad8-41da-a2d2-c083aecb90b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=600d52e300924dc88726c3ef4da51cab)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:15.963421 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d3c51-bad8-41da-a2d2-c083aecb90b3 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:16.026069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:16.250226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-575d3c51-bad8-41da-a2d2-c083aecb90b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '600d52e300924dc88726c3ef4da51cab'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:16.351502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-575d3c51-bad8-41da-a2d2-c083aecb90b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '600d52e300924dc88726c3ef4da51cab'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:16.351502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-575d3c51-bad8-41da-a2d2-c083aecb90b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '600d52e300924dc88726c3ef4da51cab'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:16.365535 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-575d3c51-bad8-41da-a2d2-c083aecb90b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '600d52e300924dc88726c3ef4da51cab'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:16.404277 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-575d3c51-bad8-41da-a2d2-c083aecb90b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '600d52e300924dc88726c3ef4da51cab'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:16.412910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1074/2146] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:57:15 2022] DELETE /identity/v3/users/600d52e300924dc88726c3ef4da51cab => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:16.817971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:17.301296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65305c2e-b039-41ec-aac1-58bfe7e9e33a admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:17.302765 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-65305c2e-b039-41ec-aac1-58bfe7e9e33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:17.317127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65305c2e-b039-41ec-aac1-58bfe7e9e33a admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:17.377795 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373bea5-accd-4967-9acf-f53d381acdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:17.379232 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373bea5-accd-4967-9acf-f53d381acdbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:17.379581 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373bea5-accd-4967-9acf-f53d381acdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:17.379927 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373bea5-accd-4967-9acf-f53d381acdbd admin admin] PATH_INFO: `/v3/projects/a7009a8975414f8a80f1f12412a40415` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:17.381131 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373bea5-accd-4967-9acf-f53d381acdbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7009a8975414f8a80f1f12412a40415)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:17.383037 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373bea5-accd-4967-9acf-f53d381acdbd admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:17.534120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-3373bea5-accd-4967-9acf-f53d381acdbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7009a8975414f8a80f1f12412a40415', 'request_id': 'req-3373bea5-accd-4967-9acf-f53d381acdbd'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:17.715866 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-3373bea5-accd-4967-9acf-f53d381acdbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7009a8975414f8a80f1f12412a40415', 'request_id': 'req-3373bea5-accd-4967-9acf-f53d381acdbd'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:17.723643 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-3373bea5-accd-4967-9acf-f53d381acdbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7009a8975414f8a80f1f12412a40415', 'request_id': 'req-3373bea5-accd-4967-9acf-f53d381acdbd'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:17.745774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-3373bea5-accd-4967-9acf-f53d381acdbd admin admin] The token cache is being invalidate because project a7009a8975414f8a80f1f12412a40415 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:17.752737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-3373bea5-accd-4967-9acf-f53d381acdbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:17.755361 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-3373bea5-accd-4967-9acf-f53d381acdbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:17.761415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1073/2147] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:17 2022] DELETE /identity/v3/projects/a7009a8975414f8a80f1f12412a40415 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:17.762478 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d3c51-bad8-41da-a2d2-c083aecb90b3 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:17.764081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-575d3c51-bad8-41da-a2d2-c083aecb90b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:17.788498 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d3c51-bad8-41da-a2d2-c083aecb90b3 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:17.931604 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac6e5d-8066-4eff-a2b4-c34d30d2d9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:17.932274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac6e5d-8066-4eff-a2b4-c34d30d2d9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:17.932555 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac6e5d-8066-4eff-a2b4-c34d30d2d9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:17.932827 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac6e5d-8066-4eff-a2b4-c34d30d2d9aa admin admin] PATH_INFO: `/v3/users/ba9d4a604a3a486c8ab9e424d19ff0c4` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:17.935076 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac6e5d-8066-4eff-a2b4-c34d30d2d9aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba9d4a604a3a486c8ab9e424d19ff0c4)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:17.937078 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac6e5d-8066-4eff-a2b4-c34d30d2d9aa admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:18.208260 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-b6ac6e5d-8066-4eff-a2b4-c34d30d2d9aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba9d4a604a3a486c8ab9e424d19ff0c4'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:18.316690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-b6ac6e5d-8066-4eff-a2b4-c34d30d2d9aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba9d4a604a3a486c8ab9e424d19ff0c4'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:18.317703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-b6ac6e5d-8066-4eff-a2b4-c34d30d2d9aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba9d4a604a3a486c8ab9e424d19ff0c4'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:18.342382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-b6ac6e5d-8066-4eff-a2b4-c34d30d2d9aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba9d4a604a3a486c8ab9e424d19ff0c4'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:18.354508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-b6ac6e5d-8066-4eff-a2b4-c34d30d2d9aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba9d4a604a3a486c8ab9e424d19ff0c4'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:18.361925 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1075/2148] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:57:17 2022] DELETE /identity/v3/users/ba9d4a604a3a486c8ab9e424d19ff0c4 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:18.939000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373bea5-accd-4967-9acf-f53d381acdbd admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:18.941045 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3373bea5-accd-4967-9acf-f53d381acdbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:19.013379 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373bea5-accd-4967-9acf-f53d381acdbd admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:19.129877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5531cd5-25e7-4d32-8bf5-22be5bcee88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:19.131359 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5531cd5-25e7-4d32-8bf5-22be5bcee88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:19.132942 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5531cd5-25e7-4d32-8bf5-22be5bcee88a admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:19.138369 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5531cd5-25e7-4d32-8bf5-22be5bcee88a admin admin] PATH_INFO: `/v3/users/b91ea7ebade74e72b1b8983834300508` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:19.138369 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5531cd5-25e7-4d32-8bf5-22be5bcee88a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b91ea7ebade74e72b1b8983834300508)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:19.138369 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5531cd5-25e7-4d32-8bf5-22be5bcee88a admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:19.186471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:19.437969 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d5531cd5-25e7-4d32-8bf5-22be5bcee88a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b91ea7ebade74e72b1b8983834300508'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:19.477486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac6e5d-8066-4eff-a2b4-c34d30d2d9aa admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:19.490926 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-b6ac6e5d-8066-4eff-a2b4-c34d30d2d9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:19.526474 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac6e5d-8066-4eff-a2b4-c34d30d2d9aa admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:19.529880 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d5531cd5-25e7-4d32-8bf5-22be5bcee88a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b91ea7ebade74e72b1b8983834300508'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:19.530781 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d5531cd5-25e7-4d32-8bf5-22be5bcee88a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b91ea7ebade74e72b1b8983834300508'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:19.543233 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d5531cd5-25e7-4d32-8bf5-22be5bcee88a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b91ea7ebade74e72b1b8983834300508'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:19.545653 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56654a57-af90-4ab7-a3ad-410d7344e7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:19.546574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56654a57-af90-4ab7-a3ad-410d7344e7a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:19.547057 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56654a57-af90-4ab7-a3ad-410d7344e7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:19.547577 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56654a57-af90-4ab7-a3ad-410d7344e7a5 admin admin] PATH_INFO: `/v3/projects/9685aef2c16e4c3b8a053637951c8a77` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:19.553803 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56654a57-af90-4ab7-a3ad-410d7344e7a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9685aef2c16e4c3b8a053637951c8a77)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:19.562554 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56654a57-af90-4ab7-a3ad-410d7344e7a5 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:19.571448 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d5531cd5-25e7-4d32-8bf5-22be5bcee88a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b91ea7ebade74e72b1b8983834300508'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:19.585638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1074/2149] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:57:18 2022] DELETE /identity/v3/users/b91ea7ebade74e72b1b8983834300508 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:19.590717 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0e2e0-d9ab-4bf2-9530-06673d1734b0 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:19.591116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0e2e0-d9ab-4bf2-9530-06673d1734b0 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:19.591501 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0e2e0-d9ab-4bf2-9530-06673d1734b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:19.613545 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-3ea0e2e0-d9ab-4bf2-9530-06673d1734b0 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:19.615016 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3ea0e2e0-d9ab-4bf2-9530-06673d1734b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:19.695316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-56654a57-af90-4ab7-a3ad-410d7344e7a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9685aef2c16e4c3b8a053637951c8a77', 'request_id': 'req-56654a57-af90-4ab7-a3ad-410d7344e7a5'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:19.700504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1075/2150] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:57:19.718806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0e2e0-d9ab-4bf2-9530-06673d1734b0 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:19.720643 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3ea0e2e0-d9ab-4bf2-9530-06673d1734b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:19.744856 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:19.761768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-56654a57-af90-4ab7-a3ad-410d7344e7a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9685aef2c16e4c3b8a053637951c8a77', 'request_id': 'req-56654a57-af90-4ab7-a3ad-410d7344e7a5'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:19.774395 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-56654a57-af90-4ab7-a3ad-410d7344e7a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9685aef2c16e4c3b8a053637951c8a77', 'request_id': 'req-56654a57-af90-4ab7-a3ad-410d7344e7a5'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:19.804169 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-56654a57-af90-4ab7-a3ad-410d7344e7a5 admin admin] The token cache is being invalidate because project 9685aef2c16e4c3b8a053637951c8a77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:19.804466 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-56654a57-af90-4ab7-a3ad-410d7344e7a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:19.807190 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-56654a57-af90-4ab7-a3ad-410d7344e7a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:19.812291 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1076/2151] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:19 2022] DELETE /identity/v3/projects/9685aef2c16e4c3b8a053637951c8a77 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:19.817597 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66ceeb-baf8-4728-b65a-21cdeb1dbd46 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:19.818127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66ceeb-baf8-4728-b65a-21cdeb1dbd46 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:19.818590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66ceeb-baf8-4728-b65a-21cdeb1dbd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:19.870796 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0e2e0-d9ab-4bf2-9530-06673d1734b0 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:19.879063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-2d66ceeb-baf8-4728-b65a-21cdeb1dbd46 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:19.880815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2d66ceeb-baf8-4728-b65a-21cdeb1dbd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:19.943131 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa05d2-a7d0-4692-88b1-976e40418e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:19.944481 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa05d2-a7d0-4692-88b1-976e40418e33 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:19.944902 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa05d2-a7d0-4692-88b1-976e40418e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:19.945433 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa05d2-a7d0-4692-88b1-976e40418e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:19.947834 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-2aaa05d2-a7d0-4692-88b1-976e40418e33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:20.027412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1077/2152] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:20.036980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07331e38-baba-423e-b66d-b4f16f560635 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:20.037538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07331e38-baba-423e-b66d-b4f16f560635 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:20.037965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07331e38-baba-423e-b66d-b4f16f560635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:20.044937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa05d2-a7d0-4692-88b1-976e40418e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:20.047482 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa05d2-a7d0-4692-88b1-976e40418e33 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:20.062572 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1076/2153] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:57:20.074543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-07331e38-baba-423e-b66d-b4f16f560635 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:20.075834 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-07331e38-baba-423e-b66d-b4f16f560635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:20.086749 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1078/2154] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:20.090686 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa05d2-a7d0-4692-88b1-976e40418e33 service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:20.101827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa05d2-a7d0-4692-88b1-976e40418e33 service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:20.108307 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd82a1-6fc5-4d44-8dab-73f2829e1edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:20.108931 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd82a1-6fc5-4d44-8dab-73f2829e1edc admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:20.109208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd82a1-6fc5-4d44-8dab-73f2829e1edc admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:20.109555 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd82a1-6fc5-4d44-8dab-73f2829e1edc admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:20.110173 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd82a1-6fc5-4d44-8dab-73f2829e1edc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:57:20.110476 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd82a1-6fc5-4d44-8dab-73f2829e1edc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:20.112155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd82a1-6fc5-4d44-8dab-73f2829e1edc admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:20.126732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1077/2155] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:57:20.131863 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07331e38-baba-423e-b66d-b4f16f560635 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:20.143290 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07331e38-baba-423e-b66d-b4f16f560635 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:20.147740 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9959425-62a9-4f32-902c-778bd99b6270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:20.149187 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9959425-62a9-4f32-902c-778bd99b6270 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:20.149187 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9959425-62a9-4f32-902c-778bd99b6270 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:20.149187 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9959425-62a9-4f32-902c-778bd99b6270 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:20.149856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9959425-62a9-4f32-902c-778bd99b6270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:20.152015 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9959425-62a9-4f32-902c-778bd99b6270 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:20.182347 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:20.305962 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1079/2156] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:20 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:57:20.309513 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd82a1-6fc5-4d44-8dab-73f2829e1edc admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:20.321919 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd82a1-6fc5-4d44-8dab-73f2829e1edc admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:20.403340 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8856c-c930-4f37-967e-27aacca3a2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:20.404034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8856c-c930-4f37-967e-27aacca3a2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:20.404662 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8856c-c930-4f37-967e-27aacca3a2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:20.405000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8856c-c930-4f37-967e-27aacca3a2f7 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:20.405936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8856c-c930-4f37-967e-27aacca3a2f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:20.408237 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8856c-c930-4f37-967e-27aacca3a2f7 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:20.531003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1078/2157] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:20 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:57:20.532546 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9959425-62a9-4f32-902c-778bd99b6270 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:20.544922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9959425-62a9-4f32-902c-778bd99b6270 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:20.552736 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d895222-415f-4d70-bcbf-3f4c78001341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:20.553371 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d895222-415f-4d70-bcbf-3f4c78001341 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:20.553649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d895222-415f-4d70-bcbf-3f4c78001341 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:20.558088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d895222-415f-4d70-bcbf-3f4c78001341 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:20.558088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d895222-415f-4d70-bcbf-3f4c78001341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:20.558088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d895222-415f-4d70-bcbf-3f4c78001341 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:20.569684 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1080/2158] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:20.573639 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8856c-c930-4f37-967e-27aacca3a2f7 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:20.586000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8856c-c930-4f37-967e-27aacca3a2f7 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:20.590772 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ac681-a356-45fd-8fe8-dc625af5a5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:20.591392 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ac681-a356-45fd-8fe8-dc625af5a5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:20.591780 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ac681-a356-45fd-8fe8-dc625af5a5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:20.592056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ac681-a356-45fd-8fe8-dc625af5a5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:20.592733 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ac681-a356-45fd-8fe8-dc625af5a5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:20.594330 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ac681-a356-45fd-8fe8-dc625af5a5e5 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:20.606229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1079/2159] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:20.611517 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d895222-415f-4d70-bcbf-3f4c78001341 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:20.627515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d895222-415f-4d70-bcbf-3f4c78001341 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:20.633910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86429944-034e-4014-b193-ac3c3cb33b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:20.634682 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86429944-034e-4014-b193-ac3c3cb33b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:20.635174 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86429944-034e-4014-b193-ac3c3cb33b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:20.636182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86429944-034e-4014-b193-ac3c3cb33b4a admin admin] PATH_INFO: `/v3/projects/1b0414d5c43d43c1b217a46cbefb7d8b/users/65a656b5540143d0aa65efe5eb82a7af/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:20.655601 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86429944-034e-4014-b193-ac3c3cb33b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0414d5c43d43c1b217a46cbefb7d8b, user_id=65a656b5540143d0aa65efe5eb82a7af, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:20.660240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86429944-034e-4014-b193-ac3c3cb33b4a admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:20.764838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1081/2160] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:20 2022] PUT /identity/v3/projects/1b0414d5c43d43c1b217a46cbefb7d8b/users/65a656b5540143d0aa65efe5eb82a7af/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:20.765681 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790b7eb-1c99-4ffe-a85c-b64f96f4a266 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:20.766046 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790b7eb-1c99-4ffe-a85c-b64f96f4a266 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:20.766902 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790b7eb-1c99-4ffe-a85c-b64f96f4a266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:20.797930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-3790b7eb-1c99-4ffe-a85c-b64f96f4a266 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:20.799399 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3790b7eb-1c99-4ffe-a85c-b64f96f4a266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:20.849099 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86429944-034e-4014-b193-ac3c3cb33b4a admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:20.849099 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-86429944-034e-4014-b193-ac3c3cb33b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:20.875273 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1080/2161] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:57:20.886778 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790b7eb-1c99-4ffe-a85c-b64f96f4a266 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:20.894671 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3790b7eb-1c99-4ffe-a85c-b64f96f4a266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:20.977088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86429944-034e-4014-b193-ac3c3cb33b4a admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:20.982873 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790b7eb-1c99-4ffe-a85c-b64f96f4a266 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:20.993375 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013366c-cb80-430f-b930-b109556896e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:20.994212 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013366c-cb80-430f-b930-b109556896e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:20.994740 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013366c-cb80-430f-b930-b109556896e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:20.994875 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013366c-cb80-430f-b930-b109556896e3 admin admin] PATH_INFO: `/v3/projects/2cc62c3947dd45808ca45049dbd3ecea` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:20.996246 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013366c-cb80-430f-b930-b109556896e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cc62c3947dd45808ca45049dbd3ecea)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:20.999823 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013366c-cb80-430f-b930-b109556896e3 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:21.002878 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54900c6-77b4-40fd-8e8a-2e811b1a6998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:21.003813 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54900c6-77b4-40fd-8e8a-2e811b1a6998 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:21.005335 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54900c6-77b4-40fd-8e8a-2e811b1a6998 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:21.005616 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54900c6-77b4-40fd-8e8a-2e811b1a6998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:21.027933 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54900c6-77b4-40fd-8e8a-2e811b1a6998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:21.029444 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54900c6-77b4-40fd-8e8a-2e811b1a6998 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:21.041981 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1081/2162] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:57:21.196939 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-0013366c-cb80-430f-b930-b109556896e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cc62c3947dd45808ca45049dbd3ecea', 'request_id': 'req-0013366c-cb80-430f-b930-b109556896e3'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:21.336901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-0013366c-cb80-430f-b930-b109556896e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cc62c3947dd45808ca45049dbd3ecea', 'request_id': 'req-0013366c-cb80-430f-b930-b109556896e3'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:21.345989 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-0013366c-cb80-430f-b930-b109556896e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cc62c3947dd45808ca45049dbd3ecea', 'request_id': 'req-0013366c-cb80-430f-b930-b109556896e3'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:21.367371 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-0013366c-cb80-430f-b930-b109556896e3 admin admin] The token cache is being invalidate because project 2cc62c3947dd45808ca45049dbd3ecea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:21.367371 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-0013366c-cb80-430f-b930-b109556896e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:21.368008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-0013366c-cb80-430f-b930-b109556896e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:21.369925 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1082/2163] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:20 2022] DELETE /identity/v3/projects/2cc62c3947dd45808ca45049dbd3ecea => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:21.373683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54900c6-77b4-40fd-8e8a-2e811b1a6998 service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:21.385661 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54900c6-77b4-40fd-8e8a-2e811b1a6998 service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:21.452643 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b1d5a-c8e8-4d00-bc09-70bb2041116f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:21.453351 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b1d5a-c8e8-4d00-bc09-70bb2041116f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:21.453636 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b1d5a-c8e8-4d00-bc09-70bb2041116f admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:21.453915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b1d5a-c8e8-4d00-bc09-70bb2041116f admin admin] PATH_INFO: `/v3/users/0f754d115722464d836b1c35789a6aa3` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:21.455150 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b1d5a-c8e8-4d00-bc09-70bb2041116f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f754d115722464d836b1c35789a6aa3)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:21.458588 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b1d5a-c8e8-4d00-bc09-70bb2041116f admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:21.697881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-344b1d5a-c8e8-4d00-bc09-70bb2041116f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f754d115722464d836b1c35789a6aa3'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:21.816329 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-344b1d5a-c8e8-4d00-bc09-70bb2041116f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f754d115722464d836b1c35789a6aa3'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:21.816449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-344b1d5a-c8e8-4d00-bc09-70bb2041116f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f754d115722464d836b1c35789a6aa3'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:21.826751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-344b1d5a-c8e8-4d00-bc09-70bb2041116f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f754d115722464d836b1c35789a6aa3'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:21.863119 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-344b1d5a-c8e8-4d00-bc09-70bb2041116f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f754d115722464d836b1c35789a6aa3'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:21.874616 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1082/2164] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:57:21 2022] DELETE /identity/v3/users/0f754d115722464d836b1c35789a6aa3 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:21.904471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:22.609764 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013366c-cb80-430f-b930-b109556896e3 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:22.612905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-0013366c-cb80-430f-b930-b109556896e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:22.629881 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013366c-cb80-430f-b930-b109556896e3 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:22.754036 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac7437-f3b5-40de-bc3a-64cdf2aa9a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:22.755427 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac7437-f3b5-40de-bc3a-64cdf2aa9a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:22.755828 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac7437-f3b5-40de-bc3a-64cdf2aa9a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:22.756371 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac7437-f3b5-40de-bc3a-64cdf2aa9a01 admin admin] PATH_INFO: `/v3/projects/ace0ce88c9834409820a3d393341915a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:22.757641 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac7437-f3b5-40de-bc3a-64cdf2aa9a01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace0ce88c9834409820a3d393341915a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:22.759709 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac7437-f3b5-40de-bc3a-64cdf2aa9a01 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:22.905942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-eeac7437-f3b5-40de-bc3a-64cdf2aa9a01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace0ce88c9834409820a3d393341915a', 'request_id': 'req-eeac7437-f3b5-40de-bc3a-64cdf2aa9a01'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:22.983526 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-eeac7437-f3b5-40de-bc3a-64cdf2aa9a01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace0ce88c9834409820a3d393341915a', 'request_id': 'req-eeac7437-f3b5-40de-bc3a-64cdf2aa9a01'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:22.995185 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-eeac7437-f3b5-40de-bc3a-64cdf2aa9a01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace0ce88c9834409820a3d393341915a', 'request_id': 'req-eeac7437-f3b5-40de-bc3a-64cdf2aa9a01'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:23.025046 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-eeac7437-f3b5-40de-bc3a-64cdf2aa9a01 admin admin] The token cache is being invalidate because project ace0ce88c9834409820a3d393341915a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:23.025234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-eeac7437-f3b5-40de-bc3a-64cdf2aa9a01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:23.025872 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-eeac7437-f3b5-40de-bc3a-64cdf2aa9a01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:23.028852 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1083/2165] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:22 2022] DELETE /identity/v3/projects/ace0ce88c9834409820a3d393341915a => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:23.039125 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab340ff-4c7e-4085-9704-0636ac0a535d None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:23.039698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab340ff-4c7e-4085-9704-0636ac0a535d None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:23.039698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab340ff-4c7e-4085-9704-0636ac0a535d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:23.064159 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-cab340ff-4c7e-4085-9704-0636ac0a535d None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:23.065525 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-cab340ff-4c7e-4085-9704-0636ac0a535d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:23.138534 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1083/2166] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:57:23.146444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0c4b3-25f5-4d1c-b7ad-918dff119311 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:23.146763 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0c4b3-25f5-4d1c-b7ad-918dff119311 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:23.147040 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0c4b3-25f5-4d1c-b7ad-918dff119311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:23.169818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-6df0c4b3-25f5-4d1c-b7ad-918dff119311 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:23.171185 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-6df0c4b3-25f5-4d1c-b7ad-918dff119311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:23.181759 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1084/2167] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:23.197561 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab340ff-4c7e-4085-9704-0636ac0a535d None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:23.212196 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab340ff-4c7e-4085-9704-0636ac0a535d None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:23.216888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99449e-a130-4b0d-9c21-5b7010322817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:23.217624 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99449e-a130-4b0d-9c21-5b7010322817 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:23.217904 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99449e-a130-4b0d-9c21-5b7010322817 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:23.218180 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99449e-a130-4b0d-9c21-5b7010322817 admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:23.218937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99449e-a130-4b0d-9c21-5b7010322817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:57:23.219440 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99449e-a130-4b0d-9c21-5b7010322817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:23.221413 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99449e-a130-4b0d-9c21-5b7010322817 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:23.236619 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1084/2168] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:57:23.250967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0c4b3-25f5-4d1c-b7ad-918dff119311 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:23.262278 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0c4b3-25f5-4d1c-b7ad-918dff119311 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:23.267751 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2ff82-70a1-4f1b-a32a-71b3f6ae9488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:23.269308 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2ff82-70a1-4f1b-a32a-71b3f6ae9488 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:23.269601 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2ff82-70a1-4f1b-a32a-71b3f6ae9488 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:23.269906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2ff82-70a1-4f1b-a32a-71b3f6ae9488 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:23.270556 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2ff82-70a1-4f1b-a32a-71b3f6ae9488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:23.272596 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2ff82-70a1-4f1b-a32a-71b3f6ae9488 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:23.403284 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99449e-a130-4b0d-9c21-5b7010322817 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:23.405107 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-9f99449e-a130-4b0d-9c21-5b7010322817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:23.414464 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:23.424558 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99449e-a130-4b0d-9c21-5b7010322817 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:23.428684 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1085/2169] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:23 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:57:23.432791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2ff82-70a1-4f1b-a32a-71b3f6ae9488 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:23.554847 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2ff82-70a1-4f1b-a32a-71b3f6ae9488 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:23.563930 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b449413-647b-478d-a758-11b1aa02a21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:23.564574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b449413-647b-478d-a758-11b1aa02a21b admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:23.564848 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b449413-647b-478d-a758-11b1aa02a21b admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:23.565262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b449413-647b-478d-a758-11b1aa02a21b admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:23.566450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b449413-647b-478d-a758-11b1aa02a21b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:23.568668 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b449413-647b-478d-a758-11b1aa02a21b admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:23.577897 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d5787-2247-4163-813b-7c4feed3b5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:23.579041 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d5787-2247-4163-813b-7c4feed3b5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:23.579300 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d5787-2247-4163-813b-7c4feed3b5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:23.579584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d5787-2247-4163-813b-7c4feed3b5a8 admin admin] PATH_INFO: `/v3/users/ffe90bd71b584c0893de5587ceee05f3` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:23.580781 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d5787-2247-4163-813b-7c4feed3b5a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffe90bd71b584c0893de5587ceee05f3)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:23.582997 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d5787-2247-4163-813b-7c4feed3b5a8 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:23.683706 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1086/2170] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:23 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:57:23.685844 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2556de-18f8-44d6-9053-10c197f876af None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:23.686670 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2556de-18f8-44d6-9053-10c197f876af None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:23.687136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2556de-18f8-44d6-9053-10c197f876af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:23.722723 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-ec2556de-18f8-44d6-9053-10c197f876af None None] MFA Rules not processed for user `65a656b5540143d0aa65efe5eb82a7af`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:23.724018 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ec2556de-18f8-44d6-9053-10c197f876af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:23.794095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1087/2171] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:23.794969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2556de-18f8-44d6-9053-10c197f876af None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:23.806926 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2556de-18f8-44d6-9053-10c197f876af None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:23.811907 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abed8a-cbfd-452c-b330-5ae79ff97261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:23.812457 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abed8a-cbfd-452c-b330-5ae79ff97261 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:23.812776 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abed8a-cbfd-452c-b330-5ae79ff97261 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:23.813090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abed8a-cbfd-452c-b330-5ae79ff97261 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:23.813927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abed8a-cbfd-452c-b330-5ae79ff97261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:23.816847 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abed8a-cbfd-452c-b330-5ae79ff97261 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:23.833353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1088/2172] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:23.834473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abed8a-cbfd-452c-b330-5ae79ff97261 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:23.836284 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c9abed8a-cbfd-452c-b330-5ae79ff97261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:23.837999 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:23.897349 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abed8a-cbfd-452c-b330-5ae79ff97261 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:23.901205 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4d2ea-0f8c-4d5d-951d-d9e119c24a71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:23.901759 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4d2ea-0f8c-4d5d-951d-d9e119c24a71 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:23.902036 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4d2ea-0f8c-4d5d-951d-d9e119c24a71 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:23.902379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4d2ea-0f8c-4d5d-951d-d9e119c24a71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:23.916514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4d2ea-0f8c-4d5d-951d-d9e119c24a71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:23.918821 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4d2ea-0f8c-4d5d-951d-d9e119c24a71 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:23.923370 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d69d5787-2247-4163-813b-7c4feed3b5a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffe90bd71b584c0893de5587ceee05f3'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:23.931866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1089/2173] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:23.932970 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4d2ea-0f8c-4d5d-951d-d9e119c24a71 service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:23.951520 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4d2ea-0f8c-4d5d-951d-d9e119c24a71 service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:23.954537 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802c4cc-2cb2-458c-a80d-3485d34b2713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:23.955141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802c4cc-2cb2-458c-a80d-3485d34b2713 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:23.955421 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802c4cc-2cb2-458c-a80d-3485d34b2713 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:23.955721 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802c4cc-2cb2-458c-a80d-3485d34b2713 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:23.956979 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802c4cc-2cb2-458c-a80d-3485d34b2713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:23.958916 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802c4cc-2cb2-458c-a80d-3485d34b2713 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:23.970892 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1090/2174] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:23.976559 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802c4cc-2cb2-458c-a80d-3485d34b2713 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:23.989760 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802c4cc-2cb2-458c-a80d-3485d34b2713 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:23.995054 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c71498-01e8-4c6e-b1ff-c0782fdde0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:23.995819 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c71498-01e8-4c6e-b1ff-c0782fdde0c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:23.996098 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c71498-01e8-4c6e-b1ff-c0782fdde0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:23.996371 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c71498-01e8-4c6e-b1ff-c0782fdde0c9 admin admin] PATH_INFO: `/v3/projects/d88b9863a0114ae8adec676bcdf473fb/users/f0c34fc7eed943dcb5365e185de509a4/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:24.016345 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c71498-01e8-4c6e-b1ff-c0782fdde0c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d88b9863a0114ae8adec676bcdf473fb, user_id=f0c34fc7eed943dcb5365e185de509a4, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:24.019479 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c71498-01e8-4c6e-b1ff-c0782fdde0c9 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:24.027332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d69d5787-2247-4163-813b-7c4feed3b5a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffe90bd71b584c0893de5587ceee05f3'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:24.027811 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d69d5787-2247-4163-813b-7c4feed3b5a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffe90bd71b584c0893de5587ceee05f3'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:24.037054 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d69d5787-2247-4163-813b-7c4feed3b5a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffe90bd71b584c0893de5587ceee05f3'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:24.051033 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d69d5787-2247-4163-813b-7c4feed3b5a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffe90bd71b584c0893de5587ceee05f3'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:24.058053 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1085/2175] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:57:23 2022] DELETE /identity/v3/users/ffe90bd71b584c0893de5587ceee05f3 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:57:24.062652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96ed8d-67c9-45ec-b164-7f565f2f06bf None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:24.063152 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96ed8d-67c9-45ec-b164-7f565f2f06bf None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:24.063469 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96ed8d-67c9-45ec-b164-7f565f2f06bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:24.086396 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-8c96ed8d-67c9-45ec-b164-7f565f2f06bf None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:24.087906 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-8c96ed8d-67c9-45ec-b164-7f565f2f06bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:24.151897 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1091/2176] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:23 2022] PUT /identity/v3/projects/d88b9863a0114ae8adec676bcdf473fb/users/f0c34fc7eed943dcb5365e185de509a4/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:24.164395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1086/2177] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:24.169314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb023d4e-1726-4d82-8acb-60d5ba9e2f0c None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:24.169693 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb023d4e-1726-4d82-8acb-60d5ba9e2f0c None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:24.169986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb023d4e-1726-4d82-8acb-60d5ba9e2f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:24.177045 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96ed8d-67c9-45ec-b164-7f565f2f06bf None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:24.178518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-8c96ed8d-67c9-45ec-b164-7f565f2f06bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:24.202509 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-fb023d4e-1726-4d82-8acb-60d5ba9e2f0c None None] MFA Rules not processed for user `f0c34fc7eed943dcb5365e185de509a4`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:24.203787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-fb023d4e-1726-4d82-8acb-60d5ba9e2f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:24.244719 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96ed8d-67c9-45ec-b164-7f565f2f06bf None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:24.286176 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1092/2178] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:24.288708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb023d4e-1726-4d82-8acb-60d5ba9e2f0c None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:24.290121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-fb023d4e-1726-4d82-8acb-60d5ba9e2f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:24.318885 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027e71f-d04e-42e0-9fcc-d1c4190e8edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:24.319508 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027e71f-d04e-42e0-9fcc-d1c4190e8edc service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:24.319816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027e71f-d04e-42e0-9fcc-d1c4190e8edc service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:24.323263 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027e71f-d04e-42e0-9fcc-d1c4190e8edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:24.381867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb023d4e-1726-4d82-8acb-60d5ba9e2f0c None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:24.387843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64fc5e-effa-4428-b31d-5fa0424f519b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:24.388483 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64fc5e-effa-4428-b31d-5fa0424f519b admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:24.388804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64fc5e-effa-4428-b31d-5fa0424f519b admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:24.389005 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64fc5e-effa-4428-b31d-5fa0424f519b admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:24.389779 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64fc5e-effa-4428-b31d-5fa0424f519b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:24.391717 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64fc5e-effa-4428-b31d-5fa0424f519b admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:24.416093 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027e71f-d04e-42e0-9fcc-d1c4190e8edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:24.418319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027e71f-d04e-42e0-9fcc-d1c4190e8edc service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:24.433608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1087/2179] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:24.537658 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1093/2180] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:24 2022] POST /identity/v3/projects => generated 379 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:24.539904 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027e71f-d04e-42e0-9fcc-d1c4190e8edc service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:24.570259 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027e71f-d04e-42e0-9fcc-d1c4190e8edc service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:24.663566 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7218b-7afd-4594-b534-7d5e9822e49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:24.663566 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7218b-7afd-4594-b534-7d5e9822e49a admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:24.663566 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7218b-7afd-4594-b534-7d5e9822e49a admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:24.663566 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7218b-7afd-4594-b534-7d5e9822e49a admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:24.663981 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7218b-7afd-4594-b534-7d5e9822e49a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:24.665310 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7218b-7afd-4594-b534-7d5e9822e49a admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:24.781235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1088/2181] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:24 2022] POST /identity/v3/users => generated 296 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:24.783200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64fc5e-effa-4428-b31d-5fa0424f519b admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:24.802420 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64fc5e-effa-4428-b31d-5fa0424f519b admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:24.811930 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d7678-3057-402f-81b6-5c69d8b3f47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:24.812967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d7678-3057-402f-81b6-5c69d8b3f47a admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:24.813366 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d7678-3057-402f-81b6-5c69d8b3f47a admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:24.813750 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d7678-3057-402f-81b6-5c69d8b3f47a admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:24.815164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d7678-3057-402f-81b6-5c69d8b3f47a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:24.818062 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d7678-3057-402f-81b6-5c69d8b3f47a admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:24.844134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1094/2182] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:57:24.844735 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7218b-7afd-4594-b534-7d5e9822e49a admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:24.856606 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7218b-7afd-4594-b534-7d5e9822e49a admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:24.872539 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9541c-0f24-4e7b-bf27-c9dce5144c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:24.873308 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9541c-0f24-4e7b-bf27-c9dce5144c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:24.873671 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9541c-0f24-4e7b-bf27-c9dce5144c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:24.874182 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9541c-0f24-4e7b-bf27-c9dce5144c78 admin admin] PATH_INFO: `/v3/projects/da9f7ba0f8c04d7aae2f6c48cba7e602/users/c21b71cadfc24d2e802532ff7fa3ec45/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:24.920703 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9541c-0f24-4e7b-bf27-c9dce5144c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9f7ba0f8c04d7aae2f6c48cba7e602, user_id=c21b71cadfc24d2e802532ff7fa3ec45, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:24.928688 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9541c-0f24-4e7b-bf27-c9dce5144c78 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:25.019915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1089/2183] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:24 2022] PUT /identity/v3/projects/da9f7ba0f8c04d7aae2f6c48cba7e602/users/c21b71cadfc24d2e802532ff7fa3ec45/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:25.024370 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d7678-3057-402f-81b6-5c69d8b3f47a admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:25.036364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d7678-3057-402f-81b6-5c69d8b3f47a admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:25.104145 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7053378-adb6-4a71-9167-3e475d6cd9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:25.104775 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7053378-adb6-4a71-9167-3e475d6cd9af admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:25.105052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7053378-adb6-4a71-9167-3e475d6cd9af admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:25.105390 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7053378-adb6-4a71-9167-3e475d6cd9af admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:25.106142 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7053378-adb6-4a71-9167-3e475d6cd9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:25.107832 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7053378-adb6-4a71-9167-3e475d6cd9af admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:25.118132 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1095/2184] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:25.122615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9541c-0f24-4e7b-bf27-c9dce5144c78 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:25.133175 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9541c-0f24-4e7b-bf27-c9dce5144c78 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:25.138715 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72cf86-1987-4224-8a2d-1510e70a89e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:25.139386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72cf86-1987-4224-8a2d-1510e70a89e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:25.139700 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72cf86-1987-4224-8a2d-1510e70a89e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:25.149480 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72cf86-1987-4224-8a2d-1510e70a89e9 admin admin] PATH_INFO: `/v3/projects/da9f7ba0f8c04d7aae2f6c48cba7e602/users/c21b71cadfc24d2e802532ff7fa3ec45/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:25.149480 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72cf86-1987-4224-8a2d-1510e70a89e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9f7ba0f8c04d7aae2f6c48cba7e602, user_id=c21b71cadfc24d2e802532ff7fa3ec45, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:25.149480 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72cf86-1987-4224-8a2d-1510e70a89e9 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:25.160803 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7053378-adb6-4a71-9167-3e475d6cd9af admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:25.171302 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a7053378-adb6-4a71-9167-3e475d6cd9af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:25.171856 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1090/2185] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:25 2022] PUT /identity/v3/projects/da9f7ba0f8c04d7aae2f6c48cba7e602/users/c21b71cadfc24d2e802532ff7fa3ec45/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:25.178322 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cd7a1-1ae3-481c-a779-4609342d783a None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:25.183381 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cd7a1-1ae3-481c-a779-4609342d783a None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:25.183381 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cd7a1-1ae3-481c-a779-4609342d783a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:25.197797 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7053378-adb6-4a71-9167-3e475d6cd9af admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:25.220186 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-ac4cd7a1-1ae3-481c-a779-4609342d783a None None] MFA Rules not processed for user `c21b71cadfc24d2e802532ff7fa3ec45`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:25.221394 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ac4cd7a1-1ae3-481c-a779-4609342d783a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:25.263394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fca2c-7bb6-4a32-a45b-49144f749337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:25.264160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fca2c-7bb6-4a32-a45b-49144f749337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:25.264443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fca2c-7bb6-4a32-a45b-49144f749337 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:25.264720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fca2c-7bb6-4a32-a45b-49144f749337 admin admin] PATH_INFO: `/v3/projects/5dc2524b9da54bb5bcdd0d143a161f02` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:25.265892 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fca2c-7bb6-4a32-a45b-49144f749337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc2524b9da54bb5bcdd0d143a161f02)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:25.267866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fca2c-7bb6-4a32-a45b-49144f749337 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:25.301760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1091/2186] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:25.408417 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cd7a1-1ae3-481c-a779-4609342d783a None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:25.410697 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ac4cd7a1-1ae3-481c-a779-4609342d783a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:25.446915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d29fca2c-7bb6-4a32-a45b-49144f749337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc2524b9da54bb5bcdd0d143a161f02', 'request_id': 'req-d29fca2c-7bb6-4a32-a45b-49144f749337'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:25.474075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cd7a1-1ae3-481c-a779-4609342d783a None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:25.526031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d29fca2c-7bb6-4a32-a45b-49144f749337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc2524b9da54bb5bcdd0d143a161f02', 'request_id': 'req-d29fca2c-7bb6-4a32-a45b-49144f749337'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:25.526280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca5aa7-281e-49a4-9a5f-a3425027bbed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:25.526714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca5aa7-281e-49a4-9a5f-a3425027bbed service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:25.526995 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca5aa7-281e-49a4-9a5f-a3425027bbed service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:25.527264 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca5aa7-281e-49a4-9a5f-a3425027bbed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:25.533777 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d29fca2c-7bb6-4a32-a45b-49144f749337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc2524b9da54bb5bcdd0d143a161f02', 'request_id': 'req-d29fca2c-7bb6-4a32-a45b-49144f749337'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:25.553273 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d29fca2c-7bb6-4a32-a45b-49144f749337 admin admin] The token cache is being invalidate because project 5dc2524b9da54bb5bcdd0d143a161f02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:25.553595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d29fca2c-7bb6-4a32-a45b-49144f749337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:25.556330 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d29fca2c-7bb6-4a32-a45b-49144f749337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:25.563796 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1096/2187] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:25 2022] DELETE /identity/v3/projects/5dc2524b9da54bb5bcdd0d143a161f02 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:25.565187 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d44bb-7d75-420f-9ea3-7496f9b15f25 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:25.565527 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d44bb-7d75-420f-9ea3-7496f9b15f25 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:25.565811 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d44bb-7d75-420f-9ea3-7496f9b15f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:25.612034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-5c1d44bb-7d75-420f-9ea3-7496f9b15f25 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:25.613767 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-5c1d44bb-7d75-420f-9ea3-7496f9b15f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:25.642839 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca5aa7-281e-49a4-9a5f-a3425027bbed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:25.644835 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca5aa7-281e-49a4-9a5f-a3425027bbed service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:25.654586 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1092/2188] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:57:25.686141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1097/2189] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:57:25.697758 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e6c15-c08c-425b-b13d-5d8b0a831c90 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:25.698244 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e6c15-c08c-425b-b13d-5d8b0a831c90 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:25.698673 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e6c15-c08c-425b-b13d-5d8b0a831c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:25.723167 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-943e6c15-c08c-425b-b13d-5d8b0a831c90 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:25.724747 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-943e6c15-c08c-425b-b13d-5d8b0a831c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:25.737006 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1093/2190] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:25.742771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d44bb-7d75-420f-9ea3-7496f9b15f25 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:25.761290 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d44bb-7d75-420f-9ea3-7496f9b15f25 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:25.773299 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b3865-5fcc-4cbc-bc96-cf4ad408d9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:25.774143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b3865-5fcc-4cbc-bc96-cf4ad408d9ae admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:25.774591 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b3865-5fcc-4cbc-bc96-cf4ad408d9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:25.775036 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b3865-5fcc-4cbc-bc96-cf4ad408d9ae admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:25.775965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b3865-5fcc-4cbc-bc96-cf4ad408d9ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:57:25.776551 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b3865-5fcc-4cbc-bc96-cf4ad408d9ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:25.782380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b3865-5fcc-4cbc-bc96-cf4ad408d9ae admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:25.794755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e6c15-c08c-425b-b13d-5d8b0a831c90 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:25.796193 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-943e6c15-c08c-425b-b13d-5d8b0a831c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:25.796607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1098/2191] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:57:25.801682 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b3865-5fcc-4cbc-bc96-cf4ad408d9ae admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:25.810182 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e6c15-c08c-425b-b13d-5d8b0a831c90 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:25.814594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b3865-5fcc-4cbc-bc96-cf4ad408d9ae admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:25.814790 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69dadf-db44-4038-bdd1-492a0c19dede service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:25.815985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69dadf-db44-4038-bdd1-492a0c19dede service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:25.816278 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69dadf-db44-4038-bdd1-492a0c19dede service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:25.816549 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69dadf-db44-4038-bdd1-492a0c19dede service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:25.819600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-9c69dadf-db44-4038-bdd1-492a0c19dede service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:25.822096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07632f55-790c-490b-8717-09bd269cbb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:25.822888 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07632f55-790c-490b-8717-09bd269cbb32 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:25.823155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07632f55-790c-490b-8717-09bd269cbb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:25.823426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07632f55-790c-490b-8717-09bd269cbb32 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:25.824148 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07632f55-790c-490b-8717-09bd269cbb32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:25.826376 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07632f55-790c-490b-8717-09bd269cbb32 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:25.925709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69dadf-db44-4038-bdd1-492a0c19dede service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:25.927599 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69dadf-db44-4038-bdd1-492a0c19dede service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:25.945271 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1099/2192] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:25 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:57:25.949987 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07632f55-790c-490b-8717-09bd269cbb32 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:25.957126 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1094/2193] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:25.992757 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9673474-d98f-43ae-8bf2-80bde2887c69 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:25.993049 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9673474-d98f-43ae-8bf2-80bde2887c69 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:25.993336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9673474-d98f-43ae-8bf2-80bde2887c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:26.017237 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-b9673474-d98f-43ae-8bf2-80bde2887c69 None None] MFA Rules not processed for user `65a656b5540143d0aa65efe5eb82a7af`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:26.019984 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b9673474-d98f-43ae-8bf2-80bde2887c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:26.113964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1095/2194] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:26.131473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07632f55-790c-490b-8717-09bd269cbb32 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:26.139023 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e24ce-c485-4b59-b8bb-e7ab14c333f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:26.140065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e24ce-c485-4b59-b8bb-e7ab14c333f6 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:26.140065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e24ce-c485-4b59-b8bb-e7ab14c333f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:26.140265 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e24ce-c485-4b59-b8bb-e7ab14c333f6 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:26.140890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e24ce-c485-4b59-b8bb-e7ab14c333f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:26.142998 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e24ce-c485-4b59-b8bb-e7ab14c333f6 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:26.312615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1100/2195] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:25 2022] POST /identity/v3/users => generated 293 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:26.314130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9673474-d98f-43ae-8bf2-80bde2887c69 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:26.326311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9673474-d98f-43ae-8bf2-80bde2887c69 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:26.336512 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cdca8-41a8-4a06-9dd3-b5f25ec66535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:26.337359 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cdca8-41a8-4a06-9dd3-b5f25ec66535 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:26.337709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cdca8-41a8-4a06-9dd3-b5f25ec66535 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:26.338087 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cdca8-41a8-4a06-9dd3-b5f25ec66535 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:26.338823 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cdca8-41a8-4a06-9dd3-b5f25ec66535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:26.340724 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cdca8-41a8-4a06-9dd3-b5f25ec66535 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:26.356192 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1096/2196] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:26.359938 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e24ce-c485-4b59-b8bb-e7ab14c333f6 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:26.374894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e24ce-c485-4b59-b8bb-e7ab14c333f6 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:26.386032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f06de-1390-49b6-8dc1-9cd431f914f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:26.386669 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f06de-1390-49b6-8dc1-9cd431f914f0 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:26.386949 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f06de-1390-49b6-8dc1-9cd431f914f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:26.387490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f06de-1390-49b6-8dc1-9cd431f914f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:26.388034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f06de-1390-49b6-8dc1-9cd431f914f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:26.389714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f06de-1390-49b6-8dc1-9cd431f914f0 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:26.404886 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1101/2197] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:26.409785 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cdca8-41a8-4a06-9dd3-b5f25ec66535 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:26.434124 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cdca8-41a8-4a06-9dd3-b5f25ec66535 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:26.447008 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b80556-1dc4-4576-a3e1-b8526fd04e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:26.448672 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b80556-1dc4-4576-a3e1-b8526fd04e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:26.448956 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b80556-1dc4-4576-a3e1-b8526fd04e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:26.449279 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b80556-1dc4-4576-a3e1-b8526fd04e9e admin admin] PATH_INFO: `/v3/projects/6b3e04b0bb944c67af393ea4108c175e/users/858525a46e69447a9cbddc875ed495e9/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:26.475614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b80556-1dc4-4576-a3e1-b8526fd04e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b3e04b0bb944c67af393ea4108c175e, user_id=858525a46e69447a9cbddc875ed495e9, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:26.480746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b80556-1dc4-4576-a3e1-b8526fd04e9e admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:26.629292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1097/2198] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:26 2022] PUT /identity/v3/projects/6b3e04b0bb944c67af393ea4108c175e/users/858525a46e69447a9cbddc875ed495e9/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:57:26.639903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96185b7-1a65-4ecf-a1ce-54bf9ef8e909 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:26.640194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96185b7-1a65-4ecf-a1ce-54bf9ef8e909 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:26.640600 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96185b7-1a65-4ecf-a1ce-54bf9ef8e909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:26.737897 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-c96185b7-1a65-4ecf-a1ce-54bf9ef8e909 None None] MFA Rules not processed for user `858525a46e69447a9cbddc875ed495e9`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:26.748531 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c96185b7-1a65-4ecf-a1ce-54bf9ef8e909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:26.887121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1102/2199] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:26.930082 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b80556-1dc4-4576-a3e1-b8526fd04e9e admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:27.056428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b80556-1dc4-4576-a3e1-b8526fd04e9e admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:27.063395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194712d-d897-4638-92fa-0d7e1657b8db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:27.063395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194712d-d897-4638-92fa-0d7e1657b8db service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:27.063395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194712d-d897-4638-92fa-0d7e1657b8db service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:27.063395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194712d-d897-4638-92fa-0d7e1657b8db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:27.077292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194712d-d897-4638-92fa-0d7e1657b8db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:27.079135 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194712d-d897-4638-92fa-0d7e1657b8db service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:27.090437 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1098/2200] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:27.345809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:28.598765 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:29.492893 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96185b7-1a65-4ecf-a1ce-54bf9ef8e909 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:29.493999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c96185b7-1a65-4ecf-a1ce-54bf9ef8e909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:29.576238 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96185b7-1a65-4ecf-a1ce-54bf9ef8e909 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:29.587177 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9d9ea-5842-49d3-9002-4f03a231837e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:29.587874 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9d9ea-5842-49d3-9002-4f03a231837e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:29.588605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9d9ea-5842-49d3-9002-4f03a231837e admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:29.588878 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9d9ea-5842-49d3-9002-4f03a231837e admin admin] PATH_INFO: `/v3/users/f0c34fc7eed943dcb5365e185de509a4` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:29.590359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9d9ea-5842-49d3-9002-4f03a231837e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0c34fc7eed943dcb5365e185de509a4)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:29.592455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9d9ea-5842-49d3-9002-4f03a231837e admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:29.960867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-59c9d9ea-5842-49d3-9002-4f03a231837e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0c34fc7eed943dcb5365e185de509a4'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:30.113697 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-59c9d9ea-5842-49d3-9002-4f03a231837e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0c34fc7eed943dcb5365e185de509a4'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:30.114335 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-59c9d9ea-5842-49d3-9002-4f03a231837e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0c34fc7eed943dcb5365e185de509a4'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:30.127206 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-59c9d9ea-5842-49d3-9002-4f03a231837e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0c34fc7eed943dcb5365e185de509a4'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:30.135739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-59c9d9ea-5842-49d3-9002-4f03a231837e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0c34fc7eed943dcb5365e185de509a4'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:30.141869 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1103/2201] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:57:29 2022] DELETE /identity/v3/users/f0c34fc7eed943dcb5365e185de509a4 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:30.147081 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c8f42-5ccc-487d-a6bb-209ccb15622f None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:30.147705 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c8f42-5ccc-487d-a6bb-209ccb15622f None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:30.147705 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c8f42-5ccc-487d-a6bb-209ccb15622f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:30.168634 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-3d6c8f42-5ccc-487d-a6bb-209ccb15622f None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:30.169855 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3d6c8f42-5ccc-487d-a6bb-209ccb15622f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:30.231429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1099/2202] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:30.242179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9d9ea-5842-49d3-9002-4f03a231837e admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:30.243791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-59c9d9ea-5842-49d3-9002-4f03a231837e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:30.302457 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9d9ea-5842-49d3-9002-4f03a231837e admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:30.306129 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ddf97-f203-4262-94fa-6fb95bc896a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:30.306756 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ddf97-f203-4262-94fa-6fb95bc896a2 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:30.307035 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ddf97-f203-4262-94fa-6fb95bc896a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:30.307309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ddf97-f203-4262-94fa-6fb95bc896a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:30.318203 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ddf97-f203-4262-94fa-6fb95bc896a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:30.319690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ddf97-f203-4262-94fa-6fb95bc896a2 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:30.332344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1104/2203] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:30.643984 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c8f42-5ccc-487d-a6bb-209ccb15622f None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:30.645678 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3d6c8f42-5ccc-487d-a6bb-209ccb15622f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:30.659646 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c8f42-5ccc-487d-a6bb-209ccb15622f None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:30.668794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176e995-ba33-4607-bde5-592e1a64380f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:30.669621 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176e995-ba33-4607-bde5-592e1a64380f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:30.669924 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176e995-ba33-4607-bde5-592e1a64380f admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:30.670269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176e995-ba33-4607-bde5-592e1a64380f admin admin] PATH_INFO: `/v3/users/858525a46e69447a9cbddc875ed495e9` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:30.671628 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176e995-ba33-4607-bde5-592e1a64380f admin admin] RBAC: Authorizing `identity:delete_user(user_id=858525a46e69447a9cbddc875ed495e9)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:30.673636 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176e995-ba33-4607-bde5-592e1a64380f admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:30.857703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ddf97-f203-4262-94fa-6fb95bc896a2 service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:30.859528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-5c9ddf97-f203-4262-94fa-6fb95bc896a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:30.878033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ddf97-f203-4262-94fa-6fb95bc896a2 service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:30.894416 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb9099-44d2-4b7c-949b-47b1a1d0d565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:30.895328 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c176e995-ba33-4607-bde5-592e1a64380f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '858525a46e69447a9cbddc875ed495e9'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:30.896093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb9099-44d2-4b7c-949b-47b1a1d0d565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:30.896525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb9099-44d2-4b7c-949b-47b1a1d0d565 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:30.897378 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb9099-44d2-4b7c-949b-47b1a1d0d565 admin admin] PATH_INFO: `/v3/projects/d88b9863a0114ae8adec676bcdf473fb` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:30.901567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb9099-44d2-4b7c-949b-47b1a1d0d565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d88b9863a0114ae8adec676bcdf473fb)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:30.904380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb9099-44d2-4b7c-949b-47b1a1d0d565 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:31.018181 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c176e995-ba33-4607-bde5-592e1a64380f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '858525a46e69447a9cbddc875ed495e9'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:31.019805 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c176e995-ba33-4607-bde5-592e1a64380f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '858525a46e69447a9cbddc875ed495e9'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:31.031850 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c176e995-ba33-4607-bde5-592e1a64380f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '858525a46e69447a9cbddc875ed495e9'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:31.042641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c176e995-ba33-4607-bde5-592e1a64380f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '858525a46e69447a9cbddc875ed495e9'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:31.049588 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1100/2204] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:57:30 2022] DELETE /identity/v3/users/858525a46e69447a9cbddc875ed495e9 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:31.055363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cea3b-c4cf-4d10-9d1b-8d851833a86e None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:31.055831 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cea3b-c4cf-4d10-9d1b-8d851833a86e None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:31.056258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cea3b-c4cf-4d10-9d1b-8d851833a86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:31.082620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-e68cea3b-c4cf-4d10-9d1b-8d851833a86e None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:31.085326 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e68cea3b-c4cf-4d10-9d1b-8d851833a86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:31.097926 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-14fb9099-44d2-4b7c-949b-47b1a1d0d565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd88b9863a0114ae8adec676bcdf473fb', 'request_id': 'req-14fb9099-44d2-4b7c-949b-47b1a1d0d565'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:31.166377 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1101/2205] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:31.178152 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cea3b-c4cf-4d10-9d1b-8d851833a86e None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:31.179522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e68cea3b-c4cf-4d10-9d1b-8d851833a86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:31.235033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-14fb9099-44d2-4b7c-949b-47b1a1d0d565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd88b9863a0114ae8adec676bcdf473fb', 'request_id': 'req-14fb9099-44d2-4b7c-949b-47b1a1d0d565'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:31.245746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-14fb9099-44d2-4b7c-949b-47b1a1d0d565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd88b9863a0114ae8adec676bcdf473fb', 'request_id': 'req-14fb9099-44d2-4b7c-949b-47b1a1d0d565'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:31.264024 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-14fb9099-44d2-4b7c-949b-47b1a1d0d565 admin admin] The token cache is being invalidate because project d88b9863a0114ae8adec676bcdf473fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:31.264520 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-14fb9099-44d2-4b7c-949b-47b1a1d0d565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:31.265410 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-14fb9099-44d2-4b7c-949b-47b1a1d0d565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:31.268581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1105/2206] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:30 2022] DELETE /identity/v3/projects/d88b9863a0114ae8adec676bcdf473fb => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:31.273257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb9099-44d2-4b7c-949b-47b1a1d0d565 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:31.275148 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-14fb9099-44d2-4b7c-949b-47b1a1d0d565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:31.292212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cea3b-c4cf-4d10-9d1b-8d851833a86e None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:31.298436 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb9099-44d2-4b7c-949b-47b1a1d0d565 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:31.305159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc6f92-af30-45e3-b5ba-3b701b488830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:31.305951 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc6f92-af30-45e3-b5ba-3b701b488830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:31.306224 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc6f92-af30-45e3-b5ba-3b701b488830 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:31.306494 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc6f92-af30-45e3-b5ba-3b701b488830 admin admin] PATH_INFO: `/v3/users/c21b71cadfc24d2e802532ff7fa3ec45` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:31.307023 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200a17e-07cc-487e-8b73-b6b4fc5ca87f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:31.307750 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc6f92-af30-45e3-b5ba-3b701b488830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21b71cadfc24d2e802532ff7fa3ec45)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:31.308094 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200a17e-07cc-487e-8b73-b6b4fc5ca87f service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:31.308437 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200a17e-07cc-487e-8b73-b6b4fc5ca87f service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:31.308785 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200a17e-07cc-487e-8b73-b6b4fc5ca87f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:31.309792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc6f92-af30-45e3-b5ba-3b701b488830 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:31.310711 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-5200a17e-07cc-487e-8b73-b6b4fc5ca87f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:31.324426 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200a17e-07cc-487e-8b73-b6b4fc5ca87f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:31.326110 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200a17e-07cc-487e-8b73-b6b4fc5ca87f service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:31.336446 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1102/2207] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:31.621643 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-dddc6f92-af30-45e3-b5ba-3b701b488830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21b71cadfc24d2e802532ff7fa3ec45'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:31.762355 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-dddc6f92-af30-45e3-b5ba-3b701b488830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21b71cadfc24d2e802532ff7fa3ec45'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:31.763617 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-dddc6f92-af30-45e3-b5ba-3b701b488830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21b71cadfc24d2e802532ff7fa3ec45'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:31.778387 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-dddc6f92-af30-45e3-b5ba-3b701b488830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21b71cadfc24d2e802532ff7fa3ec45'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:31.786705 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-dddc6f92-af30-45e3-b5ba-3b701b488830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21b71cadfc24d2e802532ff7fa3ec45'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:31.792731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1106/2208] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:57:31 2022] DELETE /identity/v3/users/c21b71cadfc24d2e802532ff7fa3ec45 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:31.905127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:32.158718 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200a17e-07cc-487e-8b73-b6b4fc5ca87f service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:32.161261 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-5200a17e-07cc-487e-8b73-b6b4fc5ca87f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:32.175879 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200a17e-07cc-487e-8b73-b6b4fc5ca87f service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:32.284591 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bee45-f69d-45df-8c05-8265bc71a9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:32.286152 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bee45-f69d-45df-8c05-8265bc71a9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:32.286586 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bee45-f69d-45df-8c05-8265bc71a9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:32.287759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bee45-f69d-45df-8c05-8265bc71a9fe admin admin] PATH_INFO: `/v3/projects/6b3e04b0bb944c67af393ea4108c175e` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:32.293468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bee45-f69d-45df-8c05-8265bc71a9fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b3e04b0bb944c67af393ea4108c175e)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:32.293468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bee45-f69d-45df-8c05-8265bc71a9fe admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:32.435029 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b55bee45-f69d-45df-8c05-8265bc71a9fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b3e04b0bb944c67af393ea4108c175e', 'request_id': 'req-b55bee45-f69d-45df-8c05-8265bc71a9fe'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:32.519054 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b55bee45-f69d-45df-8c05-8265bc71a9fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b3e04b0bb944c67af393ea4108c175e', 'request_id': 'req-b55bee45-f69d-45df-8c05-8265bc71a9fe'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:32.525669 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b55bee45-f69d-45df-8c05-8265bc71a9fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b3e04b0bb944c67af393ea4108c175e', 'request_id': 'req-b55bee45-f69d-45df-8c05-8265bc71a9fe'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:32.538677 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b55bee45-f69d-45df-8c05-8265bc71a9fe admin admin] The token cache is being invalidate because project 6b3e04b0bb944c67af393ea4108c175e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:32.538972 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b55bee45-f69d-45df-8c05-8265bc71a9fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:32.539670 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b55bee45-f69d-45df-8c05-8265bc71a9fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:32.541386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1103/2209] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:32 2022] DELETE /identity/v3/projects/6b3e04b0bb944c67af393ea4108c175e => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:32.630248 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc6f92-af30-45e3-b5ba-3b701b488830 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:32.632737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-dddc6f92-af30-45e3-b5ba-3b701b488830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:32.655063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc6f92-af30-45e3-b5ba-3b701b488830 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:32.756467 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ef994-204b-4985-8e72-d6a1ed7b3dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:32.758041 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ef994-204b-4985-8e72-d6a1ed7b3dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:32.758423 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ef994-204b-4985-8e72-d6a1ed7b3dab admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:32.758719 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ef994-204b-4985-8e72-d6a1ed7b3dab admin admin] PATH_INFO: `/v3/projects/da9f7ba0f8c04d7aae2f6c48cba7e602` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:32.760721 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ef994-204b-4985-8e72-d6a1ed7b3dab admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9f7ba0f8c04d7aae2f6c48cba7e602)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:32.764159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ef994-204b-4985-8e72-d6a1ed7b3dab admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:32.932912 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-406ef994-204b-4985-8e72-d6a1ed7b3dab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9f7ba0f8c04d7aae2f6c48cba7e602', 'request_id': 'req-406ef994-204b-4985-8e72-d6a1ed7b3dab'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:33.027238 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-406ef994-204b-4985-8e72-d6a1ed7b3dab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9f7ba0f8c04d7aae2f6c48cba7e602', 'request_id': 'req-406ef994-204b-4985-8e72-d6a1ed7b3dab'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:33.037207 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-406ef994-204b-4985-8e72-d6a1ed7b3dab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9f7ba0f8c04d7aae2f6c48cba7e602', 'request_id': 'req-406ef994-204b-4985-8e72-d6a1ed7b3dab'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:33.051861 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-406ef994-204b-4985-8e72-d6a1ed7b3dab admin admin] The token cache is being invalidate because project da9f7ba0f8c04d7aae2f6c48cba7e602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:33.052329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-406ef994-204b-4985-8e72-d6a1ed7b3dab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:33.053310 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-406ef994-204b-4985-8e72-d6a1ed7b3dab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:33.056417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1107/2210] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:32 2022] DELETE /identity/v3/projects/da9f7ba0f8c04d7aae2f6c48cba7e602 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:57:33.061302 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e617d-fb6e-4747-8c70-d3213b2ae98f None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:33.061831 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e617d-fb6e-4747-8c70-d3213b2ae98f None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:33.062356 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e617d-fb6e-4747-8c70-d3213b2ae98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:33.090396 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-d75e617d-fb6e-4747-8c70-d3213b2ae98f None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:33.092182 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d75e617d-fb6e-4747-8c70-d3213b2ae98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:33.170310 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1104/2211] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:33.184840 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e961ac4-59bf-4911-b7d6-7a4bae9a5db4 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:33.185180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e961ac4-59bf-4911-b7d6-7a4bae9a5db4 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:33.185746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e961ac4-59bf-4911-b7d6-7a4bae9a5db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:33.213923 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-5e961ac4-59bf-4911-b7d6-7a4bae9a5db4 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:33.217131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-5e961ac4-59bf-4911-b7d6-7a4bae9a5db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:33.225398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1108/2212] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:33.230165 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e617d-fb6e-4747-8c70-d3213b2ae98f None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:33.241640 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e617d-fb6e-4747-8c70-d3213b2ae98f None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:33.247629 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d7982-e83a-488e-9143-27ac935632e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:33.248331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d7982-e83a-488e-9143-27ac935632e1 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:33.248817 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d7982-e83a-488e-9143-27ac935632e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:33.249275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d7982-e83a-488e-9143-27ac935632e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:33.250117 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d7982-e83a-488e-9143-27ac935632e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:57:33.250609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d7982-e83a-488e-9143-27ac935632e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:33.253478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d7982-e83a-488e-9143-27ac935632e1 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:33.269467 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1105/2213] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:57:33.273687 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e961ac4-59bf-4911-b7d6-7a4bae9a5db4 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:33.283450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e961ac4-59bf-4911-b7d6-7a4bae9a5db4 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:33.290638 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f029ceb-eba9-440b-8678-237077c0e51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:33.291358 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f029ceb-eba9-440b-8678-237077c0e51a admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:33.291740 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f029ceb-eba9-440b-8678-237077c0e51a admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:33.292192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f029ceb-eba9-440b-8678-237077c0e51a admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:33.294154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f029ceb-eba9-440b-8678-237077c0e51a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:33.297235 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f029ceb-eba9-440b-8678-237077c0e51a admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:33.431783 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d7982-e83a-488e-9143-27ac935632e1 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:33.433036 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1109/2214] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:33 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:33.442971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d7982-e83a-488e-9143-27ac935632e1 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:33.514411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad59d34-61f6-4149-bdc4-a36fa669775b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:33.515031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad59d34-61f6-4149-bdc4-a36fa669775b admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:33.515311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad59d34-61f6-4149-bdc4-a36fa669775b admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:33.515667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad59d34-61f6-4149-bdc4-a36fa669775b admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:33.516254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad59d34-61f6-4149-bdc4-a36fa669775b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:33.518169 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad59d34-61f6-4149-bdc4-a36fa669775b admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:33.629336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1106/2215] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:33 2022] POST /identity/v3/users => generated 294 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:33.633489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f029ceb-eba9-440b-8678-237077c0e51a admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:33.655682 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f029ceb-eba9-440b-8678-237077c0e51a admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:33.662792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a23346-5574-47be-b29c-3e61dcecc040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:33.663869 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a23346-5574-47be-b29c-3e61dcecc040 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:33.664495 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a23346-5574-47be-b29c-3e61dcecc040 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:33.665092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a23346-5574-47be-b29c-3e61dcecc040 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:33.666036 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a23346-5574-47be-b29c-3e61dcecc040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:33.668052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a23346-5574-47be-b29c-3e61dcecc040 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:33.686911 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1110/2216] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:33.697557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad59d34-61f6-4149-bdc4-a36fa669775b admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:33.703428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad59d34-61f6-4149-bdc4-a36fa669775b admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:33.709271 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d64a5-8f6c-4b0e-9f01-520eda8dbc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:33.710216 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d64a5-8f6c-4b0e-9f01-520eda8dbc0a admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:33.710491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d64a5-8f6c-4b0e-9f01-520eda8dbc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:33.710760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d64a5-8f6c-4b0e-9f01-520eda8dbc0a admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:33.711405 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d64a5-8f6c-4b0e-9f01-520eda8dbc0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:33.713022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d64a5-8f6c-4b0e-9f01-520eda8dbc0a admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:33.723617 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1107/2217] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:57:33.731738 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a23346-5574-47be-b29c-3e61dcecc040 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:33.753482 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a23346-5574-47be-b29c-3e61dcecc040 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:33.759455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b44cc-f9e6-42a8-a7a5-69c5e340e8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:33.760214 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b44cc-f9e6-42a8-a7a5-69c5e340e8af admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:33.760666 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b44cc-f9e6-42a8-a7a5-69c5e340e8af admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:33.760947 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b44cc-f9e6-42a8-a7a5-69c5e340e8af admin admin] PATH_INFO: `/v3/projects/2ce1178d583d4d30a8de762aff73472c/users/ad84a23992e74825a2f305b577ce07d5/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:33.779694 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b44cc-f9e6-42a8-a7a5-69c5e340e8af admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce1178d583d4d30a8de762aff73472c, user_id=ad84a23992e74825a2f305b577ce07d5, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:33.782765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b44cc-f9e6-42a8-a7a5-69c5e340e8af admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:33.860539 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1111/2218] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:33 2022] PUT /identity/v3/projects/2ce1178d583d4d30a8de762aff73472c/users/ad84a23992e74825a2f305b577ce07d5/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:57:33.871768 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bda59-bcd1-45e7-837d-de920ed55e09 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:33.872152 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bda59-bcd1-45e7-837d-de920ed55e09 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:33.872547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bda59-bcd1-45e7-837d-de920ed55e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:33.909596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-c51bda59-bcd1-45e7-837d-de920ed55e09 None None] MFA Rules not processed for user `ad84a23992e74825a2f305b577ce07d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:33.910803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-c51bda59-bcd1-45e7-837d-de920ed55e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:33.953962 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:33.980178 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1108/2219] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:33.984730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b44cc-f9e6-42a8-a7a5-69c5e340e8af admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:34.048188 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b44cc-f9e6-42a8-a7a5-69c5e340e8af admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:34.053484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078bd23-369a-4245-8f76-21a8ee834719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:34.054145 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078bd23-369a-4245-8f76-21a8ee834719 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:34.054429 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078bd23-369a-4245-8f76-21a8ee834719 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:34.054827 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078bd23-369a-4245-8f76-21a8ee834719 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:34.055460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078bd23-369a-4245-8f76-21a8ee834719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:34.057731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078bd23-369a-4245-8f76-21a8ee834719 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:34.221269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1112/2220] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:33 2022] POST /identity/v3/projects => generated 387 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:57:34.227062 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bda59-bcd1-45e7-837d-de920ed55e09 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:34.240286 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bda59-bcd1-45e7-837d-de920ed55e09 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:34.314292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaf057-0f54-4413-81eb-242687d5ecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:34.314911 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaf057-0f54-4413-81eb-242687d5ecea admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:34.315194 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaf057-0f54-4413-81eb-242687d5ecea admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:34.315615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaf057-0f54-4413-81eb-242687d5ecea admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:34.316635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfaf057-0f54-4413-81eb-242687d5ecea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:34.318801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfaf057-0f54-4413-81eb-242687d5ecea admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:34.413915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1109/2221] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:34 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:34.415213 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078bd23-369a-4245-8f76-21a8ee834719 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:34.426866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078bd23-369a-4245-8f76-21a8ee834719 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:34.432503 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a6d6d-ca1b-4305-9f46-0a5b381f1033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:34.433117 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a6d6d-ca1b-4305-9f46-0a5b381f1033 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:34.433396 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a6d6d-ca1b-4305-9f46-0a5b381f1033 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:34.433666 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a6d6d-ca1b-4305-9f46-0a5b381f1033 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:34.434307 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a6d6d-ca1b-4305-9f46-0a5b381f1033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:34.436109 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a6d6d-ca1b-4305-9f46-0a5b381f1033 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:34.446712 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1113/2222] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:34.450914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaf057-0f54-4413-81eb-242687d5ecea admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:34.461565 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaf057-0f54-4413-81eb-242687d5ecea admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:34.466710 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9b60c-a0c1-4683-879d-93dec92aae1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:34.467376 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9b60c-a0c1-4683-879d-93dec92aae1f admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:34.467680 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9b60c-a0c1-4683-879d-93dec92aae1f admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:34.468029 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9b60c-a0c1-4683-879d-93dec92aae1f admin admin] PATH_INFO: `/v3/projects/e41b37bad1564d1eb629b8546e02d74d/users/7d6d9164f2494db7abca61c4b94f4618/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:34.485015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9b60c-a0c1-4683-879d-93dec92aae1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41b37bad1564d1eb629b8546e02d74d, user_id=7d6d9164f2494db7abca61c4b94f4618, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:34.488672 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9b60c-a0c1-4683-879d-93dec92aae1f admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:34.616109 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1110/2223] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:34 2022] PUT /identity/v3/projects/e41b37bad1564d1eb629b8546e02d74d/users/7d6d9164f2494db7abca61c4b94f4618/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:34.620144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a6d6d-ca1b-4305-9f46-0a5b381f1033 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:34.630642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a6d6d-ca1b-4305-9f46-0a5b381f1033 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:34.706416 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409e43b-072c-401f-9504-92ea04fcb68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:34.707083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409e43b-072c-401f-9504-92ea04fcb68c admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:34.707323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409e43b-072c-401f-9504-92ea04fcb68c admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:34.707818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409e43b-072c-401f-9504-92ea04fcb68c admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:34.708473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409e43b-072c-401f-9504-92ea04fcb68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:34.710252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409e43b-072c-401f-9504-92ea04fcb68c admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:34.721127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1114/2224] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:34.725327 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9b60c-a0c1-4683-879d-93dec92aae1f admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:34.742173 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9b60c-a0c1-4683-879d-93dec92aae1f admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:34.764810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad10ffd-5a6a-4c45-b785-955a5e4b66d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:34.765510 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad10ffd-5a6a-4c45-b785-955a5e4b66d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:34.766371 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad10ffd-5a6a-4c45-b785-955a5e4b66d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:34.766667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad10ffd-5a6a-4c45-b785-955a5e4b66d8 admin admin] PATH_INFO: `/v3/projects/e41b37bad1564d1eb629b8546e02d74d/users/7d6d9164f2494db7abca61c4b94f4618/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:34.770606 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad10ffd-5a6a-4c45-b785-955a5e4b66d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41b37bad1564d1eb629b8546e02d74d, user_id=7d6d9164f2494db7abca61c4b94f4618, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:34.776110 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad10ffd-5a6a-4c45-b785-955a5e4b66d8 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:34.793534 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1111/2225] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:34 2022] PUT /identity/v3/projects/e41b37bad1564d1eb629b8546e02d74d/users/7d6d9164f2494db7abca61c4b94f4618/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:34.804894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b087b6c-2ee1-45e8-8863-2e79d4384425 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:34.805217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b087b6c-2ee1-45e8-8863-2e79d4384425 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:34.805492 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b087b6c-2ee1-45e8-8863-2e79d4384425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:34.842158 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-0b087b6c-2ee1-45e8-8863-2e79d4384425 None None] MFA Rules not processed for user `7d6d9164f2494db7abca61c4b94f4618`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:34.843371 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-0b087b6c-2ee1-45e8-8863-2e79d4384425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:34.922389 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1115/2226] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:34.935820 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad10ffd-5a6a-4c45-b785-955a5e4b66d8 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:34.938946 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-fad10ffd-5a6a-4c45-b785-955a5e4b66d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:35.004652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad10ffd-5a6a-4c45-b785-955a5e4b66d8 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:35.005848 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd1605-46ef-4358-bf37-bdcfb35ba0ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:35.006567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd1605-46ef-4358-bf37-bdcfb35ba0ae service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:35.006913 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd1605-46ef-4358-bf37-bdcfb35ba0ae service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:35.007255 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd1605-46ef-4358-bf37-bdcfb35ba0ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:35.018085 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd1605-46ef-4358-bf37-bdcfb35ba0ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:35.020060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd1605-46ef-4358-bf37-bdcfb35ba0ae service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:35.039046 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1112/2227] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:35.060979 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6940b-3107-4474-976d-fc7279c9e53d None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:35.061534 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6940b-3107-4474-976d-fc7279c9e53d None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:35.061534 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6940b-3107-4474-976d-fc7279c9e53d None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:35.062980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1116/2228] 10.222.0.15 () {54 vars in 921 bytes} [Wed Sep 14 19:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:57:35.073348 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3038c67-bd64-451f-94d0-abf43af5b6f1 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:35.073685 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3038c67-bd64-451f-94d0-abf43af5b6f1 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:35.073966 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3038c67-bd64-451f-94d0-abf43af5b6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:35.093726 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-a3038c67-bd64-451f-94d0-abf43af5b6f1 None None] MFA Rules not processed for user `6942a851a69b446e90a2b138f4482465`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:35.094936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-a3038c67-bd64-451f-94d0-abf43af5b6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:35.157448 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1113/2229] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Sep 14 19:57:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:35.169334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6940b-3107-4474-976d-fc7279c9e53d None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:35.171047 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-77f6940b-3107-4474-976d-fc7279c9e53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:35.188244 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6940b-3107-4474-976d-fc7279c9e53d None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:35.193609 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b818639-e5e1-4725-81d3-804ce11c7f39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6942a851a69b446e90a2b138f4482465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:35.194218 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b818639-e5e1-4725-81d3-804ce11c7f39 service placement] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:35.194501 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b818639-e5e1-4725-81d3-804ce11c7f39 service placement] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:35.194781 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b818639-e5e1-4725-81d3-804ce11c7f39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:35.204033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b818639-e5e1-4725-81d3-804ce11c7f39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:35.205689 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b818639-e5e1-4725-81d3-804ce11c7f39 service placement] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:35.216223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1117/2230] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:35.702646 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:36.123840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3038c67-bd64-451f-94d0-abf43af5b6f1 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:36.125275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-a3038c67-bd64-451f-94d0-abf43af5b6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:36.203996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3038c67-bd64-451f-94d0-abf43af5b6f1 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:36.208958 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36637b-2d88-4a79-9f4e-37311f9a9dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:36.209660 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36637b-2d88-4a79-9f4e-37311f9a9dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:36.209945 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36637b-2d88-4a79-9f4e-37311f9a9dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:36.210222 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36637b-2d88-4a79-9f4e-37311f9a9dd5 admin admin] PATH_INFO: `/v3/users/f8e3b168829e4dfeac03ccd8192f7bfe` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:36.211372 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36637b-2d88-4a79-9f4e-37311f9a9dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8e3b168829e4dfeac03ccd8192f7bfe)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:36.213337 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36637b-2d88-4a79-9f4e-37311f9a9dd5 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:36.436325 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-3f36637b-2d88-4a79-9f4e-37311f9a9dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8e3b168829e4dfeac03ccd8192f7bfe'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:36.478948 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b818639-e5e1-4725-81d3-804ce11c7f39 service placement] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:36.490377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b818639-e5e1-4725-81d3-804ce11c7f39 service placement] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:36.495034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82bb410-17fa-40b3-8f30-f25fafc34845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:36.495712 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bb410-17fa-40b3-8f30-f25fafc34845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:36.496499 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bb410-17fa-40b3-8f30-f25fafc34845 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:36.496499 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bb410-17fa-40b3-8f30-f25fafc34845 admin admin] PATH_INFO: `/v3/users/ad84a23992e74825a2f305b577ce07d5` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:36.497366 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82bb410-17fa-40b3-8f30-f25fafc34845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad84a23992e74825a2f305b577ce07d5)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:36.499270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82bb410-17fa-40b3-8f30-f25fafc34845 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:36.541362 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-3f36637b-2d88-4a79-9f4e-37311f9a9dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8e3b168829e4dfeac03ccd8192f7bfe'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:36.542040 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-3f36637b-2d88-4a79-9f4e-37311f9a9dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8e3b168829e4dfeac03ccd8192f7bfe'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:36.549580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-3f36637b-2d88-4a79-9f4e-37311f9a9dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8e3b168829e4dfeac03ccd8192f7bfe'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:36.562330 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-3f36637b-2d88-4a79-9f4e-37311f9a9dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8e3b168829e4dfeac03ccd8192f7bfe'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:36.568276 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1114/2231] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:57:36 2022] DELETE /identity/v3/users/f8e3b168829e4dfeac03ccd8192f7bfe => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:36.793030 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e82bb410-17fa-40b3-8f30-f25fafc34845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad84a23992e74825a2f305b577ce07d5'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:36.920935 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e82bb410-17fa-40b3-8f30-f25fafc34845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad84a23992e74825a2f305b577ce07d5'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:36.921587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e82bb410-17fa-40b3-8f30-f25fafc34845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad84a23992e74825a2f305b577ce07d5'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:36.927809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36637b-2d88-4a79-9f4e-37311f9a9dd5 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:36.929407 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3f36637b-2d88-4a79-9f4e-37311f9a9dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:36.944775 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e82bb410-17fa-40b3-8f30-f25fafc34845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad84a23992e74825a2f305b577ce07d5'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:36.956232 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-e82bb410-17fa-40b3-8f30-f25fafc34845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad84a23992e74825a2f305b577ce07d5'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:36.969447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1118/2232] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:57:36 2022] DELETE /identity/v3/users/ad84a23992e74825a2f305b577ce07d5 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:57:36.971231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8b62c-0cba-41b2-a999-85c38f4284ca None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:36.972775 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8b62c-0cba-41b2-a999-85c38f4284ca None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:36.973361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8b62c-0cba-41b2-a999-85c38f4284ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:37.004113 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-91e8b62c-0cba-41b2-a999-85c38f4284ca None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:37.006481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-91e8b62c-0cba-41b2-a999-85c38f4284ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:37.054576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36637b-2d88-4a79-9f4e-37311f9a9dd5 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:37.105435 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1119/2233] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:57:37.128841 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8b62c-0cba-41b2-a999-85c38f4284ca None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:37.131131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-91e8b62c-0cba-41b2-a999-85c38f4284ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:37.147969 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f931c7e-6cb9-496f-b52d-f64971da1ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:37.148618 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f931c7e-6cb9-496f-b52d-f64971da1ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:37.148896 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f931c7e-6cb9-496f-b52d-f64971da1ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:37.149592 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f931c7e-6cb9-496f-b52d-f64971da1ec0 admin admin] PATH_INFO: `/v3/projects/97fae6b07feb45d6939fc744cf62b1a7` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:37.151273 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f931c7e-6cb9-496f-b52d-f64971da1ec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97fae6b07feb45d6939fc744cf62b1a7)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:37.153616 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f931c7e-6cb9-496f-b52d-f64971da1ec0 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:37.157426 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:37.212951 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8b62c-0cba-41b2-a999-85c38f4284ca None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:37.212951 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb71be-0d23-460b-9584-cc024e291ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:37.212951 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb71be-0d23-460b-9584-cc024e291ddd service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:37.212951 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb71be-0d23-460b-9584-cc024e291ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:37.213507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb71be-0d23-460b-9584-cc024e291ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:37.219390 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb71be-0d23-460b-9584-cc024e291ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:37.220890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb71be-0d23-460b-9584-cc024e291ddd service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:37.231611 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1120/2234] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:57:37.602410 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-4f931c7e-6cb9-496f-b52d-f64971da1ec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97fae6b07feb45d6939fc744cf62b1a7', 'request_id': 'req-4f931c7e-6cb9-496f-b52d-f64971da1ec0'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:37.732379 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-4f931c7e-6cb9-496f-b52d-f64971da1ec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97fae6b07feb45d6939fc744cf62b1a7', 'request_id': 'req-4f931c7e-6cb9-496f-b52d-f64971da1ec0'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:37.738976 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-4f931c7e-6cb9-496f-b52d-f64971da1ec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97fae6b07feb45d6939fc744cf62b1a7', 'request_id': 'req-4f931c7e-6cb9-496f-b52d-f64971da1ec0'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:37.750398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-4f931c7e-6cb9-496f-b52d-f64971da1ec0 admin admin] The token cache is being invalidate because project 97fae6b07feb45d6939fc744cf62b1a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:37.750770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-4f931c7e-6cb9-496f-b52d-f64971da1ec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:37.751494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-4f931c7e-6cb9-496f-b52d-f64971da1ec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:37.754103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1115/2235] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:36 2022] DELETE /identity/v3/projects/97fae6b07feb45d6939fc744cf62b1a7 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:37.758240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb71be-0d23-460b-9584-cc024e291ddd service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:37.759838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-63bb71be-0d23-460b-9584-cc024e291ddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:37.781102 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb71be-0d23-460b-9584-cc024e291ddd service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:37.855971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82fbbe-acca-4cde-b1ac-0cb98623481b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:37.857831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82fbbe-acca-4cde-b1ac-0cb98623481b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:37.857831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82fbbe-acca-4cde-b1ac-0cb98623481b admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:37.857831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82fbbe-acca-4cde-b1ac-0cb98623481b admin admin] PATH_INFO: `/v3/users/3c2a19c731664548bb638381f3b5dc34` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:37.858320 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82fbbe-acca-4cde-b1ac-0cb98623481b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c2a19c731664548bb638381f3b5dc34)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:37.860271 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82fbbe-acca-4cde-b1ac-0cb98623481b admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:37.924313 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f931c7e-6cb9-496f-b52d-f64971da1ec0 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:37.926645 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-4f931c7e-6cb9-496f-b52d-f64971da1ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:37.939293 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f931c7e-6cb9-496f-b52d-f64971da1ec0 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:37.950320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3846f9-f77b-4804-a37c-dfea973fdccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:37.951015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3846f9-f77b-4804-a37c-dfea973fdccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:37.951302 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3846f9-f77b-4804-a37c-dfea973fdccc admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:37.951606 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3846f9-f77b-4804-a37c-dfea973fdccc admin admin] PATH_INFO: `/v3/projects/2ce1178d583d4d30a8de762aff73472c` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:37.952964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3846f9-f77b-4804-a37c-dfea973fdccc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ce1178d583d4d30a8de762aff73472c)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:37.954888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3846f9-f77b-4804-a37c-dfea973fdccc admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:37.988484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:38.059684 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-fc82fbbe-acca-4cde-b1ac-0cb98623481b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c2a19c731664548bb638381f3b5dc34'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:38.240266 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-fc82fbbe-acca-4cde-b1ac-0cb98623481b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c2a19c731664548bb638381f3b5dc34'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:38.240897 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-fc82fbbe-acca-4cde-b1ac-0cb98623481b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c2a19c731664548bb638381f3b5dc34'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:38.260180 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8b3846f9-f77b-4804-a37c-dfea973fdccc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ce1178d583d4d30a8de762aff73472c', 'request_id': 'req-8b3846f9-f77b-4804-a37c-dfea973fdccc'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:38.264877 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-fc82fbbe-acca-4cde-b1ac-0cb98623481b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c2a19c731664548bb638381f3b5dc34'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:38.272588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-fc82fbbe-acca-4cde-b1ac-0cb98623481b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c2a19c731664548bb638381f3b5dc34'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:38.282900 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1121/2236] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:57:37 2022] DELETE /identity/v3/users/3c2a19c731664548bb638381f3b5dc34 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:38.333325 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8b3846f9-f77b-4804-a37c-dfea973fdccc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ce1178d583d4d30a8de762aff73472c', 'request_id': 'req-8b3846f9-f77b-4804-a37c-dfea973fdccc'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:38.341538 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8b3846f9-f77b-4804-a37c-dfea973fdccc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ce1178d583d4d30a8de762aff73472c', 'request_id': 'req-8b3846f9-f77b-4804-a37c-dfea973fdccc'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:38.373610 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8b3846f9-f77b-4804-a37c-dfea973fdccc admin admin] The token cache is being invalidate because project 2ce1178d583d4d30a8de762aff73472c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:38.375070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8b3846f9-f77b-4804-a37c-dfea973fdccc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:38.383597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8b3846f9-f77b-4804-a37c-dfea973fdccc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:38.388860 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1116/2237] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:37 2022] DELETE /identity/v3/projects/2ce1178d583d4d30a8de762aff73472c => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:38.392793 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82fbbe-acca-4cde-b1ac-0cb98623481b admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:38.396077 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-fc82fbbe-acca-4cde-b1ac-0cb98623481b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:38.479627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82fbbe-acca-4cde-b1ac-0cb98623481b admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:38.479627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c627fd9-6577-4205-bf7f-25507e65d981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:38.479627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c627fd9-6577-4205-bf7f-25507e65d981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:38.479627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c627fd9-6577-4205-bf7f-25507e65d981 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:38.480213 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c627fd9-6577-4205-bf7f-25507e65d981 admin admin] PATH_INFO: `/v3/users/7d6d9164f2494db7abca61c4b94f4618` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:38.480213 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c627fd9-6577-4205-bf7f-25507e65d981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d6d9164f2494db7abca61c4b94f4618)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:38.485524 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c627fd9-6577-4205-bf7f-25507e65d981 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:38.703988 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3846f9-f77b-4804-a37c-dfea973fdccc admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:38.708006 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-8b3846f9-f77b-4804-a37c-dfea973fdccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:38.750830 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-8c627fd9-6577-4205-bf7f-25507e65d981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d6d9164f2494db7abca61c4b94f4618'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:38.797536 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3846f9-f77b-4804-a37c-dfea973fdccc admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:38.806696 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf5cc4-21d7-49d8-bf3e-1bd9fd40c184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:38.807858 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf5cc4-21d7-49d8-bf3e-1bd9fd40c184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:38.808357 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf5cc4-21d7-49d8-bf3e-1bd9fd40c184 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:38.808843 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf5cc4-21d7-49d8-bf3e-1bd9fd40c184 admin admin] PATH_INFO: `/v3/projects/f1526849340d46fa9fc565f99fe61256` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:38.810916 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf5cc4-21d7-49d8-bf3e-1bd9fd40c184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1526849340d46fa9fc565f99fe61256)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:38.814750 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf5cc4-21d7-49d8-bf3e-1bd9fd40c184 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:38.863971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-8c627fd9-6577-4205-bf7f-25507e65d981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d6d9164f2494db7abca61c4b94f4618'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:38.865490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-8c627fd9-6577-4205-bf7f-25507e65d981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d6d9164f2494db7abca61c4b94f4618'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:38.879507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-8c627fd9-6577-4205-bf7f-25507e65d981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d6d9164f2494db7abca61c4b94f4618'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:38.886776 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-8c627fd9-6577-4205-bf7f-25507e65d981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d6d9164f2494db7abca61c4b94f4618'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:38.892929 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1122/2238] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:57:38 2022] DELETE /identity/v3/users/7d6d9164f2494db7abca61c4b94f4618 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:38.957768 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8fbf5cc4-21d7-49d8-bf3e-1bd9fd40c184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1526849340d46fa9fc565f99fe61256', 'request_id': 'req-8fbf5cc4-21d7-49d8-bf3e-1bd9fd40c184'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:39.063716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8fbf5cc4-21d7-49d8-bf3e-1bd9fd40c184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1526849340d46fa9fc565f99fe61256', 'request_id': 'req-8fbf5cc4-21d7-49d8-bf3e-1bd9fd40c184'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:39.071565 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8fbf5cc4-21d7-49d8-bf3e-1bd9fd40c184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1526849340d46fa9fc565f99fe61256', 'request_id': 'req-8fbf5cc4-21d7-49d8-bf3e-1bd9fd40c184'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:39.081404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8fbf5cc4-21d7-49d8-bf3e-1bd9fd40c184 admin admin] The token cache is being invalidate because project f1526849340d46fa9fc565f99fe61256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:39.081693 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8fbf5cc4-21d7-49d8-bf3e-1bd9fd40c184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:39.082385 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8fbf5cc4-21d7-49d8-bf3e-1bd9fd40c184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:39.083908 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1117/2239] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:38 2022] DELETE /identity/v3/projects/f1526849340d46fa9fc565f99fe61256 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:39.088853 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a5cab-d54a-4c9e-998f-f4a631e34316 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:39.089146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a5cab-d54a-4c9e-998f-f4a631e34316 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:39.089453 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a5cab-d54a-4c9e-998f-f4a631e34316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:39.111040 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-c92a5cab-d54a-4c9e-998f-f4a631e34316 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:39.113241 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c92a5cab-d54a-4c9e-998f-f4a631e34316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:39.197072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1123/2240] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:57:39.198689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537380c-5598-40e6-96c7-5deb7c08cb22 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:39.199035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537380c-5598-40e6-96c7-5deb7c08cb22 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:39.199318 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537380c-5598-40e6-96c7-5deb7c08cb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:39.221227 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-a537380c-5598-40e6-96c7-5deb7c08cb22 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:39.222503 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-a537380c-5598-40e6-96c7-5deb7c08cb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:39.234484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1118/2241] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:57:39.255386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a5cab-d54a-4c9e-998f-f4a631e34316 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:39.266795 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a5cab-d54a-4c9e-998f-f4a631e34316 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:39.273416 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b42991-c3d8-4132-ac84-2196c748e672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:39.273416 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b42991-c3d8-4132-ac84-2196c748e672 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:39.278676 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b42991-c3d8-4132-ac84-2196c748e672 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:39.278676 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b42991-c3d8-4132-ac84-2196c748e672 admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:39.278676 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b42991-c3d8-4132-ac84-2196c748e672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:57:39.278676 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b42991-c3d8-4132-ac84-2196c748e672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:39.278676 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b42991-c3d8-4132-ac84-2196c748e672 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:39.288503 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1124/2242] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:57:39.293015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537380c-5598-40e6-96c7-5deb7c08cb22 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:39.315924 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537380c-5598-40e6-96c7-5deb7c08cb22 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:39.315924 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924ad19-7300-42c4-a3f1-0397f67fc163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:39.315924 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924ad19-7300-42c4-a3f1-0397f67fc163 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:39.315924 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924ad19-7300-42c4-a3f1-0397f67fc163 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:39.316383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924ad19-7300-42c4-a3f1-0397f67fc163 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:39.316383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c924ad19-7300-42c4-a3f1-0397f67fc163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:39.316383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c924ad19-7300-42c4-a3f1-0397f67fc163 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:39.407965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b42991-c3d8-4132-ac84-2196c748e672 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:39.410317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-17b42991-c3d8-4132-ac84-2196c748e672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:39.414781 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1119/2243] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:39 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:39.430417 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924ad19-7300-42c4-a3f1-0397f67fc163 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:39.441637 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b42991-c3d8-4132-ac84-2196c748e672 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:39.492280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924ad19-7300-42c4-a3f1-0397f67fc163 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:39.498423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9be0e8-3b3a-4dec-9a4a-901da307d5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:39.499002 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacf12b-d7b6-4028-b9bd-46f34bf3c6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:39.499412 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9be0e8-3b3a-4dec-9a4a-901da307d5aa admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:39.499821 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacf12b-d7b6-4028-b9bd-46f34bf3c6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:39.500029 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9be0e8-3b3a-4dec-9a4a-901da307d5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:39.500240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacf12b-d7b6-4028-b9bd-46f34bf3c6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:39.500586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacf12b-d7b6-4028-b9bd-46f34bf3c6c5 admin admin] PATH_INFO: `/v3/projects/e41b37bad1564d1eb629b8546e02d74d` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:39.500719 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9be0e8-3b3a-4dec-9a4a-901da307d5aa admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:39.501488 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9be0e8-3b3a-4dec-9a4a-901da307d5aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:39.502024 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdacf12b-d7b6-4028-b9bd-46f34bf3c6c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e41b37bad1564d1eb629b8546e02d74d)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:39.504200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdacf12b-d7b6-4028-b9bd-46f34bf3c6c5 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:39.504828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9be0e8-3b3a-4dec-9a4a-901da307d5aa admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:39.611062 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1120/2244] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:39 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:39.612936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9be0e8-3b3a-4dec-9a4a-901da307d5aa admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:39.623465 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9be0e8-3b3a-4dec-9a4a-901da307d5aa admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:39.628890 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea76f3c-9c76-4320-842a-d63c2bd48378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:39.630313 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea76f3c-9c76-4320-842a-d63c2bd48378 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:39.630313 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea76f3c-9c76-4320-842a-d63c2bd48378 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:39.630313 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea76f3c-9c76-4320-842a-d63c2bd48378 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:39.631206 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea76f3c-9c76-4320-842a-d63c2bd48378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:39.632782 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea76f3c-9c76-4320-842a-d63c2bd48378 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:39.646033 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1121/2245] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:39.649890 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea76f3c-9c76-4320-842a-d63c2bd48378 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:39.661099 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea76f3c-9c76-4320-842a-d63c2bd48378 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:39.675779 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-cdacf12b-d7b6-4028-b9bd-46f34bf3c6c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e41b37bad1564d1eb629b8546e02d74d', 'request_id': 'req-cdacf12b-d7b6-4028-b9bd-46f34bf3c6c5'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:39.725096 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7ce29-aa4f-4d55-bb64-a758051308ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:39.725716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7ce29-aa4f-4d55-bb64-a758051308ff admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:39.725994 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7ce29-aa4f-4d55-bb64-a758051308ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:39.726317 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7ce29-aa4f-4d55-bb64-a758051308ff admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:39.726970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a7ce29-aa4f-4d55-bb64-a758051308ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:39.728926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a7ce29-aa4f-4d55-bb64-a758051308ff admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:39.738688 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-cdacf12b-d7b6-4028-b9bd-46f34bf3c6c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e41b37bad1564d1eb629b8546e02d74d', 'request_id': 'req-cdacf12b-d7b6-4028-b9bd-46f34bf3c6c5'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:39.744888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1122/2246] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:39.744888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7ce29-aa4f-4d55-bb64-a758051308ff admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:39.746993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-cdacf12b-d7b6-4028-b9bd-46f34bf3c6c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e41b37bad1564d1eb629b8546e02d74d', 'request_id': 'req-cdacf12b-d7b6-4028-b9bd-46f34bf3c6c5'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:39.761637 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7ce29-aa4f-4d55-bb64-a758051308ff admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:39.766125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-cdacf12b-d7b6-4028-b9bd-46f34bf3c6c5 admin admin] The token cache is being invalidate because project e41b37bad1564d1eb629b8546e02d74d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:39.766425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-cdacf12b-d7b6-4028-b9bd-46f34bf3c6c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:39.766529 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc279ed-6067-48bf-9c7c-4965ebaebd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:39.775573 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-cdacf12b-d7b6-4028-b9bd-46f34bf3c6c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:39.775858 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc279ed-6067-48bf-9c7c-4965ebaebd2a admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:39.775858 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc279ed-6067-48bf-9c7c-4965ebaebd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:39.775858 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc279ed-6067-48bf-9c7c-4965ebaebd2a admin admin] PATH_INFO: `/v3/projects/aa07101ee6064ecfaf745ba39fb9e208/users/9e8b5cdcdb6349a593da50f06f83df92/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:39.776223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1125/2247] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:39 2022] DELETE /identity/v3/projects/e41b37bad1564d1eb629b8546e02d74d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:57:39.776223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c64ae2-c21c-4cbd-b1e3-f744ec603c20 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:39.776223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c64ae2-c21c-4cbd-b1e3-f744ec603c20 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:39.776223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c64ae2-c21c-4cbd-b1e3-f744ec603c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:39.787168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc279ed-6067-48bf-9c7c-4965ebaebd2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa07101ee6064ecfaf745ba39fb9e208, user_id=9e8b5cdcdb6349a593da50f06f83df92, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:39.789887 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc279ed-6067-48bf-9c7c-4965ebaebd2a admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:39.793728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-e7c64ae2-c21c-4cbd-b1e3-f744ec603c20 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:39.794937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-e7c64ae2-c21c-4cbd-b1e3-f744ec603c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:39.803136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1126/2248] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:39.811668 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d858dc-d6df-4aa0-9161-2ea800977cd0 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:39.811959 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d858dc-d6df-4aa0-9161-2ea800977cd0 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:39.812244 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d858dc-d6df-4aa0-9161-2ea800977cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:39.832010 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-c1d858dc-d6df-4aa0-9161-2ea800977cd0 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:39.833208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c1d858dc-d6df-4aa0-9161-2ea800977cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:39.841200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1127/2249] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:57:39.845033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d858dc-d6df-4aa0-9161-2ea800977cd0 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:39.854615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d858dc-d6df-4aa0-9161-2ea800977cd0 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:39.859667 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1b678-9a78-43ce-b6ce-dbe22ef6d648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:39.860243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1b678-9a78-43ce-b6ce-dbe22ef6d648 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:39.860525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1b678-9a78-43ce-b6ce-dbe22ef6d648 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:39.860797 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1b678-9a78-43ce-b6ce-dbe22ef6d648 admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:39.861438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1b678-9a78-43ce-b6ce-dbe22ef6d648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:57:39.861739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1b678-9a78-43ce-b6ce-dbe22ef6d648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:39.863503 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1b678-9a78-43ce-b6ce-dbe22ef6d648 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:39.875088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1128/2250] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:57:39.880091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1b678-9a78-43ce-b6ce-dbe22ef6d648 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:39.889550 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1b678-9a78-43ce-b6ce-dbe22ef6d648 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:39.894986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8371b0-6b1c-43a4-b251-21d1fea08dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:39.895590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8371b0-6b1c-43a4-b251-21d1fea08dba admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:39.895875 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8371b0-6b1c-43a4-b251-21d1fea08dba admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:39.896151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8371b0-6b1c-43a4-b251-21d1fea08dba admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:39.896775 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8371b0-6b1c-43a4-b251-21d1fea08dba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:39.898638 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8371b0-6b1c-43a4-b251-21d1fea08dba admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:39.910749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1123/2251] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:39 2022] PUT /identity/v3/projects/aa07101ee6064ecfaf745ba39fb9e208/users/9e8b5cdcdb6349a593da50f06f83df92/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:57:39.921950 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e421489-5c16-4542-87ea-e404b44f53e3 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:39.922240 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e421489-5c16-4542-87ea-e404b44f53e3 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:39.922521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e421489-5c16-4542-87ea-e404b44f53e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:39.952219 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-0e421489-5c16-4542-87ea-e404b44f53e3 None None] MFA Rules not processed for user `9e8b5cdcdb6349a593da50f06f83df92`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:39.953535 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0e421489-5c16-4542-87ea-e404b44f53e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:40.025530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1124/2252] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:57:40.036968 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e421489-5c16-4542-87ea-e404b44f53e3 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:40.038485 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0e421489-5c16-4542-87ea-e404b44f53e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:40.049621 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1129/2253] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:39 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:57:40.056538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8371b0-6b1c-43a4-b251-21d1fea08dba admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:40.109475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e421489-5c16-4542-87ea-e404b44f53e3 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:40.130937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8371b0-6b1c-43a4-b251-21d1fea08dba admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:40.135650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f0573-de8b-4c1e-94b3-fc797b0ecb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:40.136261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f0573-de8b-4c1e-94b3-fc797b0ecb3a admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:40.136541 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f0573-de8b-4c1e-94b3-fc797b0ecb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:40.136814 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f0573-de8b-4c1e-94b3-fc797b0ecb3a admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:40.137439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f0573-de8b-4c1e-94b3-fc797b0ecb3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:40.139395 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f0573-de8b-4c1e-94b3-fc797b0ecb3a admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:40.159018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f5dca-e846-42b9-a5f5-c7dde9605243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:40.160404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f5dca-e846-42b9-a5f5-c7dde9605243 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:40.160708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f5dca-e846-42b9-a5f5-c7dde9605243 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:40.161113 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f5dca-e846-42b9-a5f5-c7dde9605243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:40.218769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f5dca-e846-42b9-a5f5-c7dde9605243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:40.220372 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f5dca-e846-42b9-a5f5-c7dde9605243 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:40.229540 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1125/2254] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:57:40.248645 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f5dca-e846-42b9-a5f5-c7dde9605243 service cinder] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:40.250082 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-fc9f5dca-e846-42b9-a5f5-c7dde9605243 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:40.265006 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f5dca-e846-42b9-a5f5-c7dde9605243 service cinder] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:40.270616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1130/2255] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:40 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:57:40.274591 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f0573-de8b-4c1e-94b3-fc797b0ecb3a admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:40.275180 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9906e-83d1-4555-ab3f-899e5092c322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:40.275855 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9906e-83d1-4555-ab3f-899e5092c322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:40.276130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9906e-83d1-4555-ab3f-899e5092c322 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:40.281291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9906e-83d1-4555-ab3f-899e5092c322 admin admin] PATH_INFO: `/v3/users/9e8b5cdcdb6349a593da50f06f83df92` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:40.283535 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9906e-83d1-4555-ab3f-899e5092c322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e8b5cdcdb6349a593da50f06f83df92)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:40.285515 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9906e-83d1-4555-ab3f-899e5092c322 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:40.302229 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f0573-de8b-4c1e-94b3-fc797b0ecb3a admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:40.308358 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed16cd-948a-4e41-8d01-dc72ae7f61af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:40.308936 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed16cd-948a-4e41-8d01-dc72ae7f61af admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:40.309326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed16cd-948a-4e41-8d01-dc72ae7f61af admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:40.309483 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed16cd-948a-4e41-8d01-dc72ae7f61af admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:40.310212 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed16cd-948a-4e41-8d01-dc72ae7f61af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:40.311954 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed16cd-948a-4e41-8d01-dc72ae7f61af admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:40.329188 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1131/2256] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:57:40.330220 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed16cd-948a-4e41-8d01-dc72ae7f61af admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:40.342098 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed16cd-948a-4e41-8d01-dc72ae7f61af admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:40.347352 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab7cc4-e529-406f-be1a-c524dd64b8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:40.348050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab7cc4-e529-406f-be1a-c524dd64b8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:40.348337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab7cc4-e529-406f-be1a-c524dd64b8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:40.348723 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab7cc4-e529-406f-be1a-c524dd64b8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:40.351234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab7cc4-e529-406f-be1a-c524dd64b8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:40.351234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab7cc4-e529-406f-be1a-c524dd64b8a1 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:40.363998 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1132/2257] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:40.374657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab7cc4-e529-406f-be1a-c524dd64b8a1 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:40.398075 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab7cc4-e529-406f-be1a-c524dd64b8a1 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:40.403134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e21b2-a226-4183-970a-027a725bb3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:40.404205 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e21b2-a226-4183-970a-027a725bb3c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:40.404548 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e21b2-a226-4183-970a-027a725bb3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:40.405208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e21b2-a226-4183-970a-027a725bb3c7 admin admin] PATH_INFO: `/v3/projects/7959f86bcb284435bb4ba962014de35f/users/be996da775094ad288fe797160217772/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:40.423579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e21b2-a226-4183-970a-027a725bb3c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7959f86bcb284435bb4ba962014de35f, user_id=be996da775094ad288fe797160217772, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:40.426096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e21b2-a226-4183-970a-027a725bb3c7 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:40.499357 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1133/2258] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:40 2022] PUT /identity/v3/projects/7959f86bcb284435bb4ba962014de35f/users/be996da775094ad288fe797160217772/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:40.508127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d9a9906e-83d1-4555-ab3f-899e5092c322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e8b5cdcdb6349a593da50f06f83df92'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:40.510373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f92a3e-32cd-465e-8f77-0dc16f3f54cf None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:40.510664 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f92a3e-32cd-465e-8f77-0dc16f3f54cf None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:40.510945 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f92a3e-32cd-465e-8f77-0dc16f3f54cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:40.538876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-89f92a3e-32cd-465e-8f77-0dc16f3f54cf None None] MFA Rules not processed for user `be996da775094ad288fe797160217772`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:40.540115 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-89f92a3e-32cd-465e-8f77-0dc16f3f54cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:40.587840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d9a9906e-83d1-4555-ab3f-899e5092c322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e8b5cdcdb6349a593da50f06f83df92'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:40.588809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d9a9906e-83d1-4555-ab3f-899e5092c322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e8b5cdcdb6349a593da50f06f83df92'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:40.598447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d9a9906e-83d1-4555-ab3f-899e5092c322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e8b5cdcdb6349a593da50f06f83df92'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:40.610400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1134/2259] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:57:40.613062 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d9a9906e-83d1-4555-ab3f-899e5092c322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e8b5cdcdb6349a593da50f06f83df92'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:40.621982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f92a3e-32cd-465e-8f77-0dc16f3f54cf None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:40.623308 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1126/2260] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:57:40 2022] DELETE /identity/v3/users/9e8b5cdcdb6349a593da50f06f83df92 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:57:40.623460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-89f92a3e-32cd-465e-8f77-0dc16f3f54cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:40.624879 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569bcb1-f6b4-42f0-9b56-00474a81d5ce None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:40.625163 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569bcb1-f6b4-42f0-9b56-00474a81d5ce None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:40.625431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569bcb1-f6b4-42f0-9b56-00474a81d5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:40.646268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-e569bcb1-f6b4-42f0-9b56-00474a81d5ce None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:40.647491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e569bcb1-f6b4-42f0-9b56-00474a81d5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:40.687519 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f92a3e-32cd-465e-8f77-0dc16f3f54cf None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:40.716069 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1127/2261] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:40.720181 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:40.728790 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569bcb1-f6b4-42f0-9b56-00474a81d5ce None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:40.732600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e569bcb1-f6b4-42f0-9b56-00474a81d5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:40.747328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a0b9b-a7c1-4f3d-9b80-3bc5610419a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:40.751131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a0b9b-a7c1-4f3d-9b80-3bc5610419a0 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:40.751131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a0b9b-a7c1-4f3d-9b80-3bc5610419a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:40.751131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a0b9b-a7c1-4f3d-9b80-3bc5610419a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:40.825229 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a0b9b-a7c1-4f3d-9b80-3bc5610419a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:40.828064 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569bcb1-f6b4-42f0-9b56-00474a81d5ce None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:40.829245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a0b9b-a7c1-4f3d-9b80-3bc5610419a0 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:40.833881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1fd09-07e3-459a-93f4-e89da56a7da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:40.834153 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1fd09-07e3-459a-93f4-e89da56a7da1 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:40.834468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1fd09-07e3-459a-93f4-e89da56a7da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:40.834795 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1fd09-07e3-459a-93f4-e89da56a7da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:40.849002 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1135/2262] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:57:40.852369 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1fd09-07e3-459a-93f4-e89da56a7da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:40.854199 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1fd09-07e3-459a-93f4-e89da56a7da1 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:40.866480 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1128/2263] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:57:41.420025 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a0b9b-a7c1-4f3d-9b80-3bc5610419a0 service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:41.421577 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-176a0b9b-a7c1-4f3d-9b80-3bc5610419a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:41.437516 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a0b9b-a7c1-4f3d-9b80-3bc5610419a0 service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:41.442343 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923a2fb-d438-4d6c-be7a-c487afdb3166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:41.443000 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923a2fb-d438-4d6c-be7a-c487afdb3166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:41.443285 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923a2fb-d438-4d6c-be7a-c487afdb3166 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:41.443610 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923a2fb-d438-4d6c-be7a-c487afdb3166 admin admin] PATH_INFO: `/v3/projects/aa07101ee6064ecfaf745ba39fb9e208` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:41.444763 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923a2fb-d438-4d6c-be7a-c487afdb3166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa07101ee6064ecfaf745ba39fb9e208)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:41.446781 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923a2fb-d438-4d6c-be7a-c487afdb3166 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:41.584066 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1923a2fb-d438-4d6c-be7a-c487afdb3166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa07101ee6064ecfaf745ba39fb9e208', 'request_id': 'req-1923a2fb-d438-4d6c-be7a-c487afdb3166'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:41.612703 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:41.724280 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1923a2fb-d438-4d6c-be7a-c487afdb3166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa07101ee6064ecfaf745ba39fb9e208', 'request_id': 'req-1923a2fb-d438-4d6c-be7a-c487afdb3166'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:41.740075 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1923a2fb-d438-4d6c-be7a-c487afdb3166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa07101ee6064ecfaf745ba39fb9e208', 'request_id': 'req-1923a2fb-d438-4d6c-be7a-c487afdb3166'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:41.750531 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1923a2fb-d438-4d6c-be7a-c487afdb3166 admin admin] The token cache is being invalidate because project aa07101ee6064ecfaf745ba39fb9e208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:41.750824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1923a2fb-d438-4d6c-be7a-c487afdb3166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:41.751887 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1923a2fb-d438-4d6c-be7a-c487afdb3166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:41.754587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1136/2264] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:41 2022] DELETE /identity/v3/projects/aa07101ee6064ecfaf745ba39fb9e208 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:41.759625 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3276ce-90f1-4b2f-b43f-798186d5c860 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:41.760072 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3276ce-90f1-4b2f-b43f-798186d5c860 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:41.760290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3276ce-90f1-4b2f-b43f-798186d5c860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:41.783910 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-ed3276ce-90f1-4b2f-b43f-798186d5c860 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:41.785118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ed3276ce-90f1-4b2f-b43f-798186d5c860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:41.847567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1129/2265] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:41.855287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d8ad3-8514-4130-94f0-dd33ba52b56a None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:41.855589 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d8ad3-8514-4130-94f0-dd33ba52b56a None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:41.855868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d8ad3-8514-4130-94f0-dd33ba52b56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:41.876664 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-814d8ad3-8514-4130-94f0-dd33ba52b56a None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:41.881636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-814d8ad3-8514-4130-94f0-dd33ba52b56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:41.892639 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1137/2266] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:41.897706 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3276ce-90f1-4b2f-b43f-798186d5c860 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:41.908939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3276ce-90f1-4b2f-b43f-798186d5c860 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:41.914010 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7451bf-5f6d-4dc3-a861-f07162f9e601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:41.914730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7451bf-5f6d-4dc3-a861-f07162f9e601 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:41.915082 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7451bf-5f6d-4dc3-a861-f07162f9e601 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:41.915611 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7451bf-5f6d-4dc3-a861-f07162f9e601 admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:41.916398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7451bf-5f6d-4dc3-a861-f07162f9e601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:57:41.916842 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7451bf-5f6d-4dc3-a861-f07162f9e601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:41.918540 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7451bf-5f6d-4dc3-a861-f07162f9e601 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:41.930867 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1130/2267] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:57:41.938580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d8ad3-8514-4130-94f0-dd33ba52b56a None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:41.948899 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d8ad3-8514-4130-94f0-dd33ba52b56a None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:41.953750 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63175c-7e15-44d1-9408-7163d0edfbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:41.954382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63175c-7e15-44d1-9408-7163d0edfbdd admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:41.954660 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63175c-7e15-44d1-9408-7163d0edfbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:41.954933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63175c-7e15-44d1-9408-7163d0edfbdd admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:41.956362 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63175c-7e15-44d1-9408-7163d0edfbdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:41.958463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63175c-7e15-44d1-9408-7163d0edfbdd admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:42.110762 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1138/2268] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:41 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:42.115901 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7451bf-5f6d-4dc3-a861-f07162f9e601 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:42.132746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7451bf-5f6d-4dc3-a861-f07162f9e601 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:42.211934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f3414-9cf7-43b4-9945-319d9f4f0eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:42.211934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f3414-9cf7-43b4-9945-319d9f4f0eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:42.211934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f3414-9cf7-43b4-9945-319d9f4f0eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:42.211934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f3414-9cf7-43b4-9945-319d9f4f0eb1 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:42.217744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f3414-9cf7-43b4-9945-319d9f4f0eb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:42.217744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f3414-9cf7-43b4-9945-319d9f4f0eb1 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:42.292874 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1131/2269] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:42 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:42.296879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63175c-7e15-44d1-9408-7163d0edfbdd admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:42.316101 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63175c-7e15-44d1-9408-7163d0edfbdd admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:42.321824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1668e0a-d5fe-4d01-bafc-a8d093af402c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:42.322477 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1668e0a-d5fe-4d01-bafc-a8d093af402c admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:42.322766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1668e0a-d5fe-4d01-bafc-a8d093af402c admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:42.323044 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1668e0a-d5fe-4d01-bafc-a8d093af402c admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:42.323889 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1668e0a-d5fe-4d01-bafc-a8d093af402c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:42.325536 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1668e0a-d5fe-4d01-bafc-a8d093af402c admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:42.336992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1139/2270] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:42.341329 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f3414-9cf7-43b4-9945-319d9f4f0eb1 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:42.351445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f3414-9cf7-43b4-9945-319d9f4f0eb1 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:42.356390 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cb315-285f-44fd-9a10-e403ec3b6905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:42.357025 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cb315-285f-44fd-9a10-e403ec3b6905 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:42.357446 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cb315-285f-44fd-9a10-e403ec3b6905 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:42.357715 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cb315-285f-44fd-9a10-e403ec3b6905 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:42.358382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cb315-285f-44fd-9a10-e403ec3b6905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:42.359992 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cb315-285f-44fd-9a10-e403ec3b6905 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:42.371593 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1132/2271] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:42.375610 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1668e0a-d5fe-4d01-bafc-a8d093af402c admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:42.389502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1668e0a-d5fe-4d01-bafc-a8d093af402c admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:42.394880 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34734562-3cdc-4fcb-949d-d0ef6b819587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:42.407273 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34734562-3cdc-4fcb-949d-d0ef6b819587 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:42.407273 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34734562-3cdc-4fcb-949d-d0ef6b819587 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:42.407273 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34734562-3cdc-4fcb-949d-d0ef6b819587 admin admin] PATH_INFO: `/v3/projects/c04d88fdb73446878771828aa2b4b16d/users/abf7f69bfc57411e86f410395e16d003/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:42.411913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34734562-3cdc-4fcb-949d-d0ef6b819587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04d88fdb73446878771828aa2b4b16d, user_id=abf7f69bfc57411e86f410395e16d003, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:42.414733 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34734562-3cdc-4fcb-949d-d0ef6b819587 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:42.525440 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1140/2272] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:42 2022] PUT /identity/v3/projects/c04d88fdb73446878771828aa2b4b16d/users/abf7f69bfc57411e86f410395e16d003/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:57:42.537181 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f8280-4857-4b80-806c-200da6fe55f4 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:42.537467 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f8280-4857-4b80-806c-200da6fe55f4 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:42.537792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f8280-4857-4b80-806c-200da6fe55f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:42.567226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-749f8280-4857-4b80-806c-200da6fe55f4 None None] MFA Rules not processed for user `abf7f69bfc57411e86f410395e16d003`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:42.568503 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-749f8280-4857-4b80-806c-200da6fe55f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:42.632147 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1133/2273] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:42.643335 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34734562-3cdc-4fcb-949d-d0ef6b819587 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:42.645341 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-34734562-3cdc-4fcb-949d-d0ef6b819587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:42.708240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34734562-3cdc-4fcb-949d-d0ef6b819587 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:42.712037 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e458f-b4e5-4c68-b851-ceb2bcfc8efa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:42.712609 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e458f-b4e5-4c68-b851-ceb2bcfc8efa service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:42.712886 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e458f-b4e5-4c68-b851-ceb2bcfc8efa service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:42.713153 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e458f-b4e5-4c68-b851-ceb2bcfc8efa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:42.722241 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e458f-b4e5-4c68-b851-ceb2bcfc8efa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:42.723705 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e458f-b4e5-4c68-b851-ceb2bcfc8efa service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:42.733165 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1141/2274] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:42.956573 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:43.292522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f8280-4857-4b80-806c-200da6fe55f4 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:43.293985 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-749f8280-4857-4b80-806c-200da6fe55f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:43.381919 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f8280-4857-4b80-806c-200da6fe55f4 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:43.388467 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb2d31-9813-41bd-9a2c-165a1966d4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:43.389352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb2d31-9813-41bd-9a2c-165a1966d4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:43.390050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb2d31-9813-41bd-9a2c-165a1966d4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:43.390403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb2d31-9813-41bd-9a2c-165a1966d4d4 admin admin] PATH_INFO: `/v3/users/7e46cb485a504375b9b36334272f8f53` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:43.391966 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb2d31-9813-41bd-9a2c-165a1966d4d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e46cb485a504375b9b36334272f8f53)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:43.395125 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb2d31-9813-41bd-9a2c-165a1966d4d4 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:43.642846 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c7bb2d31-9813-41bd-9a2c-165a1966d4d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e46cb485a504375b9b36334272f8f53'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:43.735772 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c7bb2d31-9813-41bd-9a2c-165a1966d4d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e46cb485a504375b9b36334272f8f53'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:43.736911 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c7bb2d31-9813-41bd-9a2c-165a1966d4d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e46cb485a504375b9b36334272f8f53'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:43.750528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c7bb2d31-9813-41bd-9a2c-165a1966d4d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e46cb485a504375b9b36334272f8f53'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:43.778996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c7bb2d31-9813-41bd-9a2c-165a1966d4d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e46cb485a504375b9b36334272f8f53'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:43.787599 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1134/2275] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:57:43 2022] DELETE /identity/v3/users/7e46cb485a504375b9b36334272f8f53 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:43.791290 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896e1c7-02b8-4a8e-a08e-e5b7cf4993a2 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:43.796306 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896e1c7-02b8-4a8e-a08e-e5b7cf4993a2 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:43.797047 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896e1c7-02b8-4a8e-a08e-e5b7cf4993a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:43.833811 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-2896e1c7-02b8-4a8e-a08e-e5b7cf4993a2 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:43.835318 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2896e1c7-02b8-4a8e-a08e-e5b7cf4993a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:43.935651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1142/2276] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:43.957674 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb2d31-9813-41bd-9a2c-165a1966d4d4 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:43.959768 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-c7bb2d31-9813-41bd-9a2c-165a1966d4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:44.049070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb2d31-9813-41bd-9a2c-165a1966d4d4 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:44.055755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a4189-8b67-444f-ada2-43b00b6dc8de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:44.057309 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a4189-8b67-444f-ada2-43b00b6dc8de service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:44.057665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a4189-8b67-444f-ada2-43b00b6dc8de service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:44.057949 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a4189-8b67-444f-ada2-43b00b6dc8de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:44.073521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a4189-8b67-444f-ada2-43b00b6dc8de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:44.075126 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a4189-8b67-444f-ada2-43b00b6dc8de service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:44.086589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1135/2277] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:57:44.669696 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896e1c7-02b8-4a8e-a08e-e5b7cf4993a2 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:44.671140 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2896e1c7-02b8-4a8e-a08e-e5b7cf4993a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:44.690976 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896e1c7-02b8-4a8e-a08e-e5b7cf4993a2 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:44.700458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e0af7-de36-445c-aa12-c7eb1f5439da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:44.701399 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e0af7-de36-445c-aa12-c7eb1f5439da admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:44.701891 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e0af7-de36-445c-aa12-c7eb1f5439da admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:44.702692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e0af7-de36-445c-aa12-c7eb1f5439da admin admin] PATH_INFO: `/v3/projects/fdb4cb1314464f7383658d030fcb7c77` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:44.703673 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e0af7-de36-445c-aa12-c7eb1f5439da admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdb4cb1314464f7383658d030fcb7c77)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:44.706537 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e0af7-de36-445c-aa12-c7eb1f5439da admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:44.782150 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:44.853712 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d72e0af7-de36-445c-aa12-c7eb1f5439da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdb4cb1314464f7383658d030fcb7c77', 'request_id': 'req-d72e0af7-de36-445c-aa12-c7eb1f5439da'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:44.983852 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d72e0af7-de36-445c-aa12-c7eb1f5439da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdb4cb1314464f7383658d030fcb7c77', 'request_id': 'req-d72e0af7-de36-445c-aa12-c7eb1f5439da'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:44.990723 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d72e0af7-de36-445c-aa12-c7eb1f5439da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdb4cb1314464f7383658d030fcb7c77', 'request_id': 'req-d72e0af7-de36-445c-aa12-c7eb1f5439da'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:45.002304 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d72e0af7-de36-445c-aa12-c7eb1f5439da admin admin] The token cache is being invalidate because project fdb4cb1314464f7383658d030fcb7c77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:45.003010 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d72e0af7-de36-445c-aa12-c7eb1f5439da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:45.003707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d72e0af7-de36-445c-aa12-c7eb1f5439da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:45.005202 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1143/2278] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:44 2022] DELETE /identity/v3/projects/fdb4cb1314464f7383658d030fcb7c77 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:45.010447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2eecd-d59b-4460-b430-53acc9db8fbe None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:45.010918 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2eecd-d59b-4460-b430-53acc9db8fbe None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:45.011006 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2eecd-d59b-4460-b430-53acc9db8fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:45.031263 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-d8a2eecd-d59b-4460-b430-53acc9db8fbe None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:45.032566 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d8a2eecd-d59b-4460-b430-53acc9db8fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:45.090428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:45.101027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1136/2279] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:45.109424 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f252dd-80d7-460e-a143-a88d4fa67c6e None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:45.109857 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f252dd-80d7-460e-a143-a88d4fa67c6e None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:45.110305 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f252dd-80d7-460e-a143-a88d4fa67c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:45.144632 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-56f252dd-80d7-460e-a143-a88d4fa67c6e None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:45.146050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-56f252dd-80d7-460e-a143-a88d4fa67c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:45.160763 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1144/2280] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:45.166112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2eecd-d59b-4460-b430-53acc9db8fbe None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:45.178768 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2eecd-d59b-4460-b430-53acc9db8fbe None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:45.186254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b729a1-cf53-42cf-aa6f-85b2a056a81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:45.187311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b729a1-cf53-42cf-aa6f-85b2a056a81f admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:45.187923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b729a1-cf53-42cf-aa6f-85b2a056a81f admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:45.188568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b729a1-cf53-42cf-aa6f-85b2a056a81f admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:45.189675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b729a1-cf53-42cf-aa6f-85b2a056a81f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:57:45.190060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b729a1-cf53-42cf-aa6f-85b2a056a81f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:45.192901 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b729a1-cf53-42cf-aa6f-85b2a056a81f admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:45.220858 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1137/2281] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:57:45.222495 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f252dd-80d7-460e-a143-a88d4fa67c6e None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:45.234916 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f252dd-80d7-460e-a143-a88d4fa67c6e None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:45.242675 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cb7e8-61b9-4a16-9067-2ceaebe74910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:45.243573 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cb7e8-61b9-4a16-9067-2ceaebe74910 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:45.243857 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cb7e8-61b9-4a16-9067-2ceaebe74910 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:45.244129 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cb7e8-61b9-4a16-9067-2ceaebe74910 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:45.244992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cb7e8-61b9-4a16-9067-2ceaebe74910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:45.247096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cb7e8-61b9-4a16-9067-2ceaebe74910 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:45.478226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1145/2282] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:45 2022] POST /identity/v3/projects => generated 373 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:45.483356 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b729a1-cf53-42cf-aa6f-85b2a056a81f admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:45.497492 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b729a1-cf53-42cf-aa6f-85b2a056a81f admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:45.564236 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26df1f5-2973-4ff7-9c0a-34637ed82216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:45.564930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26df1f5-2973-4ff7-9c0a-34637ed82216 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:45.565280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26df1f5-2973-4ff7-9c0a-34637ed82216 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:45.565608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26df1f5-2973-4ff7-9c0a-34637ed82216 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:45.566360 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26df1f5-2973-4ff7-9c0a-34637ed82216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:45.568706 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26df1f5-2973-4ff7-9c0a-34637ed82216 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:45.745032 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1138/2283] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:45 2022] POST /identity/v3/users => generated 287 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:45.786117 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cb7e8-61b9-4a16-9067-2ceaebe74910 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:45.795872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26df1f5-2973-4ff7-9c0a-34637ed82216 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:45.796486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cb7e8-61b9-4a16-9067-2ceaebe74910 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:45.797615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b26df1f5-2973-4ff7-9c0a-34637ed82216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:45.801751 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52851e13-4cad-4c69-9a79-8826a187317b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:45.802394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52851e13-4cad-4c69-9a79-8826a187317b admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:45.802700 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52851e13-4cad-4c69-9a79-8826a187317b admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:45.802974 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52851e13-4cad-4c69-9a79-8826a187317b admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:45.803672 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52851e13-4cad-4c69-9a79-8826a187317b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:45.805274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52851e13-4cad-4c69-9a79-8826a187317b admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:45.812702 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26df1f5-2973-4ff7-9c0a-34637ed82216 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:45.819965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1146/2284] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:45.820162 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabc165-1f67-4a04-88c6-4529b7b90501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:45.820162 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabc165-1f67-4a04-88c6-4529b7b90501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:45.820162 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabc165-1f67-4a04-88c6-4529b7b90501 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:45.820162 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabc165-1f67-4a04-88c6-4529b7b90501 admin admin] PATH_INFO: `/v3/users/be996da775094ad288fe797160217772` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:45.820969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52851e13-4cad-4c69-9a79-8826a187317b admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:45.821154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabc165-1f67-4a04-88c6-4529b7b90501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be996da775094ad288fe797160217772)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:45.823040 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabc165-1f67-4a04-88c6-4529b7b90501 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:45.835208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52851e13-4cad-4c69-9a79-8826a187317b admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:45.840981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234c988-ac85-486a-9023-39f44d3a7bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:45.841993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234c988-ac85-486a-9023-39f44d3a7bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:45.842272 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234c988-ac85-486a-9023-39f44d3a7bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:45.842780 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234c988-ac85-486a-9023-39f44d3a7bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:45.843610 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234c988-ac85-486a-9023-39f44d3a7bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:45.845597 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234c988-ac85-486a-9023-39f44d3a7bc1 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:45.861557 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1147/2285] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:57:45.862738 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234c988-ac85-486a-9023-39f44d3a7bc1 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:45.872630 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234c988-ac85-486a-9023-39f44d3a7bc1 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:45.877268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c48561-c7c1-44cc-93c3-5c07da92aee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:45.883150 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c48561-c7c1-44cc-93c3-5c07da92aee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:45.883150 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c48561-c7c1-44cc-93c3-5c07da92aee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:45.883150 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c48561-c7c1-44cc-93c3-5c07da92aee1 admin admin] PATH_INFO: `/v3/projects/b6d7978f092d4b0a814f1072ee5bcc62/users/4c11ae4c2cff47698b701398ba17295a/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:45.894855 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c48561-c7c1-44cc-93c3-5c07da92aee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d7978f092d4b0a814f1072ee5bcc62, user_id=4c11ae4c2cff47698b701398ba17295a, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:45.897531 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c48561-c7c1-44cc-93c3-5c07da92aee1 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:46.031239 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1148/2286] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:45 2022] PUT /identity/v3/projects/b6d7978f092d4b0a814f1072ee5bcc62/users/4c11ae4c2cff47698b701398ba17295a/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:57:46.036943 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42890c8a-1c5c-4e57-8ee0-80d35fd850a7 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:46.037227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42890c8a-1c5c-4e57-8ee0-80d35fd850a7 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:46.037554 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42890c8a-1c5c-4e57-8ee0-80d35fd850a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:46.059702 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-42890c8a-1c5c-4e57-8ee0-80d35fd850a7 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:46.060977 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-42890c8a-1c5c-4e57-8ee0-80d35fd850a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:46.138439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1149/2287] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:57:46.150064 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42890c8a-1c5c-4e57-8ee0-80d35fd850a7 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:46.151894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-42890c8a-1c5c-4e57-8ee0-80d35fd850a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:46.193723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-0fabc165-1f67-4a04-88c6-4529b7b90501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be996da775094ad288fe797160217772'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:46.228158 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42890c8a-1c5c-4e57-8ee0-80d35fd850a7 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:46.232098 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0dc63-1e93-4149-bf72-7834ca3d532e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:46.232718 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0dc63-1e93-4149-bf72-7834ca3d532e service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:46.232989 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0dc63-1e93-4149-bf72-7834ca3d532e service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:46.233264 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0dc63-1e93-4149-bf72-7834ca3d532e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:46.243183 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0dc63-1e93-4149-bf72-7834ca3d532e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:46.244685 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0dc63-1e93-4149-bf72-7834ca3d532e service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:46.254635 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1150/2288] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:46.361257 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-0fabc165-1f67-4a04-88c6-4529b7b90501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be996da775094ad288fe797160217772'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:46.362749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-0fabc165-1f67-4a04-88c6-4529b7b90501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be996da775094ad288fe797160217772'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:46.375291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-0fabc165-1f67-4a04-88c6-4529b7b90501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be996da775094ad288fe797160217772'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:46.408006 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-0fabc165-1f67-4a04-88c6-4529b7b90501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be996da775094ad288fe797160217772'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:46.430125 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1139/2289] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:57:45 2022] DELETE /identity/v3/users/be996da775094ad288fe797160217772 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:57:46.432629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7753b00-1980-4ebd-9333-1c58d4791297 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:46.432987 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7753b00-1980-4ebd-9333-1c58d4791297 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:46.433338 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7753b00-1980-4ebd-9333-1c58d4791297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:46.471915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-c7753b00-1980-4ebd-9333-1c58d4791297 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:46.474788 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c7753b00-1980-4ebd-9333-1c58d4791297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:46.611016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1151/2290] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:46.620941 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabc165-1f67-4a04-88c6-4529b7b90501 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:46.622504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0fabc165-1f67-4a04-88c6-4529b7b90501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:46.680801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabc165-1f67-4a04-88c6-4529b7b90501 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:46.684451 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f181c-fbb4-4b60-9934-ea0c419b7206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:46.685478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f181c-fbb4-4b60-9934-ea0c419b7206 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:46.685790 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f181c-fbb4-4b60-9934-ea0c419b7206 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:46.686030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f181c-fbb4-4b60-9934-ea0c419b7206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:46.697043 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f181c-fbb4-4b60-9934-ea0c419b7206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:46.698623 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f181c-fbb4-4b60-9934-ea0c419b7206 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:46.713142 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1140/2291] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:46.785025 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fa60a-21fe-4eea-b370-e80744c7ffda None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:46.785503 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fa60a-21fe-4eea-b370-e80744c7ffda None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:46.785851 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fa60a-21fe-4eea-b370-e80744c7ffda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:46.814431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-5a2fa60a-21fe-4eea-b370-e80744c7ffda None None] MFA Rules not processed for user `15fbda6263b44352b3ac560372bef725`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:46.816058 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-5a2fa60a-21fe-4eea-b370-e80744c7ffda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:46.883791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1152/2292] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Sep 14 19:57:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:46.926817 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f181c-fbb4-4b60-9934-ea0c419b7206 service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:46.928300 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-832f181c-fbb4-4b60-9934-ea0c419b7206 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:47.003738 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f181c-fbb4-4b60-9934-ea0c419b7206 service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:47.013135 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632d4ae-f468-4090-94f7-d8d560cfb493 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee56bf9af257486e94e6ff1b33086f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:47.013330 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632d4ae-f468-4090-94f7-d8d560cfb493 service swift] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:47.013600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632d4ae-f468-4090-94f7-d8d560cfb493 service swift] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:47.013878 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632d4ae-f468-4090-94f7-d8d560cfb493 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:47.024990 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632d4ae-f468-4090-94f7-d8d560cfb493 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:47.026961 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632d4ae-f468-4090-94f7-d8d560cfb493 service swift] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:47.038084 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1141/2293] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Sep 14 19:57:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 19:57:47.711384 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fa60a-21fe-4eea-b370-e80744c7ffda None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:47.711384 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-5a2fa60a-21fe-4eea-b370-e80744c7ffda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:47.711384 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fa60a-21fe-4eea-b370-e80744c7ffda None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:47.714017 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a58ca-a50a-44b0-81ff-69e31bfbf74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:47.714017 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a58ca-a50a-44b0-81ff-69e31bfbf74c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:47.714017 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a58ca-a50a-44b0-81ff-69e31bfbf74c admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:47.714017 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a58ca-a50a-44b0-81ff-69e31bfbf74c admin admin] PATH_INFO: `/v3/projects/7959f86bcb284435bb4ba962014de35f` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:47.714973 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a58ca-a50a-44b0-81ff-69e31bfbf74c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7959f86bcb284435bb4ba962014de35f)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:47.714973 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a58ca-a50a-44b0-81ff-69e31bfbf74c admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:47.885023 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-943a58ca-a50a-44b0-81ff-69e31bfbf74c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7959f86bcb284435bb4ba962014de35f', 'request_id': 'req-943a58ca-a50a-44b0-81ff-69e31bfbf74c'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:48.032556 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-943a58ca-a50a-44b0-81ff-69e31bfbf74c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7959f86bcb284435bb4ba962014de35f', 'request_id': 'req-943a58ca-a50a-44b0-81ff-69e31bfbf74c'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:48.041563 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-943a58ca-a50a-44b0-81ff-69e31bfbf74c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7959f86bcb284435bb4ba962014de35f', 'request_id': 'req-943a58ca-a50a-44b0-81ff-69e31bfbf74c'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:48.072430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-943a58ca-a50a-44b0-81ff-69e31bfbf74c admin admin] The token cache is being invalidate because project 7959f86bcb284435bb4ba962014de35f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:57:48.072730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-943a58ca-a50a-44b0-81ff-69e31bfbf74c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:48.077473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-943a58ca-a50a-44b0-81ff-69e31bfbf74c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:57:48.079916 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1153/2294] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:57:47 2022] DELETE /identity/v3/projects/7959f86bcb284435bb4ba962014de35f => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:48.085347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77573289-6a2a-45d1-acdb-a6ad20f6a149 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:48.085931 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77573289-6a2a-45d1-acdb-a6ad20f6a149 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:48.085931 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77573289-6a2a-45d1-acdb-a6ad20f6a149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:48.112528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-77573289-6a2a-45d1-acdb-a6ad20f6a149 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:48.113882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-77573289-6a2a-45d1-acdb-a6ad20f6a149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:48.192949 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1142/2295] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:48.212109 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8d911-bc4e-40fb-9a65-d7bdd0a29710 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:48.212109 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8d911-bc4e-40fb-9a65-d7bdd0a29710 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:48.212109 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8d911-bc4e-40fb-9a65-d7bdd0a29710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:48.270992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-74d8d911-bc4e-40fb-9a65-d7bdd0a29710 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:48.272631 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-74d8d911-bc4e-40fb-9a65-d7bdd0a29710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:48.296450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1154/2296] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:48.301163 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77573289-6a2a-45d1-acdb-a6ad20f6a149 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:48.318304 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77573289-6a2a-45d1-acdb-a6ad20f6a149 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:48.324047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1007ee9-95be-45f8-a035-47d216b8fd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:48.325054 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1007ee9-95be-45f8-a035-47d216b8fd7c admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:48.325591 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1007ee9-95be-45f8-a035-47d216b8fd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:48.326060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1007ee9-95be-45f8-a035-47d216b8fd7c admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:48.326922 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1007ee9-95be-45f8-a035-47d216b8fd7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:57:48.327489 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1007ee9-95be-45f8-a035-47d216b8fd7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:48.329409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1007ee9-95be-45f8-a035-47d216b8fd7c admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:48.348144 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1143/2297] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:57:48.352399 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8d911-bc4e-40fb-9a65-d7bdd0a29710 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:48.364039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8d911-bc4e-40fb-9a65-d7bdd0a29710 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:48.388712 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06b9b7-7ce4-4e65-9248-57d0d4415098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:48.389774 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06b9b7-7ce4-4e65-9248-57d0d4415098 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:48.390530 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06b9b7-7ce4-4e65-9248-57d0d4415098 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:48.391006 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06b9b7-7ce4-4e65-9248-57d0d4415098 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:48.393789 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06b9b7-7ce4-4e65-9248-57d0d4415098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:48.397493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06b9b7-7ce4-4e65-9248-57d0d4415098 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:48.522418 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1155/2298] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:48 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:48.528169 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1007ee9-95be-45f8-a035-47d216b8fd7c admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:48.542021 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1007ee9-95be-45f8-a035-47d216b8fd7c admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:48.649760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e6922-8450-4fd2-a190-2836bc44867c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:48.651068 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e6922-8450-4fd2-a190-2836bc44867c admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:48.652209 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e6922-8450-4fd2-a190-2836bc44867c admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:48.657173 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e6922-8450-4fd2-a190-2836bc44867c admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:48.657173 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e6922-8450-4fd2-a190-2836bc44867c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:48.659306 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e6922-8450-4fd2-a190-2836bc44867c admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:48.793266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1144/2299] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:48 2022] POST /identity/v3/users => generated 292 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:48.797785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06b9b7-7ce4-4e65-9248-57d0d4415098 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:48.813525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06b9b7-7ce4-4e65-9248-57d0d4415098 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:48.825856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a356eb-5dbc-4ed0-8855-08ce1a67bac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:48.827785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a356eb-5dbc-4ed0-8855-08ce1a67bac5 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:48.831073 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a356eb-5dbc-4ed0-8855-08ce1a67bac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:48.831592 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a356eb-5dbc-4ed0-8855-08ce1a67bac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:48.833034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a356eb-5dbc-4ed0-8855-08ce1a67bac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:48.836213 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a356eb-5dbc-4ed0-8855-08ce1a67bac5 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:48.857560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1156/2300] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:48.863491 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e6922-8450-4fd2-a190-2836bc44867c admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:48.891629 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e6922-8450-4fd2-a190-2836bc44867c admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:48.892365 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ed44b-5ef8-4193-816c-8f0cb516cb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:48.893280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ed44b-5ef8-4193-816c-8f0cb516cb32 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:48.893563 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ed44b-5ef8-4193-816c-8f0cb516cb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:48.893896 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ed44b-5ef8-4193-816c-8f0cb516cb32 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:48.894536 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ed44b-5ef8-4193-816c-8f0cb516cb32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:48.898582 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ed44b-5ef8-4193-816c-8f0cb516cb32 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:48.949200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a356eb-5dbc-4ed0-8855-08ce1a67bac5 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:48.950066 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1145/2301] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:57:48.950167 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:48.963346 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a356eb-5dbc-4ed0-8855-08ce1a67bac5 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:48.981867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f907a8-457d-4262-bc8b-7874f3de208f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:48.981867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f907a8-457d-4262-bc8b-7874f3de208f admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:48.981867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f907a8-457d-4262-bc8b-7874f3de208f admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:48.981867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f907a8-457d-4262-bc8b-7874f3de208f admin admin] PATH_INFO: `/v3/projects/9e53fb127a0146fb8c1d9727199465d9/users/193c786d73fc4f819498b76d3b6bb87a/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:49.014169 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f907a8-457d-4262-bc8b-7874f3de208f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e53fb127a0146fb8c1d9727199465d9, user_id=193c786d73fc4f819498b76d3b6bb87a, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:49.023827 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f907a8-457d-4262-bc8b-7874f3de208f admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:49.115191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1157/2302] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:48 2022] PUT /identity/v3/projects/9e53fb127a0146fb8c1d9727199465d9/users/193c786d73fc4f819498b76d3b6bb87a/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:49.125606 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900a3e2-8f53-4ebb-802e-1c0e6be82ef2 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:49.126204 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900a3e2-8f53-4ebb-802e-1c0e6be82ef2 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:49.126204 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900a3e2-8f53-4ebb-802e-1c0e6be82ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:49.193920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-0900a3e2-8f53-4ebb-802e-1c0e6be82ef2 None None] MFA Rules not processed for user `193c786d73fc4f819498b76d3b6bb87a`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:49.195296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0900a3e2-8f53-4ebb-802e-1c0e6be82ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:49.296147 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:49.339218 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1146/2303] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:49.343979 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f907a8-457d-4262-bc8b-7874f3de208f admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:49.503100 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f907a8-457d-4262-bc8b-7874f3de208f admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:49.527041 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd04462-0b70-4552-9468-ca3c41cf7494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:49.527982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd04462-0b70-4552-9468-ca3c41cf7494 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:49.530763 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd04462-0b70-4552-9468-ca3c41cf7494 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:49.532538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd04462-0b70-4552-9468-ca3c41cf7494 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:49.533405 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd04462-0b70-4552-9468-ca3c41cf7494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:49.543154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd04462-0b70-4552-9468-ca3c41cf7494 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:49.704073 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900a3e2-8f53-4ebb-802e-1c0e6be82ef2 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:49.711652 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1158/2304] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:49 2022] POST /identity/v3/projects => generated 383 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:49.729722 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900a3e2-8f53-4ebb-802e-1c0e6be82ef2 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:49.827330 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6ccd7-fec1-4988-a7d6-aec8cc1e2fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:49.829407 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6ccd7-fec1-4988-a7d6-aec8cc1e2fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:49.830121 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6ccd7-fec1-4988-a7d6-aec8cc1e2fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:49.831234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6ccd7-fec1-4988-a7d6-aec8cc1e2fa6 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:49.832921 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6ccd7-fec1-4988-a7d6-aec8cc1e2fa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:49.837098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6ccd7-fec1-4988-a7d6-aec8cc1e2fa6 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:49.994379 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1147/2305] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:49 2022] POST /identity/v3/users => generated 292 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:49.995846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd04462-0b70-4552-9468-ca3c41cf7494 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:50.020579 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd04462-0b70-4552-9468-ca3c41cf7494 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:50.063137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ce0cb-0d27-44fa-a929-dee23383404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:50.063807 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ce0cb-0d27-44fa-a929-dee23383404f admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:50.073936 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ce0cb-0d27-44fa-a929-dee23383404f admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:50.074224 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ce0cb-0d27-44fa-a929-dee23383404f admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:50.074952 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ce0cb-0d27-44fa-a929-dee23383404f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:50.076593 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ce0cb-0d27-44fa-a929-dee23383404f admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:50.136765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1159/2306] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:50.141086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6ccd7-fec1-4988-a7d6-aec8cc1e2fa6 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:50.160322 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6ccd7-fec1-4988-a7d6-aec8cc1e2fa6 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:50.184536 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c1381-c662-458b-810e-aaad1e50d907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:50.184536 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c1381-c662-458b-810e-aaad1e50d907 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:50.184536 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c1381-c662-458b-810e-aaad1e50d907 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:50.184536 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c1381-c662-458b-810e-aaad1e50d907 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:50.184917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c1381-c662-458b-810e-aaad1e50d907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:50.184917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c1381-c662-458b-810e-aaad1e50d907 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:50.220101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1148/2307] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:50.224075 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ce0cb-0d27-44fa-a929-dee23383404f admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:50.239252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ce0cb-0d27-44fa-a929-dee23383404f admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:50.245695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6e743-f02b-4c84-bfc4-07378fdbb632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:50.250479 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e743-f02b-4c84-bfc4-07378fdbb632 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:50.253949 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e743-f02b-4c84-bfc4-07378fdbb632 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:50.253949 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e743-f02b-4c84-bfc4-07378fdbb632 admin admin] PATH_INFO: `/v3/projects/730be96c0a2b498b875acc70673708f1/users/2290b7dfb679455a95bff4a468cd9fd3/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:50.282122 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6e743-f02b-4c84-bfc4-07378fdbb632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=730be96c0a2b498b875acc70673708f1, user_id=2290b7dfb679455a95bff4a468cd9fd3, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:50.286592 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6e743-f02b-4c84-bfc4-07378fdbb632 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:50.321934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:50.380868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1160/2308] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:50 2022] PUT /identity/v3/projects/730be96c0a2b498b875acc70673708f1/users/2290b7dfb679455a95bff4a468cd9fd3/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:50.391689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15aafcb-4e1c-46bf-965b-4c9c25f96ceb None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:50.391975 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15aafcb-4e1c-46bf-965b-4c9c25f96ceb None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:50.392248 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15aafcb-4e1c-46bf-965b-4c9c25f96ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:50.451828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-a15aafcb-4e1c-46bf-965b-4c9c25f96ceb None None] MFA Rules not processed for user `2290b7dfb679455a95bff4a468cd9fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:50.453570 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-a15aafcb-4e1c-46bf-965b-4c9c25f96ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:50.560246 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1149/2309] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:50.560362 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6e743-f02b-4c84-bfc4-07378fdbb632 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:50.720629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6e743-f02b-4c84-bfc4-07378fdbb632 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:50.726230 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15fc1b-f39c-46a3-b871-bd3dafb1ddde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:50.726949 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15fc1b-f39c-46a3-b871-bd3dafb1ddde admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:50.727300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15fc1b-f39c-46a3-b871-bd3dafb1ddde admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:50.727682 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15fc1b-f39c-46a3-b871-bd3dafb1ddde admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:50.728469 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15fc1b-f39c-46a3-b871-bd3dafb1ddde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:50.731142 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15fc1b-f39c-46a3-b871-bd3dafb1ddde admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:50.910900 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1161/2310] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:50 2022] POST /identity/v3/projects => generated 383 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:57:50.915449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15aafcb-4e1c-46bf-965b-4c9c25f96ceb None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:50.936367 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15aafcb-4e1c-46bf-965b-4c9c25f96ceb None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:51.055216 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e5387-fa22-44da-ba3a-9bc5569e022f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:51.055886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e5387-fa22-44da-ba3a-9bc5569e022f admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:51.056170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e5387-fa22-44da-ba3a-9bc5569e022f admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:51.056447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e5387-fa22-44da-ba3a-9bc5569e022f admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:51.057223 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e5387-fa22-44da-ba3a-9bc5569e022f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:51.059498 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e5387-fa22-44da-ba3a-9bc5569e022f admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:51.257155 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15fc1b-f39c-46a3-b871-bd3dafb1ddde admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:51.265219 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1150/2311] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:50 2022] POST /identity/v3/users => generated 298 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:57:51.269530 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15fc1b-f39c-46a3-b871-bd3dafb1ddde admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:51.302454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf3085-73a8-438a-b639-cb012f4103d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:51.303370 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf3085-73a8-438a-b639-cb012f4103d7 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:51.310490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf3085-73a8-438a-b639-cb012f4103d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:51.311680 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf3085-73a8-438a-b639-cb012f4103d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:51.312714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf3085-73a8-438a-b639-cb012f4103d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:51.320178 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf3085-73a8-438a-b639-cb012f4103d7 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:51.372526 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1162/2312] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:57:51.380621 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e5387-fa22-44da-ba3a-9bc5569e022f admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:51.394777 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e5387-fa22-44da-ba3a-9bc5569e022f admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:51.407401 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336a1ef-66d7-476e-9e1c-527a55dc7614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:51.408191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336a1ef-66d7-476e-9e1c-527a55dc7614 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:51.408475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336a1ef-66d7-476e-9e1c-527a55dc7614 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:51.409358 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336a1ef-66d7-476e-9e1c-527a55dc7614 admin admin] PATH_INFO: `/v3/projects/1161ae30c5d347b48294ea0ac69e581e/users/7a587a8cfd314c29ab1f620b31127d66/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:51.445028 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336a1ef-66d7-476e-9e1c-527a55dc7614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1161ae30c5d347b48294ea0ac69e581e, user_id=7a587a8cfd314c29ab1f620b31127d66, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:51.450849 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336a1ef-66d7-476e-9e1c-527a55dc7614 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:51.566623 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1151/2313] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:51 2022] PUT /identity/v3/projects/1161ae30c5d347b48294ea0ac69e581e/users/7a587a8cfd314c29ab1f620b31127d66/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:51.571789 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf3085-73a8-438a-b639-cb012f4103d7 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:51.593817 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf3085-73a8-438a-b639-cb012f4103d7 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:51.766406 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3a71d-c61f-4f89-911d-43d5aa756718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:51.767233 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3a71d-c61f-4f89-911d-43d5aa756718 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:51.767803 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3a71d-c61f-4f89-911d-43d5aa756718 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:51.768225 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3a71d-c61f-4f89-911d-43d5aa756718 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:51.769008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3a71d-c61f-4f89-911d-43d5aa756718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:51.771439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3a71d-c61f-4f89-911d-43d5aa756718 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:51.810662 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1163/2314] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:57:51.822490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336a1ef-66d7-476e-9e1c-527a55dc7614 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:51.842029 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336a1ef-66d7-476e-9e1c-527a55dc7614 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:51.845302 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d65ac9-7394-4417-83be-3ffbfcebece6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:51.846780 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d65ac9-7394-4417-83be-3ffbfcebece6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:51.847387 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d65ac9-7394-4417-83be-3ffbfcebece6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:51.848248 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d65ac9-7394-4417-83be-3ffbfcebece6 admin admin] PATH_INFO: `/v3/projects/1161ae30c5d347b48294ea0ac69e581e/users/7a587a8cfd314c29ab1f620b31127d66/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:51.850739 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d65ac9-7394-4417-83be-3ffbfcebece6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1161ae30c5d347b48294ea0ac69e581e, user_id=7a587a8cfd314c29ab1f620b31127d66, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:51.853895 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d65ac9-7394-4417-83be-3ffbfcebece6 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:51.870857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1152/2315] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:51 2022] PUT /identity/v3/projects/1161ae30c5d347b48294ea0ac69e581e/users/7a587a8cfd314c29ab1f620b31127d66/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:51.948626 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1681efa-21d5-4769-b27d-21e8f7e8e08a None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:51.948924 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1681efa-21d5-4769-b27d-21e8f7e8e08a None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:51.949209 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1681efa-21d5-4769-b27d-21e8f7e8e08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:51.984696 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-d1681efa-21d5-4769-b27d-21e8f7e8e08a None None] MFA Rules not processed for user `7a587a8cfd314c29ab1f620b31127d66`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:51.986063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-d1681efa-21d5-4769-b27d-21e8f7e8e08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:52.113187 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1164/2316] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:52.120837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d65ac9-7394-4417-83be-3ffbfcebece6 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:52.122663 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-56d65ac9-7394-4417-83be-3ffbfcebece6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:52.204567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d65ac9-7394-4417-83be-3ffbfcebece6 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:52.209263 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc24a4c-9b21-4c00-91e5-b0ddf07751c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:52.209967 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc24a4c-9b21-4c00-91e5-b0ddf07751c4 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:52.210336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc24a4c-9b21-4c00-91e5-b0ddf07751c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:52.210708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc24a4c-9b21-4c00-91e5-b0ddf07751c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:52.296426 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc24a4c-9b21-4c00-91e5-b0ddf07751c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:52.300040 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc24a4c-9b21-4c00-91e5-b0ddf07751c4 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:52.326279 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1153/2317] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:57:52.374795 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:53.876146 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:55.333061 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1681efa-21d5-4769-b27d-21e8f7e8e08a None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:55.365035 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1681efa-21d5-4769-b27d-21e8f7e8e08a None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:55.401993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fc12c-fc0c-47f7-b009-bf6ab2a4bbf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:55.403175 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fc12c-fc0c-47f7-b009-bf6ab2a4bbf8 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:55.403707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fc12c-fc0c-47f7-b009-bf6ab2a4bbf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:55.412072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fc12c-fc0c-47f7-b009-bf6ab2a4bbf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:55.500070 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203fc12c-fc0c-47f7-b009-bf6ab2a4bbf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:55.502016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203fc12c-fc0c-47f7-b009-bf6ab2a4bbf8 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:55.514425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1165/2318] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:57:56.031293 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:56.313948 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ea621-e9fa-4cd4-a4b0-f0d9022e465a None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:56.314478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ea621-e9fa-4cd4-a4b0-f0d9022e465a None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:56.314478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ea621-e9fa-4cd4-a4b0-f0d9022e465a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:56.359800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-006ea621-e9fa-4cd4-a4b0-f0d9022e465a None None] MFA Rules not processed for user `4c11ae4c2cff47698b701398ba17295a`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:57:56.361082 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-006ea621-e9fa-4cd4-a4b0-f0d9022e465a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:56.488509 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1154/2319] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:57:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:57:56.493191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fc12c-fc0c-47f7-b009-bf6ab2a4bbf8 service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:56.495198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-203fc12c-fc0c-47f7-b009-bf6ab2a4bbf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:57:56.623207 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fc12c-fc0c-47f7-b009-bf6ab2a4bbf8 service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:56.629376 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79489f6-f4e6-4eaa-a2db-1b51f02aecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:56.630940 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79489f6-f4e6-4eaa-a2db-1b51f02aecfb admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:56.631405 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79489f6-f4e6-4eaa-a2db-1b51f02aecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:56.631923 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79489f6-f4e6-4eaa-a2db-1b51f02aecfb admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:56.632739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79489f6-f4e6-4eaa-a2db-1b51f02aecfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:56.635444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79489f6-f4e6-4eaa-a2db-1b51f02aecfb admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:56.760464 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1166/2320] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:57:56 2022] POST /identity/v3/projects => generated 371 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:56.764393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ea621-e9fa-4cd4-a4b0-f0d9022e465a None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:56.776830 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ea621-e9fa-4cd4-a4b0-f0d9022e465a None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:56.897707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec5b68-14b5-4787-97c6-48c2a88db184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:56.897707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec5b68-14b5-4787-97c6-48c2a88db184 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:56.897707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec5b68-14b5-4787-97c6-48c2a88db184 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:56.897707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec5b68-14b5-4787-97c6-48c2a88db184 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:56.898833 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec5b68-14b5-4787-97c6-48c2a88db184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:56.902250 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec5b68-14b5-4787-97c6-48c2a88db184 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:57.823223 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1155/2321] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:57:56 2022] POST /identity/v3/users => generated 292 bytes in 1057 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:57:57.824511 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79489f6-f4e6-4eaa-a2db-1b51f02aecfb admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:57.844950 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79489f6-f4e6-4eaa-a2db-1b51f02aecfb admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:57.860696 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc5ab5-24b2-4056-81fc-eeb12a626768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:57.861360 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc5ab5-24b2-4056-81fc-eeb12a626768 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:57.861453 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc5ab5-24b2-4056-81fc-eeb12a626768 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:57.863026 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc5ab5-24b2-4056-81fc-eeb12a626768 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:57.863756 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc5ab5-24b2-4056-81fc-eeb12a626768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:57.865443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc5ab5-24b2-4056-81fc-eeb12a626768 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:57.889079 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1167/2322] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:57.892083 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec5b68-14b5-4787-97c6-48c2a88db184 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:57.911892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec5b68-14b5-4787-97c6-48c2a88db184 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:57.917559 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6ae3a-e23f-4a97-b81a-1382fc82d4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:57.918414 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6ae3a-e23f-4a97-b81a-1382fc82d4f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:57.918701 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6ae3a-e23f-4a97-b81a-1382fc82d4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:57.918980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6ae3a-e23f-4a97-b81a-1382fc82d4f0 admin admin] PATH_INFO: `/v3/projects/e765e05fe9164fe9bf87cfdbe42c3783/users/46ced918566e41cf84b0e767b933a66f/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:57.938354 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6ae3a-e23f-4a97-b81a-1382fc82d4f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e765e05fe9164fe9bf87cfdbe42c3783, user_id=46ced918566e41cf84b0e767b933a66f, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:57.941449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6ae3a-e23f-4a97-b81a-1382fc82d4f0 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:58.099598 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1156/2323] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:57 2022] PUT /identity/v3/projects/e765e05fe9164fe9bf87cfdbe42c3783/users/46ced918566e41cf84b0e767b933a66f/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:57:58.104493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc5ab5-24b2-4056-81fc-eeb12a626768 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:58.129934 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc5ab5-24b2-4056-81fc-eeb12a626768 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:58.217289 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b9ddf-6432-42e5-8435-3bf471c320eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:58.218284 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b9ddf-6432-42e5-8435-3bf471c320eb admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:58.218754 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b9ddf-6432-42e5-8435-3bf471c320eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:58.219213 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b9ddf-6432-42e5-8435-3bf471c320eb admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:58.220088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b9ddf-6432-42e5-8435-3bf471c320eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:58.222767 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b9ddf-6432-42e5-8435-3bf471c320eb admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:58.240384 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1168/2324] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:57:58.241481 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6ae3a-e23f-4a97-b81a-1382fc82d4f0 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:58.270584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6ae3a-e23f-4a97-b81a-1382fc82d4f0 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:58.278692 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d7a76-2f1f-4ab4-8775-41a50c041909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:58.279384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d7a76-2f1f-4ab4-8775-41a50c041909 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:58.281129 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d7a76-2f1f-4ab4-8775-41a50c041909 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:58.281420 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d7a76-2f1f-4ab4-8775-41a50c041909 admin admin] PATH_INFO: `/v3/projects/e765e05fe9164fe9bf87cfdbe42c3783/users/46ced918566e41cf84b0e767b933a66f/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:58.287588 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d7a76-2f1f-4ab4-8775-41a50c041909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e765e05fe9164fe9bf87cfdbe42c3783, user_id=46ced918566e41cf84b0e767b933a66f, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:58.310785 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d7a76-2f1f-4ab4-8775-41a50c041909 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:58.360750 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1157/2325] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:57:58 2022] PUT /identity/v3/projects/e765e05fe9164fe9bf87cfdbe42c3783/users/46ced918566e41cf84b0e767b933a66f/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:57:58.634525 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:58.871671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b9ddf-6432-42e5-8435-3bf471c320eb admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:57:59.100010 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b9ddf-6432-42e5-8435-3bf471c320eb admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:57:59.225759 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d044e43-c963-4d92-a5d7-9c2923af7795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:57:59.226529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d044e43-c963-4d92-a5d7-9c2923af7795 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:57:59.228203 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d044e43-c963-4d92-a5d7-9c2923af7795 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:57:59.229067 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d044e43-c963-4d92-a5d7-9c2923af7795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:57:59.387513 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d044e43-c963-4d92-a5d7-9c2923af7795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:57:59.389487 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d044e43-c963-4d92-a5d7-9c2923af7795 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:57:59.444090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1169/2326] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:57:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:58:00.087211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:01.439094 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:04.303879 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:05.491611 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d7a76-2f1f-4ab4-8775-41a50c041909 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:05.493310 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-2f9d7a76-2f1f-4ab4-8775-41a50c041909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:05.521730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:05.614490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d7a76-2f1f-4ab4-8775-41a50c041909 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:05.621092 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3e636-b871-4a5b-89a1-6154c8936149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:05.622105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3e636-b871-4a5b-89a1-6154c8936149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:05.622581 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3e636-b871-4a5b-89a1-6154c8936149 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:05.623010 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3e636-b871-4a5b-89a1-6154c8936149 admin admin] PATH_INFO: `/v3/users/abf7f69bfc57411e86f410395e16d003` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:05.625376 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3e636-b871-4a5b-89a1-6154c8936149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abf7f69bfc57411e86f410395e16d003)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:05.627770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3e636-b871-4a5b-89a1-6154c8936149 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:05.874415 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-34f3e636-b871-4a5b-89a1-6154c8936149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abf7f69bfc57411e86f410395e16d003'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:05.931176 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d044e43-c963-4d92-a5d7-9c2923af7795 service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:05.946418 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d044e43-c963-4d92-a5d7-9c2923af7795 service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:05.953163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ab603-1a81-49a6-b7b8-31cea9655da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:05.954297 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ab603-1a81-49a6-b7b8-31cea9655da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:05.954582 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ab603-1a81-49a6-b7b8-31cea9655da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:05.954855 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ab603-1a81-49a6-b7b8-31cea9655da4 admin admin] PATH_INFO: `/v3/users/193c786d73fc4f819498b76d3b6bb87a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:05.956327 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ab603-1a81-49a6-b7b8-31cea9655da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=193c786d73fc4f819498b76d3b6bb87a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:05.958508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ab603-1a81-49a6-b7b8-31cea9655da4 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:06.036660 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-34f3e636-b871-4a5b-89a1-6154c8936149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abf7f69bfc57411e86f410395e16d003'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:06.037519 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-34f3e636-b871-4a5b-89a1-6154c8936149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abf7f69bfc57411e86f410395e16d003'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:06.047268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-34f3e636-b871-4a5b-89a1-6154c8936149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abf7f69bfc57411e86f410395e16d003'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:06.063870 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-34f3e636-b871-4a5b-89a1-6154c8936149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abf7f69bfc57411e86f410395e16d003'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:06.071456 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1158/2327] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:58:05 2022] DELETE /identity/v3/users/abf7f69bfc57411e86f410395e16d003 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:58:06.076010 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0165c-1689-4beb-b957-2092f6fe651e None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:06.076473 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0165c-1689-4beb-b957-2092f6fe651e None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:06.076652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0165c-1689-4beb-b957-2092f6fe651e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:06.096038 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-a3d0165c-1689-4beb-b957-2092f6fe651e None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:06.097264 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-a3d0165c-1689-4beb-b957-2092f6fe651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:06.161994 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1159/2328] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:58:06.171692 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0165c-1689-4beb-b957-2092f6fe651e None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:06.173367 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-a3d0165c-1689-4beb-b957-2092f6fe651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:06.198317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d39ab603-1a81-49a6-b7b8-31cea9655da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '193c786d73fc4f819498b76d3b6bb87a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:06.261163 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0165c-1689-4beb-b957-2092f6fe651e None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:06.265817 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5504b-eff4-4032-8574-02403253a78c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:06.266514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5504b-eff4-4032-8574-02403253a78c service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:06.266869 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5504b-eff4-4032-8574-02403253a78c service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:06.267211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5504b-eff4-4032-8574-02403253a78c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:06.277916 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d39ab603-1a81-49a6-b7b8-31cea9655da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '193c786d73fc4f819498b76d3b6bb87a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:06.278200 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5504b-eff4-4032-8574-02403253a78c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:06.279289 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d39ab603-1a81-49a6-b7b8-31cea9655da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '193c786d73fc4f819498b76d3b6bb87a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:06.280104 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5504b-eff4-4032-8574-02403253a78c service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:06.292497 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1160/2329] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:58:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:58:06.297306 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d39ab603-1a81-49a6-b7b8-31cea9655da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '193c786d73fc4f819498b76d3b6bb87a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:06.308270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d39ab603-1a81-49a6-b7b8-31cea9655da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '193c786d73fc4f819498b76d3b6bb87a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:06.314732 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1170/2330] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:58:05 2022] DELETE /identity/v3/users/193c786d73fc4f819498b76d3b6bb87a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:58:06.320518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c32a2-6d07-4095-9dec-74ea8184afb0 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:06.320761 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c32a2-6d07-4095-9dec-74ea8184afb0 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:06.321040 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c32a2-6d07-4095-9dec-74ea8184afb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:06.351893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-b15c32a2-6d07-4095-9dec-74ea8184afb0 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:06.351893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b15c32a2-6d07-4095-9dec-74ea8184afb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:06.429387 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1161/2331] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:58:06.451916 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ab603-1a81-49a6-b7b8-31cea9655da4 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:06.453957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-d39ab603-1a81-49a6-b7b8-31cea9655da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:06.569773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ab603-1a81-49a6-b7b8-31cea9655da4 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:06.575709 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74a723-f20a-4746-a15d-516617c76f2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:06.578045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74a723-f20a-4746-a15d-516617c76f2f service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:06.578045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74a723-f20a-4746-a15d-516617c76f2f service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:06.578811 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74a723-f20a-4746-a15d-516617c76f2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:06.592830 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74a723-f20a-4746-a15d-516617c76f2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:06.594328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74a723-f20a-4746-a15d-516617c76f2f service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:06.608944 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1171/2332] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:58:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:58:07.095727 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c32a2-6d07-4095-9dec-74ea8184afb0 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:07.108172 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b15c32a2-6d07-4095-9dec-74ea8184afb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:07.172438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c32a2-6d07-4095-9dec-74ea8184afb0 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:07.178624 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5ea66-7b67-4a45-ad8e-71359108634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:07.179639 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5ea66-7b67-4a45-ad8e-71359108634b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:07.180073 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5ea66-7b67-4a45-ad8e-71359108634b admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:07.180451 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5ea66-7b67-4a45-ad8e-71359108634b admin admin] PATH_INFO: `/v3/projects/c04d88fdb73446878771828aa2b4b16d` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:07.182056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5ea66-7b67-4a45-ad8e-71359108634b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c04d88fdb73446878771828aa2b4b16d)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:07.189305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5ea66-7b67-4a45-ad8e-71359108634b admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:07.501332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74a723-f20a-4746-a15d-516617c76f2f service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:07.502645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-bb74a723-f20a-4746-a15d-516617c76f2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:07.524714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74a723-f20a-4746-a15d-516617c76f2f service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:07.550405 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-61e5ea66-7b67-4a45-ad8e-71359108634b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c04d88fdb73446878771828aa2b4b16d', 'request_id': 'req-61e5ea66-7b67-4a45-ad8e-71359108634b'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:07.635728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987643a5-699f-4a5a-a809-5730328740d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:07.636200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987643a5-699f-4a5a-a809-5730328740d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:07.637042 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987643a5-699f-4a5a-a809-5730328740d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:07.637328 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987643a5-699f-4a5a-a809-5730328740d2 admin admin] PATH_INFO: `/v3/projects/9e53fb127a0146fb8c1d9727199465d9` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:07.638658 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987643a5-699f-4a5a-a809-5730328740d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e53fb127a0146fb8c1d9727199465d9)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:07.640833 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987643a5-699f-4a5a-a809-5730328740d2 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:07.713086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-61e5ea66-7b67-4a45-ad8e-71359108634b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c04d88fdb73446878771828aa2b4b16d', 'request_id': 'req-61e5ea66-7b67-4a45-ad8e-71359108634b'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:07.727152 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-61e5ea66-7b67-4a45-ad8e-71359108634b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c04d88fdb73446878771828aa2b4b16d', 'request_id': 'req-61e5ea66-7b67-4a45-ad8e-71359108634b'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:07.748056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-61e5ea66-7b67-4a45-ad8e-71359108634b admin admin] The token cache is being invalidate because project c04d88fdb73446878771828aa2b4b16d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:58:07.750492 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-61e5ea66-7b67-4a45-ad8e-71359108634b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:07.750799 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-61e5ea66-7b67-4a45-ad8e-71359108634b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:07.756708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1162/2333] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:58:07 2022] DELETE /identity/v3/projects/c04d88fdb73446878771828aa2b4b16d => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:58:07.762915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28519ad7-4f00-458a-8c68-5c5f9f539e8c None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:07.763846 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28519ad7-4f00-458a-8c68-5c5f9f539e8c None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:07.764223 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28519ad7-4f00-458a-8c68-5c5f9f539e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:07.809677 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-987643a5-699f-4a5a-a809-5730328740d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e53fb127a0146fb8c1d9727199465d9', 'request_id': 'req-987643a5-699f-4a5a-a809-5730328740d2'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:07.822010 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-28519ad7-4f00-458a-8c68-5c5f9f539e8c None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:07.823426 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-28519ad7-4f00-458a-8c68-5c5f9f539e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:07.892152 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1163/2334] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:58:07.901249 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a0e9e-01ac-49c7-a5fb-853aff338062 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:07.901858 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a0e9e-01ac-49c7-a5fb-853aff338062 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:07.902140 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a0e9e-01ac-49c7-a5fb-853aff338062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:07.914908 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-987643a5-699f-4a5a-a809-5730328740d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e53fb127a0146fb8c1d9727199465d9', 'request_id': 'req-987643a5-699f-4a5a-a809-5730328740d2'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:07.921831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-987643a5-699f-4a5a-a809-5730328740d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e53fb127a0146fb8c1d9727199465d9', 'request_id': 'req-987643a5-699f-4a5a-a809-5730328740d2'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:07.926970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-ba2a0e9e-01ac-49c7-a5fb-853aff338062 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:07.928248 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ba2a0e9e-01ac-49c7-a5fb-853aff338062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:07.936606 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-987643a5-699f-4a5a-a809-5730328740d2 admin admin] The token cache is being invalidate because project 9e53fb127a0146fb8c1d9727199465d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:58:07.937008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-987643a5-699f-4a5a-a809-5730328740d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:07.938065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-987643a5-699f-4a5a-a809-5730328740d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:07.938198 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1164/2335] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:58:07.939362 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1172/2336] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:58:07 2022] DELETE /identity/v3/projects/9e53fb127a0146fb8c1d9727199465d9 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:58:07.942414 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a0e9e-01ac-49c7-a5fb-853aff338062 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:07.943489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987643a5-699f-4a5a-a809-5730328740d2 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:07.945069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-987643a5-699f-4a5a-a809-5730328740d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:07.959161 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987643a5-699f-4a5a-a809-5730328740d2 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:07.965006 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dfafe-c316-48d0-b901-7e196a51b48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:07.965657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dfafe-c316-48d0-b901-7e196a51b48f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:07.965855 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a0e9e-01ac-49c7-a5fb-853aff338062 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:07.965964 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dfafe-c316-48d0-b901-7e196a51b48f admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:07.966196 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dfafe-c316-48d0-b901-7e196a51b48f admin admin] PATH_INFO: `/v3/users/2290b7dfb679455a95bff4a468cd9fd3` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:07.967354 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268dfafe-c316-48d0-b901-7e196a51b48f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2290b7dfb679455a95bff4a468cd9fd3)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:07.969471 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268dfafe-c316-48d0-b901-7e196a51b48f admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:07.976155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e27e5-9c3e-40f0-ad86-85fe07a39d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:07.977150 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e27e5-9c3e-40f0-ad86-85fe07a39d93 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:07.977636 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e27e5-9c3e-40f0-ad86-85fe07a39d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:07.978154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e27e5-9c3e-40f0-ad86-85fe07a39d93 admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:07.979739 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e27e5-9c3e-40f0-ad86-85fe07a39d93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:58:07.980411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e27e5-9c3e-40f0-ad86-85fe07a39d93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:07.982640 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e27e5-9c3e-40f0-ad86-85fe07a39d93 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:08.001347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1165/2337] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 19:58:08.005469 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e27e5-9c3e-40f0-ad86-85fe07a39d93 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:08.007293 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-968e27e5-9c3e-40f0-ad86-85fe07a39d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:08.020660 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e27e5-9c3e-40f0-ad86-85fe07a39d93 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:08.025964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c31306-e4e5-4b04-aaee-e2465b22bdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:08.026581 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c31306-e4e5-4b04-aaee-e2465b22bdc1 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:08.026859 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c31306-e4e5-4b04-aaee-e2465b22bdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:08.027129 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c31306-e4e5-4b04-aaee-e2465b22bdc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:08.027813 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c31306-e4e5-4b04-aaee-e2465b22bdc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:08.029743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c31306-e4e5-4b04-aaee-e2465b22bdc1 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:08.161270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1166/2338] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:58:08 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:58:08.163299 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1784a6-221a-4b1e-a82c-18deb26fe875 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:08.163692 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1784a6-221a-4b1e-a82c-18deb26fe875 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:08.164018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1784a6-221a-4b1e-a82c-18deb26fe875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:08.195056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-dd1784a6-221a-4b1e-a82c-18deb26fe875 None None] MFA Rules not processed for user `46ced918566e41cf84b0e767b933a66f`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:08.197506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-dd1784a6-221a-4b1e-a82c-18deb26fe875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:08.213773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-268dfafe-c316-48d0-b901-7e196a51b48f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2290b7dfb679455a95bff4a468cd9fd3'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:08.239668 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:08.300895 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1167/2339] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:58:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:58:08.300895 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1784a6-221a-4b1e-a82c-18deb26fe875 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:08.350128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-268dfafe-c316-48d0-b901-7e196a51b48f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2290b7dfb679455a95bff4a468cd9fd3'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:08.350128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-268dfafe-c316-48d0-b901-7e196a51b48f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2290b7dfb679455a95bff4a468cd9fd3'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:08.368771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-268dfafe-c316-48d0-b901-7e196a51b48f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2290b7dfb679455a95bff4a468cd9fd3'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:08.378804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-268dfafe-c316-48d0-b901-7e196a51b48f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2290b7dfb679455a95bff4a468cd9fd3'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:08.390148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1784a6-221a-4b1e-a82c-18deb26fe875 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:08.391708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1173/2340] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:58:07 2022] DELETE /identity/v3/users/2290b7dfb679455a95bff4a468cd9fd3 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:58:08.396242 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dfafe-c316-48d0-b901-7e196a51b48f admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:08.396819 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908709f-72c6-4b1b-9ed9-963ac7c60ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:08.397455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908709f-72c6-4b1b-9ed9-963ac7c60ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:08.397743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908709f-72c6-4b1b-9ed9-963ac7c60ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:08.398021 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908709f-72c6-4b1b-9ed9-963ac7c60ad1 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:08.398121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-268dfafe-c316-48d0-b901-7e196a51b48f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:08.398671 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908709f-72c6-4b1b-9ed9-963ac7c60ad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:08.400656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908709f-72c6-4b1b-9ed9-963ac7c60ad1 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:08.543016 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dfafe-c316-48d0-b901-7e196a51b48f admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:08.557203 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b64553-1264-4361-bed3-a47b1f5aefd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:08.557845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b64553-1264-4361-bed3-a47b1f5aefd5 service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:08.558125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b64553-1264-4361-bed3-a47b1f5aefd5 service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:08.558397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b64553-1264-4361-bed3-a47b1f5aefd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:08.560397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-b6b64553-1264-4361-bed3-a47b1f5aefd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:08.613994 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1168/2341] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:58:08 2022] POST /identity/v3/users => generated 292 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:58:08.618883 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908709f-72c6-4b1b-9ed9-963ac7c60ad1 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:08.621410 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-7908709f-72c6-4b1b-9ed9-963ac7c60ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:08.642545 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908709f-72c6-4b1b-9ed9-963ac7c60ad1 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:08.653072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b64553-1264-4361-bed3-a47b1f5aefd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:08.655385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b64553-1264-4361-bed3-a47b1f5aefd5 service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:08.667614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1174/2342] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:58:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:58:08.761065 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa68a9-737e-44e8-8720-20b0a3d09e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:08.761801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa68a9-737e-44e8-8720-20b0a3d09e98 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:08.762230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa68a9-737e-44e8-8720-20b0a3d09e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:08.762600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa68a9-737e-44e8-8720-20b0a3d09e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:08.763662 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa68a9-737e-44e8-8720-20b0a3d09e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:08.765578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa68a9-737e-44e8-8720-20b0a3d09e98 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:08.777657 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1169/2343] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:58:08.781438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b64553-1264-4361-bed3-a47b1f5aefd5 service nova] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:08.793096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b64553-1264-4361-bed3-a47b1f5aefd5 service nova] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:08.798201 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddf8c4-9710-4bfd-b05d-08d0ad9aadef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:08.799356 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddf8c4-9710-4bfd-b05d-08d0ad9aadef admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:08.799884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddf8c4-9710-4bfd-b05d-08d0ad9aadef admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:08.800387 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddf8c4-9710-4bfd-b05d-08d0ad9aadef admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:08.801411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bddf8c4-9710-4bfd-b05d-08d0ad9aadef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:08.803251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bddf8c4-9710-4bfd-b05d-08d0ad9aadef admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:08.827387 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1175/2344] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:58:08.842370 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa68a9-737e-44e8-8720-20b0a3d09e98 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:08.859611 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa68a9-737e-44e8-8720-20b0a3d09e98 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:08.865453 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46883b9-0191-4142-805b-32473399450d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:08.866136 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46883b9-0191-4142-805b-32473399450d admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:08.866418 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46883b9-0191-4142-805b-32473399450d admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:08.866695 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46883b9-0191-4142-805b-32473399450d admin admin] PATH_INFO: `/v3/projects/63d0c36f415149259d784c1112542caf/users/32b57ae5ce3b4104bb21a9c1f119db81/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:08.897243 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46883b9-0191-4142-805b-32473399450d admin admin] RBAC: Authorizing `identity:create_grant(project_id=63d0c36f415149259d784c1112542caf, user_id=32b57ae5ce3b4104bb21a9c1f119db81, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:08.900299 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46883b9-0191-4142-805b-32473399450d admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:08.981458 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:09.029364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddf8c4-9710-4bfd-b05d-08d0ad9aadef admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:09.031604 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-6bddf8c4-9710-4bfd-b05d-08d0ad9aadef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:09.037871 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1170/2345] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:58:08 2022] PUT /identity/v3/projects/63d0c36f415149259d784c1112542caf/users/32b57ae5ce3b4104bb21a9c1f119db81/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:58:09.042981 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76757f3e-de1d-454f-8a0e-1cf88486f1e9 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:09.043265 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76757f3e-de1d-454f-8a0e-1cf88486f1e9 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:09.043535 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76757f3e-de1d-454f-8a0e-1cf88486f1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:09.068315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddf8c4-9710-4bfd-b05d-08d0ad9aadef admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:09.096418 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-76757f3e-de1d-454f-8a0e-1cf88486f1e9 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:09.098059 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-76757f3e-de1d-454f-8a0e-1cf88486f1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:09.227019 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b1cf8-25af-4411-abe2-cce7f8f9ad30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:09.233602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b1cf8-25af-4411-abe2-cce7f8f9ad30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:09.233846 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1171/2346] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:58:09.234352 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b1cf8-25af-4411-abe2-cce7f8f9ad30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:09.234352 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b1cf8-25af-4411-abe2-cce7f8f9ad30 admin admin] PATH_INFO: `/v3/projects/730be96c0a2b498b875acc70673708f1` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:09.234702 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b1cf8-25af-4411-abe2-cce7f8f9ad30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=730be96c0a2b498b875acc70673708f1)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:09.238715 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b1cf8-25af-4411-abe2-cce7f8f9ad30 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:09.241178 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76757f3e-de1d-454f-8a0e-1cf88486f1e9 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:09.243314 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-76757f3e-de1d-454f-8a0e-1cf88486f1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:09.338384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76757f3e-de1d-454f-8a0e-1cf88486f1e9 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:09.342704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae82cc-de2e-4ebe-bf03-b4829b275b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:09.343327 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae82cc-de2e-4ebe-bf03-b4829b275b50 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:09.343640 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae82cc-de2e-4ebe-bf03-b4829b275b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:09.343920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae82cc-de2e-4ebe-bf03-b4829b275b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:09.355165 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae82cc-de2e-4ebe-bf03-b4829b275b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:09.356672 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae82cc-de2e-4ebe-bf03-b4829b275b50 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:09.368042 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1172/2347] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:58:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:58:09.571868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2a2b1cf8-25af-4411-abe2-cce7f8f9ad30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '730be96c0a2b498b875acc70673708f1', 'request_id': 'req-2a2b1cf8-25af-4411-abe2-cce7f8f9ad30'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:09.726696 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2a2b1cf8-25af-4411-abe2-cce7f8f9ad30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '730be96c0a2b498b875acc70673708f1', 'request_id': 'req-2a2b1cf8-25af-4411-abe2-cce7f8f9ad30'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:09.735605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2a2b1cf8-25af-4411-abe2-cce7f8f9ad30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '730be96c0a2b498b875acc70673708f1', 'request_id': 'req-2a2b1cf8-25af-4411-abe2-cce7f8f9ad30'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:09.748886 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2a2b1cf8-25af-4411-abe2-cce7f8f9ad30 admin admin] The token cache is being invalidate because project 730be96c0a2b498b875acc70673708f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:58:09.749240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2a2b1cf8-25af-4411-abe2-cce7f8f9ad30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:09.751361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2a2b1cf8-25af-4411-abe2-cce7f8f9ad30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:09.760414 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1176/2348] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:58:09 2022] DELETE /identity/v3/projects/730be96c0a2b498b875acc70673708f1 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:58:09.761615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae82cc-de2e-4ebe-bf03-b4829b275b50 service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:09.762954 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:09.775677 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae82cc-de2e-4ebe-bf03-b4829b275b50 service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:09.878667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2977449-2913-47db-ad20-61c4e04cf0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:09.880660 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2977449-2913-47db-ad20-61c4e04cf0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:09.881029 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2977449-2913-47db-ad20-61c4e04cf0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:09.882541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2977449-2913-47db-ad20-61c4e04cf0f5 admin admin] PATH_INFO: `/v3/users/7a587a8cfd314c29ab1f620b31127d66` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:09.885642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2977449-2913-47db-ad20-61c4e04cf0f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a587a8cfd314c29ab1f620b31127d66)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:09.889115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2977449-2913-47db-ad20-61c4e04cf0f5 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:10.183238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c2977449-2913-47db-ad20-61c4e04cf0f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a587a8cfd314c29ab1f620b31127d66'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:10.271795 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c2977449-2913-47db-ad20-61c4e04cf0f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a587a8cfd314c29ab1f620b31127d66'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:10.273008 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c2977449-2913-47db-ad20-61c4e04cf0f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a587a8cfd314c29ab1f620b31127d66'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:10.281029 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c2977449-2913-47db-ad20-61c4e04cf0f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a587a8cfd314c29ab1f620b31127d66'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:10.313587 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c2977449-2913-47db-ad20-61c4e04cf0f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a587a8cfd314c29ab1f620b31127d66'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:10.329397 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1173/2349] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 19:58:09 2022] DELETE /identity/v3/users/7a587a8cfd314c29ab1f620b31127d66 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:58:11.159564 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b1cf8-25af-4411-abe2-cce7f8f9ad30 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:11.161056 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2a2b1cf8-25af-4411-abe2-cce7f8f9ad30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:11.184469 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b1cf8-25af-4411-abe2-cce7f8f9ad30 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:11.295348 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63584681-86e9-4407-8232-9c97af2539ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:11.296089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63584681-86e9-4407-8232-9c97af2539ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:11.296663 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63584681-86e9-4407-8232-9c97af2539ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:11.297207 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63584681-86e9-4407-8232-9c97af2539ec admin admin] PATH_INFO: `/v3/projects/1161ae30c5d347b48294ea0ac69e581e` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:11.298696 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63584681-86e9-4407-8232-9c97af2539ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=1161ae30c5d347b48294ea0ac69e581e)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:11.302101 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63584681-86e9-4407-8232-9c97af2539ec admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:11.561139 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e6e2a-2bc6-4528-a4ae-bdf85ec8c481 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:11.563154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e6e2a-2bc6-4528-a4ae-bdf85ec8c481 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:11.564270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e6e2a-2bc6-4528-a4ae-bdf85ec8c481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:11.600424 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-63584681-86e9-4407-8232-9c97af2539ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1161ae30c5d347b48294ea0ac69e581e', 'request_id': 'req-63584681-86e9-4407-8232-9c97af2539ec'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:11.649525 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-592e6e2a-2bc6-4528-a4ae-bdf85ec8c481 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:11.650763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-592e6e2a-2bc6-4528-a4ae-bdf85ec8c481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:11.723410 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1174/2350] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Sep 14 19:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:58:11.742541 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e6e2a-2bc6-4528-a4ae-bdf85ec8c481 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:11.744011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-592e6e2a-2bc6-4528-a4ae-bdf85ec8c481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:11.777046 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-63584681-86e9-4407-8232-9c97af2539ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1161ae30c5d347b48294ea0ac69e581e', 'request_id': 'req-63584681-86e9-4407-8232-9c97af2539ec'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:11.792995 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-63584681-86e9-4407-8232-9c97af2539ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1161ae30c5d347b48294ea0ac69e581e', 'request_id': 'req-63584681-86e9-4407-8232-9c97af2539ec'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:11.824941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-63584681-86e9-4407-8232-9c97af2539ec admin admin] The token cache is being invalidate because project 1161ae30c5d347b48294ea0ac69e581e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 19:58:11.825242 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-63584681-86e9-4407-8232-9c97af2539ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:11.831156 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-63584681-86e9-4407-8232-9c97af2539ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 19:58:11.837057 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1177/2351] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 19:58:11 2022] DELETE /identity/v3/projects/1161ae30c5d347b48294ea0ac69e581e => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:58:11.838927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8fbe8-a795-4318-bc60-cb8f65109421 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:11.839394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8fbe8-a795-4318-bc60-cb8f65109421 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:11.839856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8fbe8-a795-4318-bc60-cb8f65109421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:11.868860 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e6e2a-2bc6-4528-a4ae-bdf85ec8c481 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:11.880686 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-1db8fbe8-a795-4318-bc60-cb8f65109421 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:11.882638 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-1db8fbe8-a795-4318-bc60-cb8f65109421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:11.887501 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce45cb-cebd-42f3-a243-83316f5a6940 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:11.888481 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce45cb-cebd-42f3-a243-83316f5a6940 service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:11.888766 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce45cb-cebd-42f3-a243-83316f5a6940 service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:11.889774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce45cb-cebd-42f3-a243-83316f5a6940 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:11.893751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-36ce45cb-cebd-42f3-a243-83316f5a6940 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:11.900780 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1178/2352] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:58:11.913395 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b6280-a220-4498-a95b-b380d76c8704 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:11.913395 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b6280-a220-4498-a95b-b380d76c8704 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:11.913395 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b6280-a220-4498-a95b-b380d76c8704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:11.929727 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce45cb-cebd-42f3-a243-83316f5a6940 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:11.944305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce45cb-cebd-42f3-a243-83316f5a6940 service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:11.970505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1175/2353] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:58:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:58:11.973847 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-8c8b6280-a220-4498-a95b-b380d76c8704 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:11.975367 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-8c8b6280-a220-4498-a95b-b380d76c8704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:11.990686 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce45cb-cebd-42f3-a243-83316f5a6940 service nova] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:11.996868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1179/2354] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:58:12.000796 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce45cb-cebd-42f3-a243-83316f5a6940 service nova] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:12.007885 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b513b-bb97-40f7-8223-fe7cfee41267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:12.008767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b513b-bb97-40f7-8223-fe7cfee41267 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:12.009242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b513b-bb97-40f7-8223-fe7cfee41267 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:12.009888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b513b-bb97-40f7-8223-fe7cfee41267 admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:12.010724 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b513b-bb97-40f7-8223-fe7cfee41267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 19:58:12.011572 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b513b-bb97-40f7-8223-fe7cfee41267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:12.013443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b513b-bb97-40f7-8223-fe7cfee41267 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:12.032106 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1176/2355] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 19:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 19:58:12.035340 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b6280-a220-4498-a95b-b380d76c8704 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:12.047802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b6280-a220-4498-a95b-b380d76c8704 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:12.054741 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b73723-2f36-450e-a9a6-c0aa60e31118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:12.056039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b73723-2f36-450e-a9a6-c0aa60e31118 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:12.056547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b73723-2f36-450e-a9a6-c0aa60e31118 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:12.057247 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b73723-2f36-450e-a9a6-c0aa60e31118 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:12.058173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b73723-2f36-450e-a9a6-c0aa60e31118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:12.062775 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b73723-2f36-450e-a9a6-c0aa60e31118 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:12.183589 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1180/2356] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:58:12 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:58:12.187890 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b513b-bb97-40f7-8223-fe7cfee41267 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:12.199401 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b513b-bb97-40f7-8223-fe7cfee41267 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:12.273631 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a4655-2339-47d5-b2b2-2fb04d055a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:12.274424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a4655-2339-47d5-b2b2-2fb04d055a45 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:12.274812 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a4655-2339-47d5-b2b2-2fb04d055a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:12.275188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a4655-2339-47d5-b2b2-2fb04d055a45 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:12.276007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a4655-2339-47d5-b2b2-2fb04d055a45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:12.278220 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a4655-2339-47d5-b2b2-2fb04d055a45 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:12.479580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1177/2357] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:58:12 2022] POST /identity/v3/users => generated 287 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 19:58:12.480031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b73723-2f36-450e-a9a6-c0aa60e31118 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:12.491281 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b73723-2f36-450e-a9a6-c0aa60e31118 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:12.497093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4ef98-cb2f-4494-bd02-d417f597fb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:12.498326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4ef98-cb2f-4494-bd02-d417f597fb15 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:12.498813 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4ef98-cb2f-4494-bd02-d417f597fb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:12.499259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4ef98-cb2f-4494-bd02-d417f597fb15 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:12.502934 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4ef98-cb2f-4494-bd02-d417f597fb15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:12.502934 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4ef98-cb2f-4494-bd02-d417f597fb15 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:12.520440 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1181/2358] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:58:12.524326 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a4655-2339-47d5-b2b2-2fb04d055a45 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:12.537914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a4655-2339-47d5-b2b2-2fb04d055a45 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:12.543160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f54c01-0e98-406f-ba93-6c3ae50df010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:12.543946 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f54c01-0e98-406f-ba93-6c3ae50df010 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:12.544292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f54c01-0e98-406f-ba93-6c3ae50df010 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:12.544699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f54c01-0e98-406f-ba93-6c3ae50df010 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:12.545675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f54c01-0e98-406f-ba93-6c3ae50df010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:12.547150 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f54c01-0e98-406f-ba93-6c3ae50df010 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:12.558938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1178/2359] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 19:58:12.563046 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4ef98-cb2f-4494-bd02-d417f597fb15 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:12.574917 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4ef98-cb2f-4494-bd02-d417f597fb15 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:12.580191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438990e0-3f9d-4f8e-b9be-813e446209ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:12.581569 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438990e0-3f9d-4f8e-b9be-813e446209ac admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:12.581975 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438990e0-3f9d-4f8e-b9be-813e446209ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:12.582326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438990e0-3f9d-4f8e-b9be-813e446209ac admin admin] PATH_INFO: `/v3/projects/dd0e150814b54ca092c30aec2d34490f/users/1980fb7bfef74f49b50cfc07d7eacff8/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:12.598937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438990e0-3f9d-4f8e-b9be-813e446209ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd0e150814b54ca092c30aec2d34490f, user_id=1980fb7bfef74f49b50cfc07d7eacff8, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:12.602223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438990e0-3f9d-4f8e-b9be-813e446209ac admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:12.705957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1182/2360] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:58:12 2022] PUT /identity/v3/projects/dd0e150814b54ca092c30aec2d34490f/users/1980fb7bfef74f49b50cfc07d7eacff8/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:58:12.711982 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f4b24-2509-4698-be54-ef54360a193d None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:12.712498 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f4b24-2509-4698-be54-ef54360a193d None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:12.712604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f4b24-2509-4698-be54-ef54360a193d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:12.731698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-a75f4b24-2509-4698-be54-ef54360a193d None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:12.732907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-a75f4b24-2509-4698-be54-ef54360a193d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:12.832178 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1179/2361] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:58:12.841106 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438990e0-3f9d-4f8e-b9be-813e446209ac admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:12.842913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-438990e0-3f9d-4f8e-b9be-813e446209ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:12.914374 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438990e0-3f9d-4f8e-b9be-813e446209ac admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:12.919485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd8ac1-3c63-4044-a01b-29d0b53c6f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:12.920164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd8ac1-3c63-4044-a01b-29d0b53c6f57 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:12.920453 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd8ac1-3c63-4044-a01b-29d0b53c6f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:12.920800 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd8ac1-3c63-4044-a01b-29d0b53c6f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:12.931598 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd8ac1-3c63-4044-a01b-29d0b53c6f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:12.933300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd8ac1-3c63-4044-a01b-29d0b53c6f57 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:12.950101 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1183/2362] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:58:13.846377 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf5037-0c4e-4cd2-a38c-f04051a7cfec None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:13.847245 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf5037-0c4e-4cd2-a38c-f04051a7cfec None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:13.847523 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf5037-0c4e-4cd2-a38c-f04051a7cfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:13.880698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-02bf5037-0c4e-4cd2-a38c-f04051a7cfec None None] MFA Rules not processed for user `4c11ae4c2cff47698b701398ba17295a`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:13.882091 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-02bf5037-0c4e-4cd2-a38c-f04051a7cfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:13.961187 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1180/2363] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:58:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:58:14.535306 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:15.120837 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4a93b-50ff-4ec9-ae7b-d975d4eda2d3 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:15.121330 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4a93b-50ff-4ec9-ae7b-d975d4eda2d3 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:15.121423 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4a93b-50ff-4ec9-ae7b-d975d4eda2d3 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:15.123361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1184/2364] 10.222.0.15 () {54 vars in 921 bytes} [Wed Sep 14 19:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:58:15.129699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b9591-1b61-4fac-88e8-0a24e67ab668 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:15.134637 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b9591-1b61-4fac-88e8-0a24e67ab668 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:15.135120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b9591-1b61-4fac-88e8-0a24e67ab668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:15.135843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883640ea-9692-4ee4-bf8f-fb9715cfa7da None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:15.135843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883640ea-9692-4ee4-bf8f-fb9715cfa7da None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:15.136573 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883640ea-9692-4ee4-bf8f-fb9715cfa7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:15.177423 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-883640ea-9692-4ee4-bf8f-fb9715cfa7da None None] MFA Rules not processed for user `421f6cc846b342918a177d2794eb3db8`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:15.185321 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-883640ea-9692-4ee4-bf8f-fb9715cfa7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:15.193708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-6c5b9591-1b61-4fac-88e8-0a24e67ab668 None None] MFA Rules not processed for user `1980fb7bfef74f49b50cfc07d7eacff8`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:15.195289 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-6c5b9591-1b61-4fac-88e8-0a24e67ab668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:15.355290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1181/2365] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:58:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:58:15.383593 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b9591-1b61-4fac-88e8-0a24e67ab668 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:15.383593 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-6c5b9591-1b61-4fac-88e8-0a24e67ab668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:15.400203 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1185/2366] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Sep 14 19:58:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:58:15.416156 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883640ea-9692-4ee4-bf8f-fb9715cfa7da None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:15.418069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-883640ea-9692-4ee4-bf8f-fb9715cfa7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:15.457888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b9591-1b61-4fac-88e8-0a24e67ab668 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:15.461908 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496c06e-8902-4f1b-8a58-e606f691f423 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:15.462532 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496c06e-8902-4f1b-8a58-e606f691f423 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:15.462808 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496c06e-8902-4f1b-8a58-e606f691f423 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:15.463077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496c06e-8902-4f1b-8a58-e606f691f423 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:15.477960 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496c06e-8902-4f1b-8a58-e606f691f423 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:15.493598 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496c06e-8902-4f1b-8a58-e606f691f423 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:15.493598 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1182/2367] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:58:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:58:15.501382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883640ea-9692-4ee4-bf8f-fb9715cfa7da None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:15.506244 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f1c18-f547-4b7a-a596-ba90688b1f1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2faa7ffc99948478ec7b81842139078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:15.506946 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f1c18-f547-4b7a-a596-ba90688b1f1f service glance] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:15.507173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f1c18-f547-4b7a-a596-ba90688b1f1f service glance] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:15.507447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f1c18-f547-4b7a-a596-ba90688b1f1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:15.520412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f1c18-f547-4b7a-a596-ba90688b1f1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:15.521850 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f1c18-f547-4b7a-a596-ba90688b1f1f service glance] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:15.539628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1186/2368] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:58:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 19:58:15.895941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:15.953336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010b5b2-5275-4e23-ae7d-67979361d1c7 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:15.954037 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010b5b2-5275-4e23-ae7d-67979361d1c7 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:15.954483 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010b5b2-5275-4e23-ae7d-67979361d1c7 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:15.958064 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1183/2369] 10.222.0.15 () {54 vars in 921 bytes} [Wed Sep 14 19:58:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:58:15.963004 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1a667-fbf9-4f49-8254-408936e815dd None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:15.963297 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1a667-fbf9-4f49-8254-408936e815dd None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:15.963604 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1a667-fbf9-4f49-8254-408936e815dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:15.998374 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-b9f1a667-fbf9-4f49-8254-408936e815dd None None] MFA Rules not processed for user `221300017882415ca3a7c9192343b956`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:15.999665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-b9f1a667-fbf9-4f49-8254-408936e815dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:16.022172 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1187/2370] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Sep 14 19:58:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:58:16.037097 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010b5b2-5275-4e23-ae7d-67979361d1c7 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:16.038886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-a010b5b2-5275-4e23-ae7d-67979361d1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:16.054287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010b5b2-5275-4e23-ae7d-67979361d1c7 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:16.058772 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d32d4f-6aaa-4754-9cf7-569442bb428c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:16.059404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d32d4f-6aaa-4754-9cf7-569442bb428c service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:16.059718 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d32d4f-6aaa-4754-9cf7-569442bb428c service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:16.059997 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d32d4f-6aaa-4754-9cf7-569442bb428c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:16.068416 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d32d4f-6aaa-4754-9cf7-569442bb428c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:16.070064 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d32d4f-6aaa-4754-9cf7-569442bb428c service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:16.078713 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1184/2371] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:58:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:58:16.203628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23661a1a-acde-4fac-8f91-df8aaef2a46a None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:16.204180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23661a1a-acde-4fac-8f91-df8aaef2a46a None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:16.204294 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23661a1a-acde-4fac-8f91-df8aaef2a46a None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:16.206977 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1188/2372] 10.222.0.15 () {54 vars in 921 bytes} [Wed Sep 14 19:58:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 19:58:16.214483 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b02754-e115-46e5-8ba1-91c2b2f0527f None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:16.214995 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b02754-e115-46e5-8ba1-91c2b2f0527f None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:16.215100 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b02754-e115-46e5-8ba1-91c2b2f0527f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:16.240790 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-02b02754-e115-46e5-8ba1-91c2b2f0527f None None] MFA Rules not processed for user `421f6cc846b342918a177d2794eb3db8`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:16.244186 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-02b02754-e115-46e5-8ba1-91c2b2f0527f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:16.252149 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1185/2373] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Sep 14 19:58:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:58:16.272375 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23661a1a-acde-4fac-8f91-df8aaef2a46a None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:16.285928 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23661a1a-acde-4fac-8f91-df8aaef2a46a None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:16.291008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c76bd-47b3-4e26-82ab-48d6954e16fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:16.292752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c76bd-47b3-4e26-82ab-48d6954e16fe service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:16.292752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c76bd-47b3-4e26-82ab-48d6954e16fe service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:16.292752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c76bd-47b3-4e26-82ab-48d6954e16fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:16.312077 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c76bd-47b3-4e26-82ab-48d6954e16fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:16.313566 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c76bd-47b3-4e26-82ab-48d6954e16fe service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:16.328688 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1189/2374] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:58:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:58:16.490191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0824e22-f4ab-4ee7-a4b4-d02f2edd279d None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:16.490474 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0824e22-f4ab-4ee7-a4b4-d02f2edd279d None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:16.492865 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0824e22-f4ab-4ee7-a4b4-d02f2edd279d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:16.535782 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-f0824e22-f4ab-4ee7-a4b4-d02f2edd279d None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:16.537439 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f0824e22-f4ab-4ee7-a4b4-d02f2edd279d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:16.566792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1186/2375] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Sep 14 19:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:58:16.594546 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c76bd-47b3-4e26-82ab-48d6954e16fe service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:16.596656 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f89c76bd-47b3-4e26-82ab-48d6954e16fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:16.628176 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c76bd-47b3-4e26-82ab-48d6954e16fe service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:16.647189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828da916-22a3-43cc-900b-fde06cd0b5f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:16.648145 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828da916-22a3-43cc-900b-fde06cd0b5f9 service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:16.648815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828da916-22a3-43cc-900b-fde06cd0b5f9 service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:16.659323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828da916-22a3-43cc-900b-fde06cd0b5f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:16.698161 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828da916-22a3-43cc-900b-fde06cd0b5f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:16.700734 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828da916-22a3-43cc-900b-fde06cd0b5f9 service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:16.726085 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1190/2376] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:58:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:58:17.739949 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3e7cb-95fa-418a-b1f5-d88257308887 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:17.751505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3e7cb-95fa-418a-b1f5-d88257308887 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:17.752368 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3e7cb-95fa-418a-b1f5-d88257308887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:17.775951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-54c3e7cb-95fa-418a-b1f5-d88257308887 None None] MFA Rules not processed for user `1980fb7bfef74f49b50cfc07d7eacff8`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:17.777591 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-54c3e7cb-95fa-418a-b1f5-d88257308887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:17.791186 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1187/2377] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:58:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:58:18.474664 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58dae7-051f-4254-baaf-030f36323489 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:18.475192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58dae7-051f-4254-baaf-030f36323489 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:18.475192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58dae7-051f-4254-baaf-030f36323489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:18.504824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-3c58dae7-051f-4254-baaf-030f36323489 None None] MFA Rules not processed for user `32b57ae5ce3b4104bb21a9c1f119db81`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:18.506055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-3c58dae7-051f-4254-baaf-030f36323489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:18.600725 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1191/2378] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:58:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:58:18.605667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3e7cb-95fa-418a-b1f5-d88257308887 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:18.614523 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-54c3e7cb-95fa-418a-b1f5-d88257308887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:18.630106 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3e7cb-95fa-418a-b1f5-d88257308887 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:18.640836 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed789f82-2c39-4fbd-9e4a-481551c70cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:18.641618 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed789f82-2c39-4fbd-9e4a-481551c70cea admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:18.642006 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed789f82-2c39-4fbd-9e4a-481551c70cea admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:18.642552 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed789f82-2c39-4fbd-9e4a-481551c70cea admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:18.644222 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed789f82-2c39-4fbd-9e4a-481551c70cea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:18.646209 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed789f82-2c39-4fbd-9e4a-481551c70cea admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:18.770073 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1188/2379] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 19:58:18 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:58:18.774267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58dae7-051f-4254-baaf-030f36323489 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:18.786849 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58dae7-051f-4254-baaf-030f36323489 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:18.836752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:18.855227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fc715-fe8e-4e10-bf02-36707db78c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:18.855874 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fc715-fe8e-4e10-bf02-36707db78c41 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:18.856162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fc715-fe8e-4e10-bf02-36707db78c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:18.856441 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fc715-fe8e-4e10-bf02-36707db78c41 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:18.857221 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fc715-fe8e-4e10-bf02-36707db78c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:18.859239 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fc715-fe8e-4e10-bf02-36707db78c41 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:18.978738 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1192/2380] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 19:58:18 2022] POST /identity/v3/users => generated 299 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 19:58:18.979958 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed789f82-2c39-4fbd-9e4a-481551c70cea admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:18.997523 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed789f82-2c39-4fbd-9e4a-481551c70cea admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:19.007880 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f760c-fa6a-4b61-8dbc-19a0d1f9d00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:19.008681 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f760c-fa6a-4b61-8dbc-19a0d1f9d00d admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:19.009090 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f760c-fa6a-4b61-8dbc-19a0d1f9d00d admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:19.009462 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f760c-fa6a-4b61-8dbc-19a0d1f9d00d admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:19.010702 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f760c-fa6a-4b61-8dbc-19a0d1f9d00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:19.018054 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f760c-fa6a-4b61-8dbc-19a0d1f9d00d admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:19.034905 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1189/2381] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:58:19.045651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fc715-fe8e-4e10-bf02-36707db78c41 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:19.074131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fc715-fe8e-4e10-bf02-36707db78c41 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:19.093626 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f0524-c9ad-489e-b67e-aaf537f0ed3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:19.094663 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f0524-c9ad-489e-b67e-aaf537f0ed3b admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:19.095091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f0524-c9ad-489e-b67e-aaf537f0ed3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:19.095587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f0524-c9ad-489e-b67e-aaf537f0ed3b admin admin] PATH_INFO: `/v3/projects/b51bb058430c4b01ad3a4f372e39f43a/users/ddb095fcb81347538f3278ddd6a53c91/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:19.120886 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f0524-c9ad-489e-b67e-aaf537f0ed3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51bb058430c4b01ad3a4f372e39f43a, user_id=ddb095fcb81347538f3278ddd6a53c91, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:19.122634 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f0524-c9ad-489e-b67e-aaf537f0ed3b admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:19.176186 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:19.224479 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1193/2382] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:58:19 2022] PUT /identity/v3/projects/b51bb058430c4b01ad3a4f372e39f43a/users/ddb095fcb81347538f3278ddd6a53c91/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 19:58:19.228623 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f760c-fa6a-4b61-8dbc-19a0d1f9d00d admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:19.259003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f760c-fa6a-4b61-8dbc-19a0d1f9d00d admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:19.370649 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f381c6-d071-4243-b811-8a317ade7026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:19.376150 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f381c6-d071-4243-b811-8a317ade7026 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:19.376984 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f381c6-d071-4243-b811-8a317ade7026 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:19.377560 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f381c6-d071-4243-b811-8a317ade7026 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:19.378939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f381c6-d071-4243-b811-8a317ade7026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:19.394163 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f381c6-d071-4243-b811-8a317ade7026 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:19.407625 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1190/2383] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 19:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 19:58:19.412077 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f0524-c9ad-489e-b67e-aaf537f0ed3b admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:19.427907 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f0524-c9ad-489e-b67e-aaf537f0ed3b admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:19.434045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c197255-cf65-40e3-ad61-5ca66ce6b714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:19.435038 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c197255-cf65-40e3-ad61-5ca66ce6b714 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:19.435526 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c197255-cf65-40e3-ad61-5ca66ce6b714 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:19.436315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c197255-cf65-40e3-ad61-5ca66ce6b714 admin admin] PATH_INFO: `/v3/projects/b51bb058430c4b01ad3a4f372e39f43a/users/ddb095fcb81347538f3278ddd6a53c91/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:19.438747 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c197255-cf65-40e3-ad61-5ca66ce6b714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51bb058430c4b01ad3a4f372e39f43a, user_id=ddb095fcb81347538f3278ddd6a53c91, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:19.442845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c197255-cf65-40e3-ad61-5ca66ce6b714 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:19.467913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1194/2384] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 19:58:19 2022] PUT /identity/v3/projects/b51bb058430c4b01ad3a4f372e39f43a/users/ddb095fcb81347538f3278ddd6a53c91/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 19:58:20.814496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc0fa2-41c4-4ffa-acef-4b20cbcb7c21 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:20.815234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc0fa2-41c4-4ffa-acef-4b20cbcb7c21 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:20.815234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc0fa2-41c4-4ffa-acef-4b20cbcb7c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:20.843992 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-4fdc0fa2-41c4-4ffa-acef-4b20cbcb7c21 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:20.845452 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-4fdc0fa2-41c4-4ffa-acef-4b20cbcb7c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:20.950755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1191/2385] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Sep 14 19:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:58:20.965434 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c197255-cf65-40e3-ad61-5ca66ce6b714 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:21.112057 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c197255-cf65-40e3-ad61-5ca66ce6b714 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:21.119022 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b8836-1488-4e24-8006-96d6e6a3f0f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:21.119022 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b8836-1488-4e24-8006-96d6e6a3f0f3 service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:21.119559 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b8836-1488-4e24-8006-96d6e6a3f0f3 service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:21.120450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b8836-1488-4e24-8006-96d6e6a3f0f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:21.131469 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b8836-1488-4e24-8006-96d6e6a3f0f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:21.133473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b8836-1488-4e24-8006-96d6e6a3f0f3 service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:21.151835 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1195/2386] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:58:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:58:21.933247 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:22.189832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:23.813027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:23.988143 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fe8e6-3921-4876-a649-55ad768c5e7d None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:23.988434 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fe8e6-3921-4876-a649-55ad768c5e7d None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:23.988720 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fe8e6-3921-4876-a649-55ad768c5e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:24.050568 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-6d9fe8e6-3921-4876-a649-55ad768c5e7d None None] MFA Rules not processed for user `15fbda6263b44352b3ac560372bef725`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:24.052991 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-6d9fe8e6-3921-4876-a649-55ad768c5e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:24.157760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1192/2387] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Sep 14 19:58:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:58:24.187349 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b8836-1488-4e24-8006-96d6e6a3f0f3 service nova] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:24.190359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-1c8b8836-1488-4e24-8006-96d6e6a3f0f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:24.306076 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b8836-1488-4e24-8006-96d6e6a3f0f3 service nova] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:24.313092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324f8fc-be66-4020-8b67-b921df5ce8d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee56bf9af257486e94e6ff1b33086f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:24.314626 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324f8fc-be66-4020-8b67-b921df5ce8d8 service swift] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:24.317984 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324f8fc-be66-4020-8b67-b921df5ce8d8 service swift] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:24.317984 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324f8fc-be66-4020-8b67-b921df5ce8d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:24.325071 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324f8fc-be66-4020-8b67-b921df5ce8d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:24.327058 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324f8fc-be66-4020-8b67-b921df5ce8d8 service swift] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:24.342511 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1196/2388] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Sep 14 19:58:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 19:58:24.527598 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:24.837909 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b1bf3-950e-423d-a493-c965ccc84324 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:24.839220 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b1bf3-950e-423d-a493-c965ccc84324 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:24.839773 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b1bf3-950e-423d-a493-c965ccc84324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:24.919316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-1c1b1bf3-950e-423d-a493-c965ccc84324 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:24.921398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1c1b1bf3-950e-423d-a493-c965ccc84324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:24.941327 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1193/2389] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Sep 14 19:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:58:25.078335 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324f8fc-be66-4020-8b67-b921df5ce8d8 service swift] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:25.097143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324f8fc-be66-4020-8b67-b921df5ce8d8 service swift] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:25.113258 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00309aa6-7691-43e9-af83-5a0ca4517e6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:25.115085 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00309aa6-7691-43e9-af83-5a0ca4517e6d service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:25.115707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00309aa6-7691-43e9-af83-5a0ca4517e6d service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:25.116184 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00309aa6-7691-43e9-af83-5a0ca4517e6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:25.140526 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00309aa6-7691-43e9-af83-5a0ca4517e6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:25.143035 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00309aa6-7691-43e9-af83-5a0ca4517e6d service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:25.178983 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1197/2390] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:58:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:58:25.473414 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:27.609050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:28.259139 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a6fbf-9ddd-4b7b-adab-168d7100669a None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:28.259706 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a6fbf-9ddd-4b7b-adab-168d7100669a None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:28.259795 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a6fbf-9ddd-4b7b-adab-168d7100669a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:28.308285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-b12a6fbf-9ddd-4b7b-adab-168d7100669a None None] MFA Rules not processed for user `ddb095fcb81347538f3278ddd6a53c91`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:28.309529 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b12a6fbf-9ddd-4b7b-adab-168d7100669a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:28.477534 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1194/2391] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:58:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:58:28.492935 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00309aa6-7691-43e9-af83-5a0ca4517e6d service nova] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:28.495402 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-00309aa6-7691-43e9-af83-5a0ca4517e6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:28.595242 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00309aa6-7691-43e9-af83-5a0ca4517e6d service nova] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:28.613799 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86745ddf-2de5-427a-997c-025eda92930c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2faa7ffc99948478ec7b81842139078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:28.615334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86745ddf-2de5-427a-997c-025eda92930c service glance] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:28.615816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86745ddf-2de5-427a-997c-025eda92930c service glance] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:28.618628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86745ddf-2de5-427a-997c-025eda92930c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:28.701523 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86745ddf-2de5-427a-997c-025eda92930c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:28.702475 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86745ddf-2de5-427a-997c-025eda92930c service glance] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:28.722733 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1198/2392] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:58:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:58:28.741428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:29.023836 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb168d-9704-46b7-bff0-b3dc5f2fe1fc None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:29.029576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb168d-9704-46b7-bff0-b3dc5f2fe1fc None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:29.029576 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb168d-9704-46b7-bff0-b3dc5f2fe1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:29.058794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-f4eb168d-9704-46b7-bff0-b3dc5f2fe1fc None None] MFA Rules not processed for user `15fbda6263b44352b3ac560372bef725`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:29.060306 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f4eb168d-9704-46b7-bff0-b3dc5f2fe1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:29.080624 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1195/2393] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Sep 14 19:58:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:58:29.122080 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86745ddf-2de5-427a-997c-025eda92930c service glance] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:29.149097 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86745ddf-2de5-427a-997c-025eda92930c service glance] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:29.160218 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ac3eb-b524-4c7c-a54d-572ab3014076 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee56bf9af257486e94e6ff1b33086f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:29.161722 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ac3eb-b524-4c7c-a54d-572ab3014076 service swift] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:29.161722 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ac3eb-b524-4c7c-a54d-572ab3014076 service swift] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:29.161722 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ac3eb-b524-4c7c-a54d-572ab3014076 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:29.187271 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ac3eb-b524-4c7c-a54d-572ab3014076 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:29.189085 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ac3eb-b524-4c7c-a54d-572ab3014076 service swift] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:29.217620 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1199/2394] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Sep 14 19:58:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 19:58:30.621258 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:31.875082 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:33.447533 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:34.481540 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:34.640860 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e420d76-7154-4339-831a-caa041d3150c None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:34.641626 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e420d76-7154-4339-831a-caa041d3150c None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:34.643100 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e420d76-7154-4339-831a-caa041d3150c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:34.737437 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-9e420d76-7154-4339-831a-caa041d3150c None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:34.743708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-9e420d76-7154-4339-831a-caa041d3150c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:34.857874 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1196/2395] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Sep 14 19:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:58:34.875237 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ac3eb-b524-4c7c-a54d-572ab3014076 service swift] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:34.882479 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-930ac3eb-b524-4c7c-a54d-572ab3014076 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:34.914504 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ac3eb-b524-4c7c-a54d-572ab3014076 service swift] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:34.935819 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc9761-b577-4dab-932f-e02e70ac5248 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:34.939393 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc9761-b577-4dab-932f-e02e70ac5248 service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:34.939848 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc9761-b577-4dab-932f-e02e70ac5248 service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:34.943711 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc9761-b577-4dab-932f-e02e70ac5248 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:34.979578 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc9761-b577-4dab-932f-e02e70ac5248 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:34.982082 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc9761-b577-4dab-932f-e02e70ac5248 service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:35.018958 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1200/2396] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:58:35.941571 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:37.006884 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:39.012559 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:39.898561 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:40.778037 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:41.100570 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:41.130107 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f2d0b-fe7b-4539-b5fe-5ea16b93a090 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:41.130403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f2d0b-fe7b-4539-b5fe-5ea16b93a090 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:41.130697 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f2d0b-fe7b-4539-b5fe-5ea16b93a090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:41.152753 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-f51f2d0b-fe7b-4539-b5fe-5ea16b93a090 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:41.154234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f51f2d0b-fe7b-4539-b5fe-5ea16b93a090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:41.166829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1197/2397] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Sep 14 19:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:58:41.186441 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc9761-b577-4dab-932f-e02e70ac5248 service nova] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:41.202076 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc9761-b577-4dab-932f-e02e70ac5248 service nova] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:41.208940 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de7ea2-2a5e-42a0-8a7a-00bb39472a88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:41.209893 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de7ea2-2a5e-42a0-8a7a-00bb39472a88 service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:41.210479 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de7ea2-2a5e-42a0-8a7a-00bb39472a88 service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:41.211208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de7ea2-2a5e-42a0-8a7a-00bb39472a88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:41.229111 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de7ea2-2a5e-42a0-8a7a-00bb39472a88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:41.231268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de7ea2-2a5e-42a0-8a7a-00bb39472a88 service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:41.244825 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1201/2398] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:58:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:58:41.799380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:41.920719 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:43.752270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:44.037669 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:44.390421 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:44.629373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00436ed3-ec50-4394-844a-ba6ea428fb90 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:44.629662 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00436ed3-ec50-4394-844a-ba6ea428fb90 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:44.630192 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00436ed3-ec50-4394-844a-ba6ea428fb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:44.657468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-00436ed3-ec50-4394-844a-ba6ea428fb90 None None] MFA Rules not processed for user `32b57ae5ce3b4104bb21a9c1f119db81`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:44.660261 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-00436ed3-ec50-4394-844a-ba6ea428fb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:44.668367 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1198/2399] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:58:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:58:45.038006 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:45.340158 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:46.592168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:47.872166 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff480a-f64c-4ad8-991e-049603a9caa6 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:47.872638 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff480a-f64c-4ad8-991e-049603a9caa6 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:47.872758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff480a-f64c-4ad8-991e-049603a9caa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:47.899599 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-dcff480a-f64c-4ad8-991e-049603a9caa6 None None] MFA Rules not processed for user `15fbda6263b44352b3ac560372bef725`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:58:47.901600 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-dcff480a-f64c-4ad8-991e-049603a9caa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:47.916559 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1202/2400] 10.222.0.15 () {58 vars in 967 bytes} [Wed Sep 14 19:58:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 19:58:47.953170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00436ed3-ec50-4394-844a-ba6ea428fb90 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:47.993917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00436ed3-ec50-4394-844a-ba6ea428fb90 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:48.002370 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305465fd-0145-4c6a-8cc7-66294657b56e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee56bf9af257486e94e6ff1b33086f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:48.003884 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305465fd-0145-4c6a-8cc7-66294657b56e service swift] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:48.004375 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305465fd-0145-4c6a-8cc7-66294657b56e service swift] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:48.005015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305465fd-0145-4c6a-8cc7-66294657b56e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:48.030692 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305465fd-0145-4c6a-8cc7-66294657b56e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:48.032345 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305465fd-0145-4c6a-8cc7-66294657b56e service swift] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:48.052872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1199/2401] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Sep 14 19:58:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 19:58:48.516001 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:49.306163 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:49.338211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff480a-f64c-4ad8-991e-049603a9caa6 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:58:49.340358 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-dcff480a-f64c-4ad8-991e-049603a9caa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:49.430128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff480a-f64c-4ad8-991e-049603a9caa6 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:58:49.443392 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2dc83-8478-4427-9137-298273c00558 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6942a851a69b446e90a2b138f4482465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:58:49.444441 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2dc83-8478-4427-9137-298273c00558 service placement] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:58:49.444958 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2dc83-8478-4427-9137-298273c00558 service placement] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:58:49.445386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2dc83-8478-4427-9137-298273c00558 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:58:49.447726 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-bdb2dc83-8478-4427-9137-298273c00558 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:58:49.463587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2dc83-8478-4427-9137-298273c00558 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:58:49.465520 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2dc83-8478-4427-9137-298273c00558 service placement] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:58:49.483781 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1203/2402] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:58:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:58:50.539899 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:50.772328 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:52.054226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:52.300448 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:52.532247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:53.535174 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:53.621870 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:53.983359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:54.076973 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:54.286374 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:54.911428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:55.121560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:56.305441 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:56.391516 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:56.560869 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:57.189813 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:57.389641 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:58.167320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:58.340057 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:58.852484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:58.915156 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:59.549573 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:59.700194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:59.865622 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:00.494484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:00.812279 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:01.459297 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee69b70-35fe-431f-87a7-d3a8f4d8ee1f None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:59:01.460440 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee69b70-35fe-431f-87a7-d3a8f4d8ee1f None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:59:01.460712 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee69b70-35fe-431f-87a7-d3a8f4d8ee1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:59:01.500852 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-aee69b70-35fe-431f-87a7-d3a8f4d8ee1f None None] MFA Rules not processed for user `15fbda6263b44352b3ac560372bef725`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:59:01.503516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-aee69b70-35fe-431f-87a7-d3a8f4d8ee1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:59:01.533260 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1200/2403] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Sep 14 19:59:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:59:01.543351 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2dc83-8478-4427-9137-298273c00558 service placement] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:59:01.574683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2dc83-8478-4427-9137-298273c00558 service placement] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:59:01.597255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05024f4e-71af-4cab-9934-ac80c805132c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee56bf9af257486e94e6ff1b33086f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:59:01.598529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05024f4e-71af-4cab-9934-ac80c805132c service swift] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:59:01.598999 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05024f4e-71af-4cab-9934-ac80c805132c service swift] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:59:01.599869 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05024f4e-71af-4cab-9934-ac80c805132c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:59:01.610836 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05024f4e-71af-4cab-9934-ac80c805132c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:59:01.612500 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05024f4e-71af-4cab-9934-ac80c805132c service swift] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:59:01.622934 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1204/2404] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Sep 14 19:59:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 19:59:01.934518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:02.201325 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:02.967076 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:03.130484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:03.823437 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:03.888754 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:04.140770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:04.544044 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:04.840560 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bc427-0d73-47ae-812c-edd3a810fcb2 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:59:04.841211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bc427-0d73-47ae-812c-edd3a810fcb2 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:59:04.841211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bc427-0d73-47ae-812c-edd3a810fcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:59:04.867883 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:04.873700 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-a02bc427-0d73-47ae-812c-edd3a810fcb2 None None] MFA Rules not processed for user `7e631060d3e0499d8df476f0b5096b3b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:59:04.875013 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-a02bc427-0d73-47ae-812c-edd3a810fcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:59:04.941311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1201/2405] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:59:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:59:05.041128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:05.671178 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:05.823589 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:06.030087 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:06.069510 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:06.328817 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:06.571673 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:06.769767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:07.016068 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:07.037313 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:07.294066 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:07.374620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:07.472326 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:07.580656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:07.663246 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:07.688639 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:07.729130 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:07.825993 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:07.944627 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:07.968497 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:08.064767 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:08.088357 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:08.207111 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:08.345517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:08.376925 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:08.528760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:08.561275 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:08.637537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:08.706085 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:08.729114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:09.384592 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:09.409599 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:09.569333 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:09.599125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:09.620231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:09.648810 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:09.778325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:12.131812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e053fd-32ae-4c7c-bc54-6a07edfc9f36 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:59:12.132459 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e053fd-32ae-4c7c-bc54-6a07edfc9f36 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:59:12.132459 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e053fd-32ae-4c7c-bc54-6a07edfc9f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:59:12.153065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-f5e053fd-32ae-4c7c-bc54-6a07edfc9f36 None None] MFA Rules not processed for user `1980fb7bfef74f49b50cfc07d7eacff8`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:59:12.154307 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f5e053fd-32ae-4c7c-bc54-6a07edfc9f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:59:12.210067 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1205/2406] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:59:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:59:15.633636 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bc427-0d73-47ae-812c-edd3a810fcb2 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:59:15.760172 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bc427-0d73-47ae-812c-edd3a810fcb2 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:59:15.767450 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4b0f0-d2cf-4e10-a7fc-eb8513ae4f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:59:15.768428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4b0f0-d2cf-4e10-a7fc-eb8513ae4f12 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:59:15.768967 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4b0f0-d2cf-4e10-a7fc-eb8513ae4f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:59:15.769458 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4b0f0-d2cf-4e10-a7fc-eb8513ae4f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:59:15.771501 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-aff4b0f0-d2cf-4e10-a7fc-eb8513ae4f12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:59:15.790749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:15.847729 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4b0f0-d2cf-4e10-a7fc-eb8513ae4f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:59:15.849461 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4b0f0-d2cf-4e10-a7fc-eb8513ae4f12 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:59:15.859594 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1202/2407] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:59:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:59:16.687512 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bf883-ae2c-4831-85da-d5339529ff77 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:59:16.688134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bf883-ae2c-4831-85da-d5339529ff77 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:59:16.688134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bf883-ae2c-4831-85da-d5339529ff77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:59:16.708462 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-718bf883-ae2c-4831-85da-d5339529ff77 None None] MFA Rules not processed for user `65a656b5540143d0aa65efe5eb82a7af`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:59:16.709759 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-718bf883-ae2c-4831-85da-d5339529ff77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:59:16.794606 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1206/2408] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:59:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:59:26.373753 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=22 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:26.786066 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=72 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:27.352183 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4b0f0-d2cf-4e10-a7fc-eb8513ae4f12 service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:59:27.362011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4b0f0-d2cf-4e10-a7fc-eb8513ae4f12 service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:59:27.366834 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca80784-e3fd-445d-8a6c-3031b959a3a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:59:27.367478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca80784-e3fd-445d-8a6c-3031b959a3a2 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:59:27.367853 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca80784-e3fd-445d-8a6c-3031b959a3a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:59:27.368140 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca80784-e3fd-445d-8a6c-3031b959a3a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:59:27.378590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca80784-e3fd-445d-8a6c-3031b959a3a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:59:27.380165 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca80784-e3fd-445d-8a6c-3031b959a3a2 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:59:27.391015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1203/2409] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:59:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:59:37.386187 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=6 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:43.545113 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7781949-1590-42c6-a45f-9b56e739e0a7 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:59:43.545657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7781949-1590-42c6-a45f-9b56e739e0a7 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:59:43.545657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7781949-1590-42c6-a45f-9b56e739e0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:59:43.567419 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-e7781949-1590-42c6-a45f-9b56e739e0a7 None None] MFA Rules not processed for user `15fbda6263b44352b3ac560372bef725`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:59:43.573816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-e7781949-1590-42c6-a45f-9b56e739e0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:59:43.577283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1207/2410] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Sep 14 19:59:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:59:43.589533 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca80784-e3fd-445d-8a6c-3031b959a3a2 service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:59:43.602200 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca80784-e3fd-445d-8a6c-3031b959a3a2 service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:59:43.608220 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9766013-b729-4168-9fee-88797e9a8918 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee56bf9af257486e94e6ff1b33086f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:59:43.611792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9766013-b729-4168-9fee-88797e9a8918 service swift] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:59:43.611792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9766013-b729-4168-9fee-88797e9a8918 service swift] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:59:43.611792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9766013-b729-4168-9fee-88797e9a8918 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:59:43.618671 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9766013-b729-4168-9fee-88797e9a8918 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:59:43.620286 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9766013-b729-4168-9fee-88797e9a8918 service swift] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:59:43.629397 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1204/2411] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Sep 14 19:59:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 19:59:45.000025 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15101908-8dac-4b07-ac49-35922e4743cb None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:59:45.001004 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15101908-8dac-4b07-ac49-35922e4743cb None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:59:45.001280 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15101908-8dac-4b07-ac49-35922e4743cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:59:45.025856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-15101908-8dac-4b07-ac49-35922e4743cb None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:59:45.027362 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-15101908-8dac-4b07-ac49-35922e4743cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:59:45.036181 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1208/2412] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Sep 14 19:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:59:45.056887 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9766013-b729-4168-9fee-88797e9a8918 service swift] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:59:45.072146 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9766013-b729-4168-9fee-88797e9a8918 service swift] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:59:45.079877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63593fe5-cd26-44cb-bbcb-5eb5e9952b3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:59:45.080953 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63593fe5-cd26-44cb-bbcb-5eb5e9952b3c service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:59:45.081341 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63593fe5-cd26-44cb-bbcb-5eb5e9952b3c service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:59:45.081620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63593fe5-cd26-44cb-bbcb-5eb5e9952b3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:59:45.093261 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63593fe5-cd26-44cb-bbcb-5eb5e9952b3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:59:45.095747 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63593fe5-cd26-44cb-bbcb-5eb5e9952b3c service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:59:45.112171 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1205/2413] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:59:45.857704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafa691-354a-448c-a3bb-22dfd172f54f None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:59:45.858337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafa691-354a-448c-a3bb-22dfd172f54f None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:59:45.858617 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafa691-354a-448c-a3bb-22dfd172f54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:59:45.879314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-8fafa691-354a-448c-a3bb-22dfd172f54f None None] MFA Rules not processed for user `e95c629061564a93acaf944fd3ea3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:59:45.880917 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-8fafa691-354a-448c-a3bb-22dfd172f54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:59:45.951833 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1209/2414] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 19:59:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:59:49.551146 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f37870-9bf5-49f2-bd80-c2a716b7de8e None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:59:49.551146 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f37870-9bf5-49f2-bd80-c2a716b7de8e None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:59:49.551146 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f37870-9bf5-49f2-bd80-c2a716b7de8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:59:49.551146 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-21f37870-9bf5-49f2-bd80-c2a716b7de8e None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:59:49.552612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-21f37870-9bf5-49f2-bd80-c2a716b7de8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:59:49.561417 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1206/2415] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Sep 14 19:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:59:49.576892 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafa691-354a-448c-a3bb-22dfd172f54f None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:59:49.591920 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafa691-354a-448c-a3bb-22dfd172f54f None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:59:49.598000 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166196e-eb68-4505-b2a4-645e72803af3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:59:49.598641 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166196e-eb68-4505-b2a4-645e72803af3 service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:59:49.598927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166196e-eb68-4505-b2a4-645e72803af3 service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:59:49.599202 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166196e-eb68-4505-b2a4-645e72803af3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:59:49.609182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166196e-eb68-4505-b2a4-645e72803af3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:59:49.618888 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166196e-eb68-4505-b2a4-645e72803af3 service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:59:49.643987 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1210/2416] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:59:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 19:59:55.603190 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896a95b-0ba7-43fb-a855-752558196ee8 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:59:55.604735 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896a95b-0ba7-43fb-a855-752558196ee8 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:59:55.608660 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896a95b-0ba7-43fb-a855-752558196ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:59:55.637343 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-f896a95b-0ba7-43fb-a855-752558196ee8 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 19:59:55.640243 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f896a95b-0ba7-43fb-a855-752558196ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 19:59:55.652566 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1207/2417] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Sep 14 19:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 19:59:55.678868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166196e-eb68-4505-b2a4-645e72803af3 service nova] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 19:59:55.691972 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166196e-eb68-4505-b2a4-645e72803af3 service nova] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 19:59:55.698116 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975e149-3be1-4909-ab71-33229ccf04f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 19:59:55.698960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975e149-3be1-4909-ab71-33229ccf04f0 service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 19:59:55.699410 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975e149-3be1-4909-ab71-33229ccf04f0 service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 19:59:55.699876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975e149-3be1-4909-ab71-33229ccf04f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 19:59:55.709810 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975e149-3be1-4909-ab71-33229ccf04f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 19:59:55.712448 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975e149-3be1-4909-ab71-33229ccf04f0 service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 19:59:55.724477 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1211/2418] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 19:59:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:00:00.932250 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916146d8-efc0-407d-b34c-bab7ae182811 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:00.933166 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916146d8-efc0-407d-b34c-bab7ae182811 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:00.933447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916146d8-efc0-407d-b34c-bab7ae182811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:00.954389 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-916146d8-efc0-407d-b34c-bab7ae182811 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:00:00.955672 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-916146d8-efc0-407d-b34c-bab7ae182811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:00:00.963826 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1208/2419] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Sep 14 20:00:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:00:00.993662 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975e149-3be1-4909-ab71-33229ccf04f0 service nova] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:00:01.007165 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975e149-3be1-4909-ab71-33229ccf04f0 service nova] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:00:01.013404 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411cdf11-9375-4ae9-ba79-6b46551f2749 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:00:01.014075 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cdf11-9375-4ae9-ba79-6b46551f2749 service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:01.014319 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cdf11-9375-4ae9-ba79-6b46551f2749 service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:01.015180 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cdf11-9375-4ae9-ba79-6b46551f2749 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:01.026676 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411cdf11-9375-4ae9-ba79-6b46551f2749 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:00:01.029836 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411cdf11-9375-4ae9-ba79-6b46551f2749 service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:00:01.040605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1212/2420] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:00:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:00:02.127834 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c760-572b-4fd2-b438-6aae221bc9f3 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:02.128281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c760-572b-4fd2-b438-6aae221bc9f3 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:02.128820 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c760-572b-4fd2-b438-6aae221bc9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:02.151451 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-0f64c760-572b-4fd2-b438-6aae221bc9f3 None None] MFA Rules not processed for user `15fbda6263b44352b3ac560372bef725`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:00:02.153991 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0f64c760-572b-4fd2-b438-6aae221bc9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:00:02.162324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1209/2421] 10.222.0.15 () {58 vars in 967 bytes} [Wed Sep 14 20:00:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:00:02.177338 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411cdf11-9375-4ae9-ba79-6b46551f2749 service nova] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:00:02.191216 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411cdf11-9375-4ae9-ba79-6b46551f2749 service nova] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:00:02.196937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33530c-e12d-4e5b-9ada-07050f9f88bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee56bf9af257486e94e6ff1b33086f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:00:02.197566 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33530c-e12d-4e5b-9ada-07050f9f88bd service swift] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:02.197854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33530c-e12d-4e5b-9ada-07050f9f88bd service swift] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:02.198158 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33530c-e12d-4e5b-9ada-07050f9f88bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:02.208287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33530c-e12d-4e5b-9ada-07050f9f88bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:00:02.210277 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33530c-e12d-4e5b-9ada-07050f9f88bd service swift] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:00:02.218912 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1213/2422] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Sep 14 20:00:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 20:00:04.887086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304473a2-97b6-4580-b1a2-22c46550c508 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:04.887631 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304473a2-97b6-4580-b1a2-22c46550c508 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:04.887631 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304473a2-97b6-4580-b1a2-22c46550c508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:04.910459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-304473a2-97b6-4580-b1a2-22c46550c508 None None] MFA Rules not processed for user `983e57be9b214d788dc3a69da22a174e`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:00:04.911817 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-304473a2-97b6-4580-b1a2-22c46550c508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:00:04.979845 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1210/2423] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:00:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:00:05.261573 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323e647-ba98-4dc9-9f03-6655383fbb81 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:05.263380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323e647-ba98-4dc9-9f03-6655383fbb81 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:05.263785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323e647-ba98-4dc9-9f03-6655383fbb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:05.290318 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-1323e647-ba98-4dc9-9f03-6655383fbb81 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:00:05.291590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-1323e647-ba98-4dc9-9f03-6655383fbb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:00:05.318333 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1214/2424] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Sep 14 20:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:00:05.584818 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304473a2-97b6-4580-b1a2-22c46550c508 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:00:05.598729 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304473a2-97b6-4580-b1a2-22c46550c508 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:00:05.604549 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcc8c2-6b40-4c3e-b973-60503500ec73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:00:05.605193 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcc8c2-6b40-4c3e-b973-60503500ec73 service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:05.605546 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcc8c2-6b40-4c3e-b973-60503500ec73 service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:05.606068 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcc8c2-6b40-4c3e-b973-60503500ec73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:05.614370 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fcc8c2-6b40-4c3e-b973-60503500ec73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:00:05.615964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fcc8c2-6b40-4c3e-b973-60503500ec73 service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:00:05.628252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1211/2425] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:00:05.695159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323e647-ba98-4dc9-9f03-6655383fbb81 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:00:05.709849 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323e647-ba98-4dc9-9f03-6655383fbb81 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:00:05.724186 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25380d-c6b4-477b-9399-bd6af9a4b75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:00:05.728072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25380d-c6b4-477b-9399-bd6af9a4b75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:05.728072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25380d-c6b4-477b-9399-bd6af9a4b75e admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:05.728072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25380d-c6b4-477b-9399-bd6af9a4b75e admin admin] PATH_INFO: `/v3/users/1980fb7bfef74f49b50cfc07d7eacff8` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:05.728072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25380d-c6b4-477b-9399-bd6af9a4b75e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1980fb7bfef74f49b50cfc07d7eacff8)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:00:05.729069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25380d-c6b4-477b-9399-bd6af9a4b75e admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:00:05.923261 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-dd25380d-c6b4-477b-9399-bd6af9a4b75e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1980fb7bfef74f49b50cfc07d7eacff8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:06.001991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-dd25380d-c6b4-477b-9399-bd6af9a4b75e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1980fb7bfef74f49b50cfc07d7eacff8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:06.002600 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-dd25380d-c6b4-477b-9399-bd6af9a4b75e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1980fb7bfef74f49b50cfc07d7eacff8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:06.015385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-dd25380d-c6b4-477b-9399-bd6af9a4b75e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1980fb7bfef74f49b50cfc07d7eacff8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:06.023569 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-dd25380d-c6b4-477b-9399-bd6af9a4b75e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1980fb7bfef74f49b50cfc07d7eacff8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:06.029578 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1215/2426] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:00:05 2022] DELETE /identity/v3/users/1980fb7bfef74f49b50cfc07d7eacff8 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:00:06.322973 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcc8c2-6b40-4c3e-b973-60503500ec73 service nova] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:00:06.335203 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcc8c2-6b40-4c3e-b973-60503500ec73 service nova] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:00:06.397330 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4e46c-e7e8-44cd-81ea-7bfe05fa90e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:00:06.397978 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4e46c-e7e8-44cd-81ea-7bfe05fa90e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:06.398303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4e46c-e7e8-44cd-81ea-7bfe05fa90e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:06.398733 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4e46c-e7e8-44cd-81ea-7bfe05fa90e9 admin admin] PATH_INFO: `/v3/projects/dd0e150814b54ca092c30aec2d34490f` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:06.399901 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4e46c-e7e8-44cd-81ea-7bfe05fa90e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd0e150814b54ca092c30aec2d34490f)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:00:06.402000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4e46c-e7e8-44cd-81ea-7bfe05fa90e9 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:00:06.678190 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:06.685412 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-62c4e46c-e7e8-44cd-81ea-7bfe05fa90e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd0e150814b54ca092c30aec2d34490f', 'request_id': 'req-62c4e46c-e7e8-44cd-81ea-7bfe05fa90e9'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:06.779382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-62c4e46c-e7e8-44cd-81ea-7bfe05fa90e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd0e150814b54ca092c30aec2d34490f', 'request_id': 'req-62c4e46c-e7e8-44cd-81ea-7bfe05fa90e9'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:06.786569 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-62c4e46c-e7e8-44cd-81ea-7bfe05fa90e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd0e150814b54ca092c30aec2d34490f', 'request_id': 'req-62c4e46c-e7e8-44cd-81ea-7bfe05fa90e9'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:06.799049 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-62c4e46c-e7e8-44cd-81ea-7bfe05fa90e9 admin admin] The token cache is being invalidate because project dd0e150814b54ca092c30aec2d34490f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:00:06.803763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-62c4e46c-e7e8-44cd-81ea-7bfe05fa90e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:06.803763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-62c4e46c-e7e8-44cd-81ea-7bfe05fa90e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:06.803763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1212/2427] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:00:06 2022] DELETE /identity/v3/projects/dd0e150814b54ca092c30aec2d34490f => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:00:16.026069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:16.888192 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=9,keystone:DELETE=4,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:40.927786 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25380d-c6b4-477b-9399-bd6af9a4b75e admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:00:40.929272 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-dd25380d-c6b4-477b-9399-bd6af9a4b75e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:00:40.943680 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25380d-c6b4-477b-9399-bd6af9a4b75e admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:00:40.999049 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddb35b-37e6-4b72-ab8a-cbb07efbeb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:00:40.999651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddb35b-37e6-4b72-ab8a-cbb07efbeb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:40.999948 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddb35b-37e6-4b72-ab8a-cbb07efbeb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:41.000215 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddb35b-37e6-4b72-ab8a-cbb07efbeb29 admin admin] PATH_INFO: `/v3/users/65a656b5540143d0aa65efe5eb82a7af` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:41.001337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddb35b-37e6-4b72-ab8a-cbb07efbeb29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a656b5540143d0aa65efe5eb82a7af)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:00:41.004089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddb35b-37e6-4b72-ab8a-cbb07efbeb29 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:00:41.191775 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-91ddb35b-37e6-4b72-ab8a-cbb07efbeb29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a656b5540143d0aa65efe5eb82a7af'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:41.257866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-91ddb35b-37e6-4b72-ab8a-cbb07efbeb29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a656b5540143d0aa65efe5eb82a7af'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:41.258806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-91ddb35b-37e6-4b72-ab8a-cbb07efbeb29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a656b5540143d0aa65efe5eb82a7af'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:41.272537 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-91ddb35b-37e6-4b72-ab8a-cbb07efbeb29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a656b5540143d0aa65efe5eb82a7af'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:41.279501 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-91ddb35b-37e6-4b72-ab8a-cbb07efbeb29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a656b5540143d0aa65efe5eb82a7af'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:41.285440 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1216/2428] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:00:40 2022] DELETE /identity/v3/users/65a656b5540143d0aa65efe5eb82a7af => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:00:41.530821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4e46c-e7e8-44cd-81ea-7bfe05fa90e9 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:00:41.532295 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-62c4e46c-e7e8-44cd-81ea-7bfe05fa90e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:00:41.545683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4e46c-e7e8-44cd-81ea-7bfe05fa90e9 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:00:41.606994 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8693b27-6bb3-49dc-a83d-fb012eaef821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:00:41.607665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8693b27-6bb3-49dc-a83d-fb012eaef821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:41.607944 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8693b27-6bb3-49dc-a83d-fb012eaef821 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:41.608216 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8693b27-6bb3-49dc-a83d-fb012eaef821 admin admin] PATH_INFO: `/v3/projects/1b0414d5c43d43c1b217a46cbefb7d8b` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:41.609398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8693b27-6bb3-49dc-a83d-fb012eaef821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b0414d5c43d43c1b217a46cbefb7d8b)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:00:41.611314 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8693b27-6bb3-49dc-a83d-fb012eaef821 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:00:41.726451 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d8693b27-6bb3-49dc-a83d-fb012eaef821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b0414d5c43d43c1b217a46cbefb7d8b', 'request_id': 'req-d8693b27-6bb3-49dc-a83d-fb012eaef821'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:41.800856 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d8693b27-6bb3-49dc-a83d-fb012eaef821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b0414d5c43d43c1b217a46cbefb7d8b', 'request_id': 'req-d8693b27-6bb3-49dc-a83d-fb012eaef821'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:41.809971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d8693b27-6bb3-49dc-a83d-fb012eaef821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b0414d5c43d43c1b217a46cbefb7d8b', 'request_id': 'req-d8693b27-6bb3-49dc-a83d-fb012eaef821'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:41.824710 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d8693b27-6bb3-49dc-a83d-fb012eaef821 admin admin] The token cache is being invalidate because project 1b0414d5c43d43c1b217a46cbefb7d8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:00:41.825002 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d8693b27-6bb3-49dc-a83d-fb012eaef821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:41.825664 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d8693b27-6bb3-49dc-a83d-fb012eaef821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:41.827139 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1213/2429] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:00:41 2022] DELETE /identity/v3/projects/1b0414d5c43d43c1b217a46cbefb7d8b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:00:41.832691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc36a17-72a8-4c4e-bb51-ae73a647de3a None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:41.833006 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc36a17-72a8-4c4e-bb51-ae73a647de3a None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:41.833281 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc36a17-72a8-4c4e-bb51-ae73a647de3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:41.853831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-2bc36a17-72a8-4c4e-bb51-ae73a647de3a None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:00:41.855042 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2bc36a17-72a8-4c4e-bb51-ae73a647de3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:00:41.918112 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1217/2430] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:00:41.926003 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a85c35-d139-4256-999a-e5cff44b0802 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:41.926293 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a85c35-d139-4256-999a-e5cff44b0802 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:41.926570 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a85c35-d139-4256-999a-e5cff44b0802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:41.950193 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-d7a85c35-d139-4256-999a-e5cff44b0802 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:00:41.951510 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d7a85c35-d139-4256-999a-e5cff44b0802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:00:41.960759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1214/2431] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:00:41.964620 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc36a17-72a8-4c4e-bb51-ae73a647de3a None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:00:41.975960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc36a17-72a8-4c4e-bb51-ae73a647de3a None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:00:41.982058 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfb3e8-03c9-4a87-b4ff-51df7514eff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:00:41.982678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfb3e8-03c9-4a87-b4ff-51df7514eff8 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:41.982954 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfb3e8-03c9-4a87-b4ff-51df7514eff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:41.983414 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfb3e8-03c9-4a87-b4ff-51df7514eff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:41.984341 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfb3e8-03c9-4a87-b4ff-51df7514eff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:00:41.984529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfb3e8-03c9-4a87-b4ff-51df7514eff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:00:41.986164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfb3e8-03c9-4a87-b4ff-51df7514eff8 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:00:42.001170 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1218/2432] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 20:00:42.006104 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a85c35-d139-4256-999a-e5cff44b0802 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:00:42.015856 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a85c35-d139-4256-999a-e5cff44b0802 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:00:42.020769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810d1a2-f436-4991-bab0-580a3f4e7cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:00:42.021622 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810d1a2-f436-4991-bab0-580a3f4e7cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:42.021906 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810d1a2-f436-4991-bab0-580a3f4e7cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:42.022190 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810d1a2-f436-4991-bab0-580a3f4e7cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:42.022842 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810d1a2-f436-4991-bab0-580a3f4e7cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:00:42.024789 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810d1a2-f436-4991-bab0-580a3f4e7cf1 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:00:42.117383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1215/2433] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:00:42 2022] POST /identity/v3/projects => generated 397 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:00:42.124834 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfb3e8-03c9-4a87-b4ff-51df7514eff8 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:00:42.132202 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfb3e8-03c9-4a87-b4ff-51df7514eff8 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:00:42.135744 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:42.187909 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301f9ff-9741-4596-afda-89552af3ca50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:00:42.188519 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301f9ff-9741-4596-afda-89552af3ca50 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:42.188795 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301f9ff-9741-4596-afda-89552af3ca50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:42.189070 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301f9ff-9741-4596-afda-89552af3ca50 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:42.189701 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301f9ff-9741-4596-afda-89552af3ca50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:00:42.192333 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301f9ff-9741-4596-afda-89552af3ca50 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:00:42.296979 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1219/2434] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:00:42 2022] POST /identity/v3/users => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:00:42.301708 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810d1a2-f436-4991-bab0-580a3f4e7cf1 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:00:42.312321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810d1a2-f436-4991-bab0-580a3f4e7cf1 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:00:42.317873 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cde996-ee36-4f5f-a77d-5b2d2e77c57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:00:42.318497 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cde996-ee36-4f5f-a77d-5b2d2e77c57f admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:42.318773 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cde996-ee36-4f5f-a77d-5b2d2e77c57f admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:42.319038 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cde996-ee36-4f5f-a77d-5b2d2e77c57f admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:42.319765 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cde996-ee36-4f5f-a77d-5b2d2e77c57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:00:42.322330 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cde996-ee36-4f5f-a77d-5b2d2e77c57f admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:00:42.331781 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1216/2435] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:00:42.335585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301f9ff-9741-4596-afda-89552af3ca50 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:00:42.345385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301f9ff-9741-4596-afda-89552af3ca50 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:00:42.351108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18889390-a2da-4330-a81f-837dd98a83ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:00:42.351775 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18889390-a2da-4330-a81f-837dd98a83ab admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:42.352056 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18889390-a2da-4330-a81f-837dd98a83ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:42.352327 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18889390-a2da-4330-a81f-837dd98a83ab admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:42.353253 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18889390-a2da-4330-a81f-837dd98a83ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:00:42.355138 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18889390-a2da-4330-a81f-837dd98a83ab admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:00:42.366969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1220/2436] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:00:42.370786 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cde996-ee36-4f5f-a77d-5b2d2e77c57f admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:00:42.380856 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cde996-ee36-4f5f-a77d-5b2d2e77c57f admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:00:42.385602 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ad2d5-25e5-4f6a-9a89-57917e03d25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:00:42.386265 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ad2d5-25e5-4f6a-9a89-57917e03d25e admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:42.386548 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ad2d5-25e5-4f6a-9a89-57917e03d25e admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:42.386825 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ad2d5-25e5-4f6a-9a89-57917e03d25e admin admin] PATH_INFO: `/v3/projects/99eebf649f374b21b5631275a5986461/users/530dd41bad9b4b538ae0cda45bcc0a06/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:42.401667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ad2d5-25e5-4f6a-9a89-57917e03d25e admin admin] RBAC: Authorizing `identity:create_grant(project_id=99eebf649f374b21b5631275a5986461, user_id=530dd41bad9b4b538ae0cda45bcc0a06, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:00:42.404391 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ad2d5-25e5-4f6a-9a89-57917e03d25e admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:00:42.526340 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1217/2437] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:00:42 2022] PUT /identity/v3/projects/99eebf649f374b21b5631275a5986461/users/530dd41bad9b4b538ae0cda45bcc0a06/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:00:42.537050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee811d38-70b5-4965-9d8b-d8a50b66d22f None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:42.537340 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee811d38-70b5-4965-9d8b-d8a50b66d22f None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:42.537618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee811d38-70b5-4965-9d8b-d8a50b66d22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:42.565567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-ee811d38-70b5-4965-9d8b-d8a50b66d22f None None] MFA Rules not processed for user `530dd41bad9b4b538ae0cda45bcc0a06`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:00:42.566824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ee811d38-70b5-4965-9d8b-d8a50b66d22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:00:42.633285 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1221/2438] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:00:42 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:00:42.645217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ad2d5-25e5-4f6a-9a89-57917e03d25e admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:00:42.647025 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b48ad2d5-25e5-4f6a-9a89-57917e03d25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:00:42.679160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:42.709042 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ad2d5-25e5-4f6a-9a89-57917e03d25e admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:00:42.712850 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2a4f8-8559-49cd-a757-c6081b8cbfff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:00:42.713471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2a4f8-8559-49cd-a757-c6081b8cbfff service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:42.713749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2a4f8-8559-49cd-a757-c6081b8cbfff service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:42.714022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2a4f8-8559-49cd-a757-c6081b8cbfff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:42.724078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2a4f8-8559-49cd-a757-c6081b8cbfff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:00:42.725550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2a4f8-8559-49cd-a757-c6081b8cbfff service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:00:42.734909 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1218/2439] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:00:42 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:00:45.132011 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0366e2-1b44-4c5d-b9a6-35e0d8e5729c None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:45.132573 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0366e2-1b44-4c5d-b9a6-35e0d8e5729c None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:45.132573 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0366e2-1b44-4c5d-b9a6-35e0d8e5729c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:45.152883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-ef0366e2-1b44-4c5d-b9a6-35e0d8e5729c None None] MFA Rules not processed for user `7e631060d3e0499d8df476f0b5096b3b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:00:45.154099 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ef0366e2-1b44-4c5d-b9a6-35e0d8e5729c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:00:45.209009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1222/2440] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:00:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:00:49.097658 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2a4f8-8559-49cd-a757-c6081b8cbfff service cinder] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:00:49.161683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2a4f8-8559-49cd-a757-c6081b8cbfff service cinder] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:00:49.166197 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f02c0-46fd-402b-9485-3a74b81bd65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:00:49.166827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f02c0-46fd-402b-9485-3a74b81bd65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:49.167104 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f02c0-46fd-402b-9485-3a74b81bd65e admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:49.167378 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f02c0-46fd-402b-9485-3a74b81bd65e admin admin] PATH_INFO: `/v3/users/530dd41bad9b4b538ae0cda45bcc0a06` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:49.168543 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f02c0-46fd-402b-9485-3a74b81bd65e admin admin] RBAC: Authorizing `identity:delete_user(user_id=530dd41bad9b4b538ae0cda45bcc0a06)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:00:49.170455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f02c0-46fd-402b-9485-3a74b81bd65e admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:00:49.291259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0366e2-1b44-4c5d-b9a6-35e0d8e5729c None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:00:49.292724 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ef0366e2-1b44-4c5d-b9a6-35e0d8e5729c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:00:49.314604 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:49.350340 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0366e2-1b44-4c5d-b9a6-35e0d8e5729c None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:00:49.354039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae802eec-d58a-4e19-8925-7986fac0c059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:00:49.354653 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae802eec-d58a-4e19-8925-7986fac0c059 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:49.354936 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae802eec-d58a-4e19-8925-7986fac0c059 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:49.355212 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae802eec-d58a-4e19-8925-7986fac0c059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:49.357355 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ae802eec-d58a-4e19-8925-7986fac0c059 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:00:49.409516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b04f02c0-46fd-402b-9485-3a74b81bd65e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '530dd41bad9b4b538ae0cda45bcc0a06'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:49.429556 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae802eec-d58a-4e19-8925-7986fac0c059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:00:49.430925 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae802eec-d58a-4e19-8925-7986fac0c059 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:00:49.442541 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1223/2441] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:00:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 20:00:49.504165 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b04f02c0-46fd-402b-9485-3a74b81bd65e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '530dd41bad9b4b538ae0cda45bcc0a06'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:49.504882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b04f02c0-46fd-402b-9485-3a74b81bd65e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '530dd41bad9b4b538ae0cda45bcc0a06'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:49.512667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b04f02c0-46fd-402b-9485-3a74b81bd65e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '530dd41bad9b4b538ae0cda45bcc0a06'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:49.525771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b04f02c0-46fd-402b-9485-3a74b81bd65e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '530dd41bad9b4b538ae0cda45bcc0a06'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:49.532069 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1219/2442] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:00:49 2022] DELETE /identity/v3/users/530dd41bad9b4b538ae0cda45bcc0a06 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:00:49.537632 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92ed61-2288-48cf-a954-bd7ea63a87d8 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:49.537919 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92ed61-2288-48cf-a954-bd7ea63a87d8 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:49.538200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92ed61-2288-48cf-a954-bd7ea63a87d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:49.568501 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-8c92ed61-2288-48cf-a954-bd7ea63a87d8 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:00:49.569855 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-8c92ed61-2288-48cf-a954-bd7ea63a87d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:00:49.633336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1224/2443] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:00:49.643034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f02c0-46fd-402b-9485-3a74b81bd65e admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:00:49.644624 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b04f02c0-46fd-402b-9485-3a74b81bd65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:00:49.652496 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92ed61-2288-48cf-a954-bd7ea63a87d8 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:00:49.654080 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-8c92ed61-2288-48cf-a954-bd7ea63a87d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:00:49.704187 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:49.708501 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f02c0-46fd-402b-9485-3a74b81bd65e admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:00:49.712189 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65582f90-a0a3-4e2b-b2d0-9b0dcc8c35cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:00:49.712794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65582f90-a0a3-4e2b-b2d0-9b0dcc8c35cc service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:49.713073 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65582f90-a0a3-4e2b-b2d0-9b0dcc8c35cc service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:49.713485 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65582f90-a0a3-4e2b-b2d0-9b0dcc8c35cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:49.715290 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92ed61-2288-48cf-a954-bd7ea63a87d8 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:00:49.718935 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50743afa-98b9-4ab1-870d-c75f91f0b44e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:00:49.719577 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50743afa-98b9-4ab1-870d-c75f91f0b44e service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:49.719862 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50743afa-98b9-4ab1-870d-c75f91f0b44e service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:49.720131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50743afa-98b9-4ab1-870d-c75f91f0b44e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:49.723054 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-50743afa-98b9-4ab1-870d-c75f91f0b44e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:00:49.723191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65582f90-a0a3-4e2b-b2d0-9b0dcc8c35cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:00:49.724692 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65582f90-a0a3-4e2b-b2d0-9b0dcc8c35cc service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:00:49.734559 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1220/2444] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:00:49.738807 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:49.797072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50743afa-98b9-4ab1-870d-c75f91f0b44e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:00:49.798504 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50743afa-98b9-4ab1-870d-c75f91f0b44e service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:00:49.811089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1225/2445] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:00:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 20:00:50.230112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65582f90-a0a3-4e2b-b2d0-9b0dcc8c35cc service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:00:50.231991 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-65582f90-a0a3-4e2b-b2d0-9b0dcc8c35cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:00:50.249544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65582f90-a0a3-4e2b-b2d0-9b0dcc8c35cc service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:00:50.266795 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb9901-7ac9-4ac8-9b46-970ecde3674b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:00:50.267482 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb9901-7ac9-4ac8-9b46-970ecde3674b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:00:50.267771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb9901-7ac9-4ac8-9b46-970ecde3674b admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:00:50.268048 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb9901-7ac9-4ac8-9b46-970ecde3674b admin admin] PATH_INFO: `/v3/projects/99eebf649f374b21b5631275a5986461` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:00:50.269297 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb9901-7ac9-4ac8-9b46-970ecde3674b admin admin] RBAC: Authorizing `identity:delete_project(project_id=99eebf649f374b21b5631275a5986461)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:00:50.271269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb9901-7ac9-4ac8-9b46-970ecde3674b admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:00:50.382606 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-44bb9901-7ac9-4ac8-9b46-970ecde3674b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99eebf649f374b21b5631275a5986461', 'request_id': 'req-44bb9901-7ac9-4ac8-9b46-970ecde3674b'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:50.452300 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-44bb9901-7ac9-4ac8-9b46-970ecde3674b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99eebf649f374b21b5631275a5986461', 'request_id': 'req-44bb9901-7ac9-4ac8-9b46-970ecde3674b'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:50.459492 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-44bb9901-7ac9-4ac8-9b46-970ecde3674b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99eebf649f374b21b5631275a5986461', 'request_id': 'req-44bb9901-7ac9-4ac8-9b46-970ecde3674b'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:50.471265 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-44bb9901-7ac9-4ac8-9b46-970ecde3674b admin admin] The token cache is being invalidate because project 99eebf649f374b21b5631275a5986461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:00:50.471532 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-44bb9901-7ac9-4ac8-9b46-970ecde3674b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:50.472404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-44bb9901-7ac9-4ac8-9b46-970ecde3674b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:00:50.473895 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1221/2446] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:00:50 2022] DELETE /identity/v3/projects/99eebf649f374b21b5631275a5986461 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:00:59.804759 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=26 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:00.467730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=31,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:00.528507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50743afa-98b9-4ab1-870d-c75f91f0b44e service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:00.530111 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-50743afa-98b9-4ab1-870d-c75f91f0b44e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:00.544202 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50743afa-98b9-4ab1-870d-c75f91f0b44e service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:00.608681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58ce35-a91f-4249-ad91-87abaf505de6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:00.609301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58ce35-a91f-4249-ad91-87abaf505de6 service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:00.609580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58ce35-a91f-4249-ad91-87abaf505de6 service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:00.609851 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58ce35-a91f-4249-ad91-87abaf505de6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:00.611595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-aa58ce35-a91f-4249-ad91-87abaf505de6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:00.670762 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58ce35-a91f-4249-ad91-87abaf505de6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:00.672318 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58ce35-a91f-4249-ad91-87abaf505de6 service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:00.683772 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1226/2447] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:01:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:01:02.257297 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb9901-7ac9-4ac8-9b46-970ecde3674b admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:02.258639 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-44bb9901-7ac9-4ac8-9b46-970ecde3674b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:02.275411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb9901-7ac9-4ac8-9b46-970ecde3674b admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:02.280949 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e9b54-5422-4a29-99f0-bbba3f0871e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:02.281554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e9b54-5422-4a29-99f0-bbba3f0871e3 service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:02.281838 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e9b54-5422-4a29-99f0-bbba3f0871e3 service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:02.282114 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e9b54-5422-4a29-99f0-bbba3f0871e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:02.284818 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-416e9b54-5422-4a29-99f0-bbba3f0871e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:02.343946 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e9b54-5422-4a29-99f0-bbba3f0871e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:02.345527 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e9b54-5422-4a29-99f0-bbba3f0871e3 service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:02.355867 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1222/2448] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:01:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:01:10.678001 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=56 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:12.351291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=28 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:12.773806 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06bbcd-fdbb-4460-93ab-12c77f53ffb1 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:12.774289 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06bbcd-fdbb-4460-93ab-12c77f53ffb1 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:12.774289 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06bbcd-fdbb-4460-93ab-12c77f53ffb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:12.794975 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-fe06bbcd-fdbb-4460-93ab-12c77f53ffb1 None None] MFA Rules not processed for user `15fbda6263b44352b3ac560372bef725`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:12.796245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-fe06bbcd-fdbb-4460-93ab-12c77f53ffb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:12.852990 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1227/2449] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Sep 14 20:01:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:01:13.015686 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e9b54-5422-4a29-99f0-bbba3f0871e3 service nova] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:13.017244 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-416e9b54-5422-4a29-99f0-bbba3f0871e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:13.092031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e9b54-5422-4a29-99f0-bbba3f0871e3 service nova] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:13.096990 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710f31c-39f7-4071-be96-53f42e5ef5eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee56bf9af257486e94e6ff1b33086f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:13.097592 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710f31c-39f7-4071-be96-53f42e5ef5eb service swift] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:13.097938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710f31c-39f7-4071-be96-53f42e5ef5eb service swift] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:13.098219 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710f31c-39f7-4071-be96-53f42e5ef5eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:13.106232 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710f31c-39f7-4071-be96-53f42e5ef5eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:13.108101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710f31c-39f7-4071-be96-53f42e5ef5eb service swift] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:13.116403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1223/2450] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Sep 14 20:01:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 20:01:22.057307 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06bbcd-fdbb-4460-93ab-12c77f53ffb1 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:22.075829 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06bbcd-fdbb-4460-93ab-12c77f53ffb1 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:22.091245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ccd66-8941-4105-8e7b-0635bf12fe29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:22.101901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ccd66-8941-4105-8e7b-0635bf12fe29 service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:22.102716 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ccd66-8941-4105-8e7b-0635bf12fe29 service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:22.103237 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ccd66-8941-4105-8e7b-0635bf12fe29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:22.116133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-106ccd66-8941-4105-8e7b-0635bf12fe29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:22.153048 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ccd66-8941-4105-8e7b-0635bf12fe29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:22.155179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ccd66-8941-4105-8e7b-0635bf12fe29 service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:22.201210 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1228/2451] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:01:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:01:22.273523 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710f31c-39f7-4071-be96-53f42e5ef5eb service swift] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:22.276158 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f710f31c-39f7-4071-be96-53f42e5ef5eb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:22.499224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710f31c-39f7-4071-be96-53f42e5ef5eb service swift] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:22.512298 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d983d43-f70c-445e-ae97-3cec84ee5b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:22.512954 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d983d43-f70c-445e-ae97-3cec84ee5b89 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:22.513234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d983d43-f70c-445e-ae97-3cec84ee5b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:22.513515 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d983d43-f70c-445e-ae97-3cec84ee5b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:22.518422 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-6d983d43-f70c-445e-ae97-3cec84ee5b89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:22.561352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d983d43-f70c-445e-ae97-3cec84ee5b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:22.563226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d983d43-f70c-445e-ae97-3cec84ee5b89 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:22.594959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1224/2452] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:01:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:01:22.746144 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ccd66-8941-4105-8e7b-0635bf12fe29 service nova] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:22.747777 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-106ccd66-8941-4105-8e7b-0635bf12fe29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:22.778981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ccd66-8941-4105-8e7b-0635bf12fe29 service nova] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:22.792455 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a019f-3710-4c74-8d18-a61989c13cf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:22.793503 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a019f-3710-4c74-8d18-a61989c13cf6 service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:22.793966 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a019f-3710-4c74-8d18-a61989c13cf6 service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:22.794402 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a019f-3710-4c74-8d18-a61989c13cf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:22.796880 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-6f3a019f-3710-4c74-8d18-a61989c13cf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:22.818647 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a019f-3710-4c74-8d18-a61989c13cf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:22.820570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a019f-3710-4c74-8d18-a61989c13cf6 service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:22.839426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1229/2453] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:01:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:01:30.701785 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d983d43-f70c-445e-ae97-3cec84ee5b89 service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:30.710949 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d983d43-f70c-445e-ae97-3cec84ee5b89 service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:30.714711 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365268a-34c0-4007-a4c1-dbc53e2f1411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:30.715388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365268a-34c0-4007-a4c1-dbc53e2f1411 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:30.715801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365268a-34c0-4007-a4c1-dbc53e2f1411 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:30.716143 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365268a-34c0-4007-a4c1-dbc53e2f1411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:30.718104 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-2365268a-34c0-4007-a4c1-dbc53e2f1411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:30.784046 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365268a-34c0-4007-a4c1-dbc53e2f1411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:30.785517 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365268a-34c0-4007-a4c1-dbc53e2f1411 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:30.796031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1225/2454] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:01:31.573419 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a019f-3710-4c74-8d18-a61989c13cf6 service nova] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:31.587524 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a019f-3710-4c74-8d18-a61989c13cf6 service nova] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:31.594263 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22d2b7-c326-42f0-a24c-512114e912ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:31.595239 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22d2b7-c326-42f0-a24c-512114e912ed service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:31.595761 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22d2b7-c326-42f0-a24c-512114e912ed service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:31.596189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22d2b7-c326-42f0-a24c-512114e912ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:31.598699 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-af22d2b7-c326-42f0-a24c-512114e912ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:31.616468 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22d2b7-c326-42f0-a24c-512114e912ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:31.618333 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22d2b7-c326-42f0-a24c-512114e912ed service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:31.644422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1230/2455] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:01:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:01:34.625520 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f606b0f-b383-4092-bb68-53e2b8a98f0f None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:34.626098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f606b0f-b383-4092-bb68-53e2b8a98f0f None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:34.626202 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f606b0f-b383-4092-bb68-53e2b8a98f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:34.632322 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22d2b7-c326-42f0-a24c-512114e912ed service nova] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:34.651110 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22d2b7-c326-42f0-a24c-512114e912ed service nova] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:34.655602 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-8f606b0f-b383-4092-bb68-53e2b8a98f0f None None] MFA Rules not processed for user `15fbda6263b44352b3ac560372bef725`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:34.656167 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e9fa4-8126-4c5c-8e54-0d5409a344b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:34.657025 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-8f606b0f-b383-4092-bb68-53e2b8a98f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:34.657594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e9fa4-8126-4c5c-8e54-0d5409a344b9 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:34.658042 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e9fa4-8126-4c5c-8e54-0d5409a344b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:34.658480 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e9fa4-8126-4c5c-8e54-0d5409a344b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:34.660794 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-827e9fa4-8126-4c5c-8e54-0d5409a344b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:34.671768 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1226/2456] 10.222.0.15 () {58 vars in 967 bytes} [Wed Sep 14 20:01:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:01:34.673591 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e9fa4-8126-4c5c-8e54-0d5409a344b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:34.675223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e9fa4-8126-4c5c-8e54-0d5409a344b9 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:34.680788 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f606b0f-b383-4092-bb68-53e2b8a98f0f None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:34.687187 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1231/2457] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:01:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:01:34.695457 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f606b0f-b383-4092-bb68-53e2b8a98f0f None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:34.702338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e5f92-b737-4135-b575-941d913efc39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee56bf9af257486e94e6ff1b33086f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:34.703004 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e5f92-b737-4135-b575-941d913efc39 service swift] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:34.703278 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e5f92-b737-4135-b575-941d913efc39 service swift] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:34.703567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e5f92-b737-4135-b575-941d913efc39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:34.715620 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e5f92-b737-4135-b575-941d913efc39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:34.717485 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e5f92-b737-4135-b575-941d913efc39 service swift] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:34.727126 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1227/2458] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Sep 14 20:01:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 20:01:35.242736 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afb066-c498-4c09-ad10-aa47602e6d49 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:35.243034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afb066-c498-4c09-ad10-aa47602e6d49 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:35.243415 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afb066-c498-4c09-ad10-aa47602e6d49 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:35.245188 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1232/2459] 10.222.0.15 () {54 vars in 921 bytes} [Wed Sep 14 20:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 20:01:35.252273 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79491040-11a2-4c9b-b9ec-24fb1d18fed4 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:35.252554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79491040-11a2-4c9b-b9ec-24fb1d18fed4 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:35.253004 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79491040-11a2-4c9b-b9ec-24fb1d18fed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:35.277309 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:35.283968 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-79491040-11a2-4c9b-b9ec-24fb1d18fed4 None None] MFA Rules not processed for user `421f6cc846b342918a177d2794eb3db8`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:35.285314 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-79491040-11a2-4c9b-b9ec-24fb1d18fed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:35.297452 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1228/2460] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Sep 14 20:01:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:01:35.309732 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afb066-c498-4c09-ad10-aa47602e6d49 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:35.313061 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-44afb066-c498-4c09-ad10-aa47602e6d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:35.412050 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afb066-c498-4c09-ad10-aa47602e6d49 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:35.416702 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b902a0-13a6-4d54-8acc-8414cbbcbfec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2faa7ffc99948478ec7b81842139078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:35.417399 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b902a0-13a6-4d54-8acc-8414cbbcbfec service glance] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:35.417779 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b902a0-13a6-4d54-8acc-8414cbbcbfec service glance] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:35.418243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b902a0-13a6-4d54-8acc-8414cbbcbfec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:35.438542 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b902a0-13a6-4d54-8acc-8414cbbcbfec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:35.442453 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b902a0-13a6-4d54-8acc-8414cbbcbfec service glance] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:35.473380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1233/2461] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:01:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:01:35.733776 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc67d8-d603-4bdb-bfe8-6aa5e87be5e7 None None] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:35.734565 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc67d8-d603-4bdb-bfe8-6aa5e87be5e7 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:35.735025 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc67d8-d603-4bdb-bfe8-6aa5e87be5e7 None None] PATH_INFO: `/` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:35.738464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1229/2462] 10.222.0.15 () {54 vars in 921 bytes} [Wed Sep 14 20:01:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 20:01:35.745171 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c88f1-087a-43e9-8bdc-5e3767b6de39 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:35.746027 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c88f1-087a-43e9-8bdc-5e3767b6de39 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:35.746773 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c88f1-087a-43e9-8bdc-5e3767b6de39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:35.804461 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-ee2c88f1-087a-43e9-8bdc-5e3767b6de39 None None] MFA Rules not processed for user `221300017882415ca3a7c9192343b956`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:35.805820 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ee2c88f1-087a-43e9-8bdc-5e3767b6de39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:35.813165 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1234/2463] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Sep 14 20:01:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:01:35.825377 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc67d8-d603-4bdb-bfe8-6aa5e87be5e7 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:35.837076 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc67d8-d603-4bdb-bfe8-6aa5e87be5e7 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:35.841367 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e01a41-defb-404e-ac5c-5496e8dee93a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:35.842004 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e01a41-defb-404e-ac5c-5496e8dee93a service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:35.842283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e01a41-defb-404e-ac5c-5496e8dee93a service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:35.842684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e01a41-defb-404e-ac5c-5496e8dee93a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:35.850754 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e01a41-defb-404e-ac5c-5496e8dee93a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:35.852232 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e01a41-defb-404e-ac5c-5496e8dee93a service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:35.862461 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1230/2464] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:01:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:01:35.967583 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53291f63-c075-4146-9ccc-c9c5c8fca627 None None] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:35.968214 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53291f63-c075-4146-9ccc-c9c5c8fca627 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:35.968214 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53291f63-c075-4146-9ccc-c9c5c8fca627 None None] PATH_INFO: `/` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:35.969543 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1235/2465] 10.222.0.15 () {54 vars in 921 bytes} [Wed Sep 14 20:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 20:01:35.975184 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bb12c-9c81-42c3-bc90-eef86ac0f9e3 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:35.975505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bb12c-9c81-42c3-bc90-eef86ac0f9e3 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:35.975806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bb12c-9c81-42c3-bc90-eef86ac0f9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:35.996895 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-405bb12c-9c81-42c3-bc90-eef86ac0f9e3 None None] MFA Rules not processed for user `421f6cc846b342918a177d2794eb3db8`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:35.997293 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-405bb12c-9c81-42c3-bc90-eef86ac0f9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:36.007480 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1231/2466] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Sep 14 20:01:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:01:36.019657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53291f63-c075-4146-9ccc-c9c5c8fca627 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:36.022347 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-53291f63-c075-4146-9ccc-c9c5c8fca627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:36.034926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bb12c-9c81-42c3-bc90-eef86ac0f9e3 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:36.038648 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-405bb12c-9c81-42c3-bc90-eef86ac0f9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:36.039116 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53291f63-c075-4146-9ccc-c9c5c8fca627 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:36.044823 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cca1b-baa1-4d2f-8a31-d40ed393ec37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:36.045486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cca1b-baa1-4d2f-8a31-d40ed393ec37 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:36.045762 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cca1b-baa1-4d2f-8a31-d40ed393ec37 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:36.046109 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cca1b-baa1-4d2f-8a31-d40ed393ec37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:36.056957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bb12c-9c81-42c3-bc90-eef86ac0f9e3 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:36.058228 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cca1b-baa1-4d2f-8a31-d40ed393ec37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:36.059734 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cca1b-baa1-4d2f-8a31-d40ed393ec37 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:36.062423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a2dc7-5624-4a12-b501-2c0031702a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:36.063184 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a2dc7-5624-4a12-b501-2c0031702a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:36.063467 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a2dc7-5624-4a12-b501-2c0031702a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:36.063772 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a2dc7-5624-4a12-b501-2c0031702a6c admin admin] PATH_INFO: `/v3/users/983e57be9b214d788dc3a69da22a174e` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:36.065055 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a2dc7-5624-4a12-b501-2c0031702a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=983e57be9b214d788dc3a69da22a174e)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:36.067942 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a2dc7-5624-4a12-b501-2c0031702a6c admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:36.071954 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1236/2467] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:01:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:01:36.141848 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cca1b-baa1-4d2f-8a31-d40ed393ec37 service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:36.143520 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-315cca1b-baa1-4d2f-8a31-d40ed393ec37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:36.187864 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:36.217435 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cca1b-baa1-4d2f-8a31-d40ed393ec37 service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:36.222664 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae76f64-b18e-4ce9-973a-127160cf2c86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6942a851a69b446e90a2b138f4482465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:36.223398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae76f64-b18e-4ce9-973a-127160cf2c86 service placement] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:36.223790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae76f64-b18e-4ce9-973a-127160cf2c86 service placement] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:36.224074 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae76f64-b18e-4ce9-973a-127160cf2c86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:36.225872 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-1ae76f64-b18e-4ce9-973a-127160cf2c86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:36.237968 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae76f64-b18e-4ce9-973a-127160cf2c86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:36.241128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae76f64-b18e-4ce9-973a-127160cf2c86 service placement] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:36.252614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1237/2468] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:01:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 20:01:36.254124 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-ca4a2dc7-5624-4a12-b501-2c0031702a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '983e57be9b214d788dc3a69da22a174e'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:36.337464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-ca4a2dc7-5624-4a12-b501-2c0031702a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '983e57be9b214d788dc3a69da22a174e'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:36.342553 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-ca4a2dc7-5624-4a12-b501-2c0031702a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '983e57be9b214d788dc3a69da22a174e'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:36.353790 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-ca4a2dc7-5624-4a12-b501-2c0031702a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '983e57be9b214d788dc3a69da22a174e'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:36.375062 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-ca4a2dc7-5624-4a12-b501-2c0031702a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '983e57be9b214d788dc3a69da22a174e'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:36.396285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1232/2469] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:01:36 2022] DELETE /identity/v3/users/983e57be9b214d788dc3a69da22a174e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:01:36.967537 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae76f64-b18e-4ce9-973a-127160cf2c86 service placement] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:36.978687 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae76f64-b18e-4ce9-973a-127160cf2c86 service placement] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:37.059147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ad99b-3063-4978-b643-8f46b06345d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:37.060453 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ad99b-3063-4978-b643-8f46b06345d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:37.061036 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ad99b-3063-4978-b643-8f46b06345d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:37.061474 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ad99b-3063-4978-b643-8f46b06345d4 admin admin] PATH_INFO: `/v3/projects/588b092767bc4a8cb15638dc89f23966` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:37.063059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ad99b-3063-4978-b643-8f46b06345d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=588b092767bc4a8cb15638dc89f23966)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:37.065291 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ad99b-3063-4978-b643-8f46b06345d4 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:37.221984 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-342ad99b-3063-4978-b643-8f46b06345d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '588b092767bc4a8cb15638dc89f23966', 'request_id': 'req-342ad99b-3063-4978-b643-8f46b06345d4'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:37.365901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-342ad99b-3063-4978-b643-8f46b06345d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '588b092767bc4a8cb15638dc89f23966', 'request_id': 'req-342ad99b-3063-4978-b643-8f46b06345d4'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:37.373885 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-342ad99b-3063-4978-b643-8f46b06345d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '588b092767bc4a8cb15638dc89f23966', 'request_id': 'req-342ad99b-3063-4978-b643-8f46b06345d4'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:37.386954 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-342ad99b-3063-4978-b643-8f46b06345d4 admin admin] The token cache is being invalidate because project 588b092767bc4a8cb15638dc89f23966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:01:37.387805 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-342ad99b-3063-4978-b643-8f46b06345d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:37.388858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-342ad99b-3063-4978-b643-8f46b06345d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:37.393286 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1238/2470] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:01:36 2022] DELETE /identity/v3/projects/588b092767bc4a8cb15638dc89f23966 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:01:37.399685 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee0592-3d5b-4ac9-888d-5784ef04b1bc None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:37.407319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee0592-3d5b-4ac9-888d-5784ef04b1bc None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:37.407319 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee0592-3d5b-4ac9-888d-5784ef04b1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:37.420058 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-02ee0592-3d5b-4ac9-888d-5784ef04b1bc None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:37.421248 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-02ee0592-3d5b-4ac9-888d-5784ef04b1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:37.479866 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1233/2471] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:01:37.488526 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fdf6c-00eb-4a1f-91f4-f3ab4890a835 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:37.488912 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fdf6c-00eb-4a1f-91f4-f3ab4890a835 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:37.489316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fdf6c-00eb-4a1f-91f4-f3ab4890a835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:37.508805 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-1a8fdf6c-00eb-4a1f-91f4-f3ab4890a835 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:37.509981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-1a8fdf6c-00eb-4a1f-91f4-f3ab4890a835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:37.517796 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1239/2472] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:01:37.523260 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee0592-3d5b-4ac9-888d-5784ef04b1bc None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:37.533197 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee0592-3d5b-4ac9-888d-5784ef04b1bc None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:37.538509 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad8f1d-f0d5-40df-bb9b-9fa49b1621a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:37.539151 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad8f1d-f0d5-40df-bb9b-9fa49b1621a3 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:37.539413 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad8f1d-f0d5-40df-bb9b-9fa49b1621a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:37.539711 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad8f1d-f0d5-40df-bb9b-9fa49b1621a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:37.540790 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad8f1d-f0d5-40df-bb9b-9fa49b1621a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:01:37.541095 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad8f1d-f0d5-40df-bb9b-9fa49b1621a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:37.542712 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad8f1d-f0d5-40df-bb9b-9fa49b1621a3 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:37.555426 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1234/2473] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 20:01:37.561067 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fdf6c-00eb-4a1f-91f4-f3ab4890a835 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:37.571974 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fdf6c-00eb-4a1f-91f4-f3ab4890a835 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:37.578578 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca763bd5-ff2f-4976-8c25-86ff9e18043b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:37.579687 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca763bd5-ff2f-4976-8c25-86ff9e18043b admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:37.580138 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca763bd5-ff2f-4976-8c25-86ff9e18043b admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:37.580418 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca763bd5-ff2f-4976-8c25-86ff9e18043b admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:37.581097 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca763bd5-ff2f-4976-8c25-86ff9e18043b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:37.583891 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca763bd5-ff2f-4976-8c25-86ff9e18043b admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:37.702194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1240/2474] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:01:37 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:01:37.706529 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad8f1d-f0d5-40df-bb9b-9fa49b1621a3 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:37.720542 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad8f1d-f0d5-40df-bb9b-9fa49b1621a3 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:37.770830 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:37.795024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3eae5-4d50-4f16-8de7-56c7ea67456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:37.795781 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3eae5-4d50-4f16-8de7-56c7ea67456d admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:37.796133 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3eae5-4d50-4f16-8de7-56c7ea67456d admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:37.796482 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3eae5-4d50-4f16-8de7-56c7ea67456d admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:37.797193 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3eae5-4d50-4f16-8de7-56c7ea67456d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:37.799183 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3eae5-4d50-4f16-8de7-56c7ea67456d admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:37.940165 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1235/2475] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:01:37 2022] POST /identity/v3/users => generated 288 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:01:37.942889 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca763bd5-ff2f-4976-8c25-86ff9e18043b admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:37.954286 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca763bd5-ff2f-4976-8c25-86ff9e18043b admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:37.962601 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecdb26-dae3-4acf-831a-ef8017e6c322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:37.963575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecdb26-dae3-4acf-831a-ef8017e6c322 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:37.963575 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecdb26-dae3-4acf-831a-ef8017e6c322 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:37.973131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecdb26-dae3-4acf-831a-ef8017e6c322 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:37.973131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ecdb26-dae3-4acf-831a-ef8017e6c322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:37.973131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ecdb26-dae3-4acf-831a-ef8017e6c322 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:37.980421 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1241/2476] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:01:37.984883 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3eae5-4d50-4f16-8de7-56c7ea67456d admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:37.997702 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3eae5-4d50-4f16-8de7-56c7ea67456d admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:38.013526 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3415c66-b871-441e-adfa-9f10295e03bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:38.014471 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3415c66-b871-441e-adfa-9f10295e03bc admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:38.022410 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3415c66-b871-441e-adfa-9f10295e03bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:38.022709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3415c66-b871-441e-adfa-9f10295e03bc admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:38.025150 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3415c66-b871-441e-adfa-9f10295e03bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:38.030634 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3415c66-b871-441e-adfa-9f10295e03bc admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:38.047780 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1236/2477] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:01:38.051689 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecdb26-dae3-4acf-831a-ef8017e6c322 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:38.066369 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecdb26-dae3-4acf-831a-ef8017e6c322 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:38.075736 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd05b99-3a21-4377-805e-c1a86cc831da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:38.076693 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd05b99-3a21-4377-805e-c1a86cc831da admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:38.077161 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd05b99-3a21-4377-805e-c1a86cc831da admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:38.078556 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd05b99-3a21-4377-805e-c1a86cc831da admin admin] PATH_INFO: `/v3/projects/9870f491b51e401481db688d34da0a9d/users/03b480e2d0ec4ce7b08eed3b722b0397/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:38.099969 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:38.104382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd05b99-3a21-4377-805e-c1a86cc831da admin admin] RBAC: Authorizing `identity:create_grant(project_id=9870f491b51e401481db688d34da0a9d, user_id=03b480e2d0ec4ce7b08eed3b722b0397, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:38.108091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd05b99-3a21-4377-805e-c1a86cc831da admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:38.283393 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1242/2478] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:01:38 2022] PUT /identity/v3/projects/9870f491b51e401481db688d34da0a9d/users/03b480e2d0ec4ce7b08eed3b722b0397/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:01:38.302032 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8301d2c-a2c1-46ba-8858-74747aa673e3 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:38.302326 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8301d2c-a2c1-46ba-8858-74747aa673e3 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:38.302603 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8301d2c-a2c1-46ba-8858-74747aa673e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:38.343342 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-f8301d2c-a2c1-46ba-8858-74747aa673e3 None None] MFA Rules not processed for user `03b480e2d0ec4ce7b08eed3b722b0397`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:38.344953 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f8301d2c-a2c1-46ba-8858-74747aa673e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:38.446764 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1237/2479] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:01:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:01:38.458847 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd05b99-3a21-4377-805e-c1a86cc831da admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:38.461447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-0cd05b99-3a21-4377-805e-c1a86cc831da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:38.593776 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd05b99-3a21-4377-805e-c1a86cc831da admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:38.600729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca73c1-0c92-4e74-bd7d-881196ce9552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:38.601388 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca73c1-0c92-4e74-bd7d-881196ce9552 service nova] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:38.601733 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca73c1-0c92-4e74-bd7d-881196ce9552 service nova] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:38.602197 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca73c1-0c92-4e74-bd7d-881196ce9552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:38.611335 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca73c1-0c92-4e74-bd7d-881196ce9552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:38.613039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca73c1-0c92-4e74-bd7d-881196ce9552 service nova] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:38.623300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1243/2480] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:01:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:01:38.930898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8301d2c-a2c1-46ba-8858-74747aa673e3 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:39.028546 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8301d2c-a2c1-46ba-8858-74747aa673e3 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:39.034099 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002a359-68be-4ccc-a324-dd123f5346c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:39.035216 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002a359-68be-4ccc-a324-dd123f5346c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:39.035565 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002a359-68be-4ccc-a324-dd123f5346c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:39.036482 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002a359-68be-4ccc-a324-dd123f5346c1 admin admin] PATH_INFO: `/v3/users/03b480e2d0ec4ce7b08eed3b722b0397` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:39.037165 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002a359-68be-4ccc-a324-dd123f5346c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03b480e2d0ec4ce7b08eed3b722b0397)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:39.039128 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002a359-68be-4ccc-a324-dd123f5346c1 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:39.397348 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b002a359-68be-4ccc-a324-dd123f5346c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03b480e2d0ec4ce7b08eed3b722b0397'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:39.411284 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:39.593787 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b002a359-68be-4ccc-a324-dd123f5346c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03b480e2d0ec4ce7b08eed3b722b0397'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:39.596970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b002a359-68be-4ccc-a324-dd123f5346c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03b480e2d0ec4ce7b08eed3b722b0397'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:39.606677 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b002a359-68be-4ccc-a324-dd123f5346c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03b480e2d0ec4ce7b08eed3b722b0397'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:39.628905 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b002a359-68be-4ccc-a324-dd123f5346c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03b480e2d0ec4ce7b08eed3b722b0397'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:39.640901 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1238/2481] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:01:38 2022] DELETE /identity/v3/users/03b480e2d0ec4ce7b08eed3b722b0397 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:01:39.646047 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b3ac1-3ac1-4015-b40a-c7d1ec8b06ef None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:39.647015 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b3ac1-3ac1-4015-b40a-c7d1ec8b06ef None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:39.647507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b3ac1-3ac1-4015-b40a-c7d1ec8b06ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:39.672271 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-296b3ac1-3ac1-4015-b40a-c7d1ec8b06ef None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:39.673515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-296b3ac1-3ac1-4015-b40a-c7d1ec8b06ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:39.748509 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1244/2482] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:01:39.761618 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002a359-68be-4ccc-a324-dd123f5346c1 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:39.763192 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b002a359-68be-4ccc-a324-dd123f5346c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:39.849983 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002a359-68be-4ccc-a324-dd123f5346c1 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:39.872663 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a60cda-a96b-4d9b-9b9d-dab5375463a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:39.875751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a60cda-a96b-4d9b-9b9d-dab5375463a5 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:39.875751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a60cda-a96b-4d9b-9b9d-dab5375463a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:39.875751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a60cda-a96b-4d9b-9b9d-dab5375463a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:39.892605 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a60cda-a96b-4d9b-9b9d-dab5375463a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:39.895597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a60cda-a96b-4d9b-9b9d-dab5375463a5 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:39.913328 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1239/2483] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:01:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:01:40.706383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b3ac1-3ac1-4015-b40a-c7d1ec8b06ef None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:40.708815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-296b3ac1-3ac1-4015-b40a-c7d1ec8b06ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:40.724396 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b3ac1-3ac1-4015-b40a-c7d1ec8b06ef None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:40.732772 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4920be-7bc1-41d8-a3e3-7932c0b479a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:40.733436 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4920be-7bc1-41d8-a3e3-7932c0b479a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:40.734445 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4920be-7bc1-41d8-a3e3-7932c0b479a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:40.734720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4920be-7bc1-41d8-a3e3-7932c0b479a8 admin admin] PATH_INFO: `/v3/projects/9870f491b51e401481db688d34da0a9d` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:40.736337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4920be-7bc1-41d8-a3e3-7932c0b479a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9870f491b51e401481db688d34da0a9d)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:40.739653 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4920be-7bc1-41d8-a3e3-7932c0b479a8 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:40.866226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ae572-ff3b-4fd0-9fd5-a24768af56a9 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:40.867087 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ae572-ff3b-4fd0-9fd5-a24768af56a9 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:40.867372 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ae572-ff3b-4fd0-9fd5-a24768af56a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:40.887991 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-f55ae572-ff3b-4fd0-9fd5-a24768af56a9 None None] MFA Rules not processed for user `15fbda6263b44352b3ac560372bef725`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:40.889978 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f55ae572-ff3b-4fd0-9fd5-a24768af56a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:40.924770 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1d4920be-7bc1-41d8-a3e3-7932c0b479a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9870f491b51e401481db688d34da0a9d', 'request_id': 'req-1d4920be-7bc1-41d8-a3e3-7932c0b479a8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:40.963892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1240/2484] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Sep 14 20:01:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:01:40.979916 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ae572-ff3b-4fd0-9fd5-a24768af56a9 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:40.981278 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f55ae572-ff3b-4fd0-9fd5-a24768af56a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:41.056758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1d4920be-7bc1-41d8-a3e3-7932c0b479a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9870f491b51e401481db688d34da0a9d', 'request_id': 'req-1d4920be-7bc1-41d8-a3e3-7932c0b479a8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:41.065109 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1d4920be-7bc1-41d8-a3e3-7932c0b479a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9870f491b51e401481db688d34da0a9d', 'request_id': 'req-1d4920be-7bc1-41d8-a3e3-7932c0b479a8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:41.082085 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:41.088542 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1d4920be-7bc1-41d8-a3e3-7932c0b479a8 admin admin] The token cache is being invalidate because project 9870f491b51e401481db688d34da0a9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:01:41.088995 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1d4920be-7bc1-41d8-a3e3-7932c0b479a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:41.089678 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ae572-ff3b-4fd0-9fd5-a24768af56a9 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:41.090147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1d4920be-7bc1-41d8-a3e3-7932c0b479a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:41.092476 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1245/2485] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:01:40 2022] DELETE /identity/v3/projects/9870f491b51e401481db688d34da0a9d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:01:41.099670 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdca3f5-eb1f-4f71-aaa5-3025bb3c1a85 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:41.100880 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdca3f5-eb1f-4f71-aaa5-3025bb3c1a85 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:41.101826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdca3f5-eb1f-4f71-aaa5-3025bb3c1a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:41.117554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:41.138430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-3fdca3f5-eb1f-4f71-aaa5-3025bb3c1a85 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:41.141356 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-3fdca3f5-eb1f-4f71-aaa5-3025bb3c1a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:41.269129 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1246/2486] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:01:41.273281 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e9d63-f2a0-4e0e-b742-463142ac6f40 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:41.275965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e9d63-f2a0-4e0e-b742-463142ac6f40 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:41.276250 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e9d63-f2a0-4e0e-b742-463142ac6f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:41.307611 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12199693-3c7f-4637-adeb-d28416871e48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee56bf9af257486e94e6ff1b33086f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:41.308360 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12199693-3c7f-4637-adeb-d28416871e48 service swift] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:41.308738 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12199693-3c7f-4637-adeb-d28416871e48 service swift] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:41.309107 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12199693-3c7f-4637-adeb-d28416871e48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:41.314639 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-12199693-3c7f-4637-adeb-d28416871e48 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:41.322632 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-235e9d63-f2a0-4e0e-b742-463142ac6f40 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:41.324591 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-235e9d63-f2a0-4e0e-b742-463142ac6f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:41.346534 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1247/2487] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:01:41.351951 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e9d63-f2a0-4e0e-b742-463142ac6f40 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:41.366009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e9d63-f2a0-4e0e-b742-463142ac6f40 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:41.387336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6761f6-0421-4ee2-96e7-d9049582e050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:41.388318 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6761f6-0421-4ee2-96e7-d9049582e050 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:41.389242 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6761f6-0421-4ee2-96e7-d9049582e050 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:41.389531 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6761f6-0421-4ee2-96e7-d9049582e050 admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:41.390206 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6761f6-0421-4ee2-96e7-d9049582e050 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:01:41.390514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6761f6-0421-4ee2-96e7-d9049582e050 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:41.392376 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6761f6-0421-4ee2-96e7-d9049582e050 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:41.408637 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1248/2488] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 20:01:41.413113 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6761f6-0421-4ee2-96e7-d9049582e050 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:41.413459 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12199693-3c7f-4637-adeb-d28416871e48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:41.417948 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12199693-3c7f-4637-adeb-d28416871e48 service swift] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:41.424354 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6761f6-0421-4ee2-96e7-d9049582e050 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:41.432548 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26141cf1-7401-4856-9474-7ae8a906f420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:41.433395 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26141cf1-7401-4856-9474-7ae8a906f420 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:41.433855 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26141cf1-7401-4856-9474-7ae8a906f420 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:41.434298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26141cf1-7401-4856-9474-7ae8a906f420 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:41.435095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26141cf1-7401-4856-9474-7ae8a906f420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:41.437963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26141cf1-7401-4856-9474-7ae8a906f420 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:41.439450 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1241/2489] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Sep 14 20:01:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 20:01:41.542851 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1249/2490] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:01:41 2022] POST /identity/v3/projects => generated 389 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 20:01:41.545807 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12199693-3c7f-4637-adeb-d28416871e48 service swift] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:41.556612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12199693-3c7f-4637-adeb-d28416871e48 service swift] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:41.655675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249fd6af-cfd0-4d66-8fd1-cc7531a96a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:41.657411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fd6af-cfd0-4d66-8fd1-cc7531a96a0e admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:41.658055 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fd6af-cfd0-4d66-8fd1-cc7531a96a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:41.659143 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fd6af-cfd0-4d66-8fd1-cc7531a96a0e admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:41.659940 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249fd6af-cfd0-4d66-8fd1-cc7531a96a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:41.666307 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249fd6af-cfd0-4d66-8fd1-cc7531a96a0e admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:41.815355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1242/2491] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:01:41 2022] POST /identity/v3/users => generated 295 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:01:41.820563 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26141cf1-7401-4856-9474-7ae8a906f420 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:41.840140 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26141cf1-7401-4856-9474-7ae8a906f420 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:41.848282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a668c-91a4-4cb5-a844-5bffc13b4901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:41.850448 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a668c-91a4-4cb5-a844-5bffc13b4901 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:41.851570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a668c-91a4-4cb5-a844-5bffc13b4901 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:41.852127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a668c-91a4-4cb5-a844-5bffc13b4901 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:41.852976 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a668c-91a4-4cb5-a844-5bffc13b4901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:41.866750 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a668c-91a4-4cb5-a844-5bffc13b4901 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:41.890457 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1250/2492] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:01:41.890990 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249fd6af-cfd0-4d66-8fd1-cc7531a96a0e admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:41.918083 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249fd6af-cfd0-4d66-8fd1-cc7531a96a0e admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:41.929131 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad1ff2-6dd3-412f-a8c9-4f54767db12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:41.930009 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad1ff2-6dd3-412f-a8c9-4f54767db12b admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:41.930552 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad1ff2-6dd3-412f-a8c9-4f54767db12b admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:41.931050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad1ff2-6dd3-412f-a8c9-4f54767db12b admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:41.932621 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad1ff2-6dd3-412f-a8c9-4f54767db12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:41.934395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad1ff2-6dd3-412f-a8c9-4f54767db12b admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:41.955684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1243/2493] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:01:41.960693 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a668c-91a4-4cb5-a844-5bffc13b4901 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:41.976430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a668c-91a4-4cb5-a844-5bffc13b4901 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:41.993357 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d9f3b-b1dd-4aae-a42e-97271c553bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:41.994308 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d9f3b-b1dd-4aae-a42e-97271c553bb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:41.994788 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d9f3b-b1dd-4aae-a42e-97271c553bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:41.995255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d9f3b-b1dd-4aae-a42e-97271c553bb4 admin admin] PATH_INFO: `/v3/projects/1af3f709be724e6eb141fccc9721c5bb/users/9b6d8ceab2c54b37a387ffa89e668728/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:42.028025 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d9f3b-b1dd-4aae-a42e-97271c553bb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af3f709be724e6eb141fccc9721c5bb, user_id=9b6d8ceab2c54b37a387ffa89e668728, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:42.031167 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d9f3b-b1dd-4aae-a42e-97271c553bb4 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:42.150128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1251/2494] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:01:41 2022] PUT /identity/v3/projects/1af3f709be724e6eb141fccc9721c5bb/users/9b6d8ceab2c54b37a387ffa89e668728/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:01:42.161512 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1d9b4-4dc0-46d0-b8eb-a4723430c4bb None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:42.161946 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1d9b4-4dc0-46d0-b8eb-a4723430c4bb None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:42.162199 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1d9b4-4dc0-46d0-b8eb-a4723430c4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:42.213068 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-30f1d9b4-4dc0-46d0-b8eb-a4723430c4bb None None] MFA Rules not processed for user `9b6d8ceab2c54b37a387ffa89e668728`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:42.214570 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-30f1d9b4-4dc0-46d0-b8eb-a4723430c4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:42.253216 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:42.359100 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1244/2495] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:01:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:01:42.364810 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d9f3b-b1dd-4aae-a42e-97271c553bb4 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:42.532789 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d9f3b-b1dd-4aae-a42e-97271c553bb4 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:42.545642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35491c-d9ff-4104-8004-ce219a8b2670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:42.547317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35491c-d9ff-4104-8004-ce219a8b2670 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:42.547776 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35491c-d9ff-4104-8004-ce219a8b2670 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:42.549217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35491c-d9ff-4104-8004-ce219a8b2670 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:42.550043 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35491c-d9ff-4104-8004-ce219a8b2670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:42.552959 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35491c-d9ff-4104-8004-ce219a8b2670 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:42.699304 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1252/2496] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:01:42 2022] POST /identity/v3/projects => generated 389 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:01:42.703652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1d9b4-4dc0-46d0-b8eb-a4723430c4bb None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:42.725755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1d9b4-4dc0-46d0-b8eb-a4723430c4bb None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:42.860544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34333d9-072c-417a-9343-367fb3f85cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:42.864634 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34333d9-072c-417a-9343-367fb3f85cdd admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:42.864938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34333d9-072c-417a-9343-367fb3f85cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:42.865221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34333d9-072c-417a-9343-367fb3f85cdd admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:42.866031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34333d9-072c-417a-9343-367fb3f85cdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:42.872867 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34333d9-072c-417a-9343-367fb3f85cdd admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:42.962140 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1245/2497] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:01:42 2022] POST /identity/v3/users => generated 301 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:01:42.965800 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35491c-d9ff-4104-8004-ce219a8b2670 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:42.989114 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35491c-d9ff-4104-8004-ce219a8b2670 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:43.018457 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa56e09-adbe-441c-9132-7cabf017f513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:43.021796 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa56e09-adbe-441c-9132-7cabf017f513 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:43.022799 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa56e09-adbe-441c-9132-7cabf017f513 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:43.023235 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa56e09-adbe-441c-9132-7cabf017f513 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:43.024255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa56e09-adbe-441c-9132-7cabf017f513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:43.026488 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa56e09-adbe-441c-9132-7cabf017f513 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:43.030581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:43.048822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1253/2498] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:01:43.050280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34333d9-072c-417a-9343-367fb3f85cdd admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:43.068621 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34333d9-072c-417a-9343-367fb3f85cdd admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:43.076199 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96961259-5831-4ff4-8b20-105acadba7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:43.077130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96961259-5831-4ff4-8b20-105acadba7d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:43.077637 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96961259-5831-4ff4-8b20-105acadba7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:43.078124 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96961259-5831-4ff4-8b20-105acadba7d3 admin admin] PATH_INFO: `/v3/projects/623e3f4dc6a34d6e87a5054423d7b39e/users/eec1023c360e43c0b72080bfcffb1fa8/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:43.132688 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96961259-5831-4ff4-8b20-105acadba7d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=623e3f4dc6a34d6e87a5054423d7b39e, user_id=eec1023c360e43c0b72080bfcffb1fa8, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:43.137362 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96961259-5831-4ff4-8b20-105acadba7d3 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:43.248932 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1246/2499] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:01:43 2022] PUT /identity/v3/projects/623e3f4dc6a34d6e87a5054423d7b39e/users/eec1023c360e43c0b72080bfcffb1fa8/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:01:43.255288 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa56e09-adbe-441c-9132-7cabf017f513 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:43.280637 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa56e09-adbe-441c-9132-7cabf017f513 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:43.420079 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ea6b9-e06d-4167-81a4-894a6d42ac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:43.420728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ea6b9-e06d-4167-81a4-894a6d42ac49 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:43.421023 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ea6b9-e06d-4167-81a4-894a6d42ac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:43.421292 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ea6b9-e06d-4167-81a4-894a6d42ac49 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:43.421957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ea6b9-e06d-4167-81a4-894a6d42ac49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:43.423598 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ea6b9-e06d-4167-81a4-894a6d42ac49 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:43.438535 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1254/2500] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:01:43.439959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96961259-5831-4ff4-8b20-105acadba7d3 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:43.456084 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96961259-5831-4ff4-8b20-105acadba7d3 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:43.474997 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fdd5d-53d3-4774-8ff9-3c42e3cc8dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:43.475441 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fdd5d-53d3-4774-8ff9-3c42e3cc8dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:43.482763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fdd5d-53d3-4774-8ff9-3c42e3cc8dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:43.482763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fdd5d-53d3-4774-8ff9-3c42e3cc8dcb admin admin] PATH_INFO: `/v3/projects/623e3f4dc6a34d6e87a5054423d7b39e/users/eec1023c360e43c0b72080bfcffb1fa8/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:43.483234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fdd5d-53d3-4774-8ff9-3c42e3cc8dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=623e3f4dc6a34d6e87a5054423d7b39e, user_id=eec1023c360e43c0b72080bfcffb1fa8, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:43.487072 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fdd5d-53d3-4774-8ff9-3c42e3cc8dcb admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:43.518976 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1247/2501] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:01:43 2022] PUT /identity/v3/projects/623e3f4dc6a34d6e87a5054423d7b39e/users/eec1023c360e43c0b72080bfcffb1fa8/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:01:43.532253 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4b01b-ac83-43f3-9bb6-e7f942bcf337 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:43.532542 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4b01b-ac83-43f3-9bb6-e7f942bcf337 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:43.532820 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4b01b-ac83-43f3-9bb6-e7f942bcf337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:43.600038 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-b9e4b01b-ac83-43f3-9bb6-e7f942bcf337 None None] MFA Rules not processed for user `eec1023c360e43c0b72080bfcffb1fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:43.601308 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-b9e4b01b-ac83-43f3-9bb6-e7f942bcf337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:43.744639 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1255/2502] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:01:43 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:01:43.776569 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fdd5d-53d3-4774-8ff9-3c42e3cc8dcb admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:43.778351 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-4b3fdd5d-53d3-4774-8ff9-3c42e3cc8dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:43.852493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fdd5d-53d3-4774-8ff9-3c42e3cc8dcb admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:43.857181 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b29b9-735a-42f8-98c6-078891c5b43c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:43.858117 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b29b9-735a-42f8-98c6-078891c5b43c service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:43.858394 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b29b9-735a-42f8-98c6-078891c5b43c service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:43.858667 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b29b9-735a-42f8-98c6-078891c5b43c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:43.870338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b29b9-735a-42f8-98c6-078891c5b43c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:43.872252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b29b9-735a-42f8-98c6-078891c5b43c service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:43.895706 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1248/2503] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:01:43 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:01:44.049467 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4b01b-ac83-43f3-9bb6-e7f942bcf337 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:44.114457 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4b01b-ac83-43f3-9bb6-e7f942bcf337 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:44.118829 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a33ec-2f2b-4d17-aaed-ac770fa3234d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:44.119474 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a33ec-2f2b-4d17-aaed-ac770fa3234d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:44.119777 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a33ec-2f2b-4d17-aaed-ac770fa3234d admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:44.120053 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a33ec-2f2b-4d17-aaed-ac770fa3234d admin admin] PATH_INFO: `/v3/users/9b6d8ceab2c54b37a387ffa89e668728` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:44.121183 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a33ec-2f2b-4d17-aaed-ac770fa3234d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6d8ceab2c54b37a387ffa89e668728)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:44.123138 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a33ec-2f2b-4d17-aaed-ac770fa3234d admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:44.148146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:44.428789 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-c73a33ec-2f2b-4d17-aaed-ac770fa3234d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6d8ceab2c54b37a387ffa89e668728'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:44.525281 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-c73a33ec-2f2b-4d17-aaed-ac770fa3234d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6d8ceab2c54b37a387ffa89e668728'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:44.525862 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-c73a33ec-2f2b-4d17-aaed-ac770fa3234d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6d8ceab2c54b37a387ffa89e668728'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:44.540163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-c73a33ec-2f2b-4d17-aaed-ac770fa3234d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6d8ceab2c54b37a387ffa89e668728'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:44.548129 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-c73a33ec-2f2b-4d17-aaed-ac770fa3234d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6d8ceab2c54b37a387ffa89e668728'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:44.558635 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1256/2504] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:01:44 2022] DELETE /identity/v3/users/9b6d8ceab2c54b37a387ffa89e668728 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:01:44.560499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff7e94-b895-4a0f-95f3-5d4e231dbb06 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:44.560955 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff7e94-b895-4a0f-95f3-5d4e231dbb06 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:44.561054 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff7e94-b895-4a0f-95f3-5d4e231dbb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:44.581509 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-1bff7e94-b895-4a0f-95f3-5d4e231dbb06 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:44.583007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1bff7e94-b895-4a0f-95f3-5d4e231dbb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:44.602057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:44.648265 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1249/2505] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:01:44.663954 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a33ec-2f2b-4d17-aaed-ac770fa3234d admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:44.665521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c73a33ec-2f2b-4d17-aaed-ac770fa3234d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:44.734365 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a33ec-2f2b-4d17-aaed-ac770fa3234d admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:44.738192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265022e-a850-4cb1-9ebd-afdeff62c163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:44.739676 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265022e-a850-4cb1-9ebd-afdeff62c163 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:44.743896 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265022e-a850-4cb1-9ebd-afdeff62c163 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:44.744358 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265022e-a850-4cb1-9ebd-afdeff62c163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:44.758329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265022e-a850-4cb1-9ebd-afdeff62c163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:44.760059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265022e-a850-4cb1-9ebd-afdeff62c163 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:44.795262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1257/2506] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:01:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:01:45.602450 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff7e94-b895-4a0f-95f3-5d4e231dbb06 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:45.604229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1bff7e94-b895-4a0f-95f3-5d4e231dbb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:45.620409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff7e94-b895-4a0f-95f3-5d4e231dbb06 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:45.627029 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a952fb-00d3-46c6-9e9c-618643f0c6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:45.627754 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a952fb-00d3-46c6-9e9c-618643f0c6fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:45.628032 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a952fb-00d3-46c6-9e9c-618643f0c6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:45.628300 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a952fb-00d3-46c6-9e9c-618643f0c6fe admin admin] PATH_INFO: `/v3/projects/1af3f709be724e6eb141fccc9721c5bb` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:45.638522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a952fb-00d3-46c6-9e9c-618643f0c6fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af3f709be724e6eb141fccc9721c5bb)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:45.638522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a952fb-00d3-46c6-9e9c-618643f0c6fe admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:45.849153 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-22a952fb-00d3-46c6-9e9c-618643f0c6fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af3f709be724e6eb141fccc9721c5bb', 'request_id': 'req-22a952fb-00d3-46c6-9e9c-618643f0c6fe'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:45.976675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-22a952fb-00d3-46c6-9e9c-618643f0c6fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af3f709be724e6eb141fccc9721c5bb', 'request_id': 'req-22a952fb-00d3-46c6-9e9c-618643f0c6fe'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:45.992199 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-22a952fb-00d3-46c6-9e9c-618643f0c6fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af3f709be724e6eb141fccc9721c5bb', 'request_id': 'req-22a952fb-00d3-46c6-9e9c-618643f0c6fe'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:46.018703 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-22a952fb-00d3-46c6-9e9c-618643f0c6fe admin admin] The token cache is being invalidate because project 1af3f709be724e6eb141fccc9721c5bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:01:46.019016 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-22a952fb-00d3-46c6-9e9c-618643f0c6fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:46.020505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-22a952fb-00d3-46c6-9e9c-618643f0c6fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:46.028816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1250/2507] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:01:45 2022] DELETE /identity/v3/projects/1af3f709be724e6eb141fccc9721c5bb => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:01:46.029545 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265022e-a850-4cb1-9ebd-afdeff62c163 service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:46.043601 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265022e-a850-4cb1-9ebd-afdeff62c163 service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:46.186867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603bc18-b32b-4c78-b905-73712cab52ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:46.187554 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603bc18-b32b-4c78-b905-73712cab52ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:46.187893 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603bc18-b32b-4c78-b905-73712cab52ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:46.193337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603bc18-b32b-4c78-b905-73712cab52ce admin admin] PATH_INFO: `/v3/users/eec1023c360e43c0b72080bfcffb1fa8` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:46.193337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603bc18-b32b-4c78-b905-73712cab52ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=eec1023c360e43c0b72080bfcffb1fa8)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:46.193337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603bc18-b32b-4c78-b905-73712cab52ce admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:46.496401 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:46.499177 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-f603bc18-b32b-4c78-b905-73712cab52ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eec1023c360e43c0b72080bfcffb1fa8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:46.588073 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-f603bc18-b32b-4c78-b905-73712cab52ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eec1023c360e43c0b72080bfcffb1fa8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:46.588698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-f603bc18-b32b-4c78-b905-73712cab52ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eec1023c360e43c0b72080bfcffb1fa8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:46.604743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-f603bc18-b32b-4c78-b905-73712cab52ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eec1023c360e43c0b72080bfcffb1fa8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:46.612972 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-f603bc18-b32b-4c78-b905-73712cab52ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eec1023c360e43c0b72080bfcffb1fa8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:46.622557 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1258/2508] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:01:46 2022] DELETE /identity/v3/users/eec1023c360e43c0b72080bfcffb1fa8 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:01:47.364079 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a952fb-00d3-46c6-9e9c-618643f0c6fe admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:47.364590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-22a952fb-00d3-46c6-9e9c-618643f0c6fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:47.389539 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a952fb-00d3-46c6-9e9c-618643f0c6fe admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:47.546710 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768d9a4-413e-4602-bb0f-5e6939ffb0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:47.549251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768d9a4-413e-4602-bb0f-5e6939ffb0c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:47.550397 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768d9a4-413e-4602-bb0f-5e6939ffb0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:47.551571 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768d9a4-413e-4602-bb0f-5e6939ffb0c0 admin admin] PATH_INFO: `/v3/projects/623e3f4dc6a34d6e87a5054423d7b39e` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:47.556008 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768d9a4-413e-4602-bb0f-5e6939ffb0c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=623e3f4dc6a34d6e87a5054423d7b39e)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:47.566262 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768d9a4-413e-4602-bb0f-5e6939ffb0c0 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:47.835076 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:47.844443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-0768d9a4-413e-4602-bb0f-5e6939ffb0c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '623e3f4dc6a34d6e87a5054423d7b39e', 'request_id': 'req-0768d9a4-413e-4602-bb0f-5e6939ffb0c0'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:47.940635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-0768d9a4-413e-4602-bb0f-5e6939ffb0c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '623e3f4dc6a34d6e87a5054423d7b39e', 'request_id': 'req-0768d9a4-413e-4602-bb0f-5e6939ffb0c0'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:47.952032 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-0768d9a4-413e-4602-bb0f-5e6939ffb0c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '623e3f4dc6a34d6e87a5054423d7b39e', 'request_id': 'req-0768d9a4-413e-4602-bb0f-5e6939ffb0c0'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:47.975174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-0768d9a4-413e-4602-bb0f-5e6939ffb0c0 admin admin] The token cache is being invalidate because project 623e3f4dc6a34d6e87a5054423d7b39e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:01:47.975749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-0768d9a4-413e-4602-bb0f-5e6939ffb0c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:47.976490 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-0768d9a4-413e-4602-bb0f-5e6939ffb0c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:47.978595 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1251/2509] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:01:47 2022] DELETE /identity/v3/projects/623e3f4dc6a34d6e87a5054423d7b39e => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:01:47.991096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15296fb6-d767-455e-806f-f86bf8b4514f None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:47.991096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15296fb6-d767-455e-806f-f86bf8b4514f None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:47.991096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15296fb6-d767-455e-806f-f86bf8b4514f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:48.005651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-15296fb6-d767-455e-806f-f86bf8b4514f None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:48.006889 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-15296fb6-d767-455e-806f-f86bf8b4514f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:48.076665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1259/2510] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:01:48.090414 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec027e47-83e0-4a4c-8d47-c53864aac8fc None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:48.090414 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec027e47-83e0-4a4c-8d47-c53864aac8fc None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:48.090414 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec027e47-83e0-4a4c-8d47-c53864aac8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:48.112008 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-ec027e47-83e0-4a4c-8d47-c53864aac8fc None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:48.113259 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ec027e47-83e0-4a4c-8d47-c53864aac8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:48.126791 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1252/2511] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:01:48.127957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15296fb6-d767-455e-806f-f86bf8b4514f None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:48.139172 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15296fb6-d767-455e-806f-f86bf8b4514f None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:48.144393 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa3fab-2072-43e0-b891-b72c58956af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:48.145622 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa3fab-2072-43e0-b891-b72c58956af6 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:48.146000 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa3fab-2072-43e0-b891-b72c58956af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:48.146439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa3fab-2072-43e0-b891-b72c58956af6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:48.147141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa3fab-2072-43e0-b891-b72c58956af6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:01:48.147467 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa3fab-2072-43e0-b891-b72c58956af6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:48.149095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa3fab-2072-43e0-b891-b72c58956af6 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:48.162032 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1260/2512] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 20:01:48.166877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec027e47-83e0-4a4c-8d47-c53864aac8fc None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:48.177357 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec027e47-83e0-4a4c-8d47-c53864aac8fc None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:48.182205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7befb4a-5a48-4a80-902b-20446d11b827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:48.182812 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7befb4a-5a48-4a80-902b-20446d11b827 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:48.183086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7befb4a-5a48-4a80-902b-20446d11b827 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:48.183352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7befb4a-5a48-4a80-902b-20446d11b827 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:48.184018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7befb4a-5a48-4a80-902b-20446d11b827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:48.185898 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7befb4a-5a48-4a80-902b-20446d11b827 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:48.329810 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa3fab-2072-43e0-b891-b72c58956af6 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:48.331590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f2fa3fab-2072-43e0-b891-b72c58956af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:48.345324 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa3fab-2072-43e0-b891-b72c58956af6 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:48.356444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84573e84-16a3-44be-afe0-25fb176464cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:48.357169 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84573e84-16a3-44be-afe0-25fb176464cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:48.366421 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84573e84-16a3-44be-afe0-25fb176464cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:48.366421 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84573e84-16a3-44be-afe0-25fb176464cb admin admin] PATH_INFO: `/v3/users/32b57ae5ce3b4104bb21a9c1f119db81` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:48.366421 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84573e84-16a3-44be-afe0-25fb176464cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=32b57ae5ce3b4104bb21a9c1f119db81)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:48.366904 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1253/2513] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:01:48 2022] POST /identity/v3/projects => generated 373 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:01:48.367358 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84573e84-16a3-44be-afe0-25fb176464cb admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:48.369907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7befb4a-5a48-4a80-902b-20446d11b827 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:48.450497 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7befb4a-5a48-4a80-902b-20446d11b827 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:48.455477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb685c7-afae-46ed-9da1-1c62dce02f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:48.456105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb685c7-afae-46ed-9da1-1c62dce02f54 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:48.456380 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb685c7-afae-46ed-9da1-1c62dce02f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:48.456650 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb685c7-afae-46ed-9da1-1c62dce02f54 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:48.457837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb685c7-afae-46ed-9da1-1c62dce02f54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:48.459783 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb685c7-afae-46ed-9da1-1c62dce02f54 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:48.554053 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1254/2514] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:01:48 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:01:48.557971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb685c7-afae-46ed-9da1-1c62dce02f54 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:48.568218 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb685c7-afae-46ed-9da1-1c62dce02f54 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:48.572833 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2629f84-fdd6-451b-8b0b-7b7ecf9a0f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:48.573409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2629f84-fdd6-451b-8b0b-7b7ecf9a0f43 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:48.573684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2629f84-fdd6-451b-8b0b-7b7ecf9a0f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:48.573953 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2629f84-fdd6-451b-8b0b-7b7ecf9a0f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:48.574579 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2629f84-fdd6-451b-8b0b-7b7ecf9a0f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:48.576304 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2629f84-fdd6-451b-8b0b-7b7ecf9a0f43 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:48.587838 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1255/2515] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 20:01:48.595281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2629f84-fdd6-451b-8b0b-7b7ecf9a0f43 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:48.605224 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-84573e84-16a3-44be-afe0-25fb176464cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32b57ae5ce3b4104bb21a9c1f119db81'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:48.605787 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2629f84-fdd6-451b-8b0b-7b7ecf9a0f43 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:48.610946 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b54da-d6ce-4646-8b1c-ade224a8919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:48.611526 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b54da-d6ce-4646-8b1c-ade224a8919d admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:48.611828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b54da-d6ce-4646-8b1c-ade224a8919d admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:48.612096 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b54da-d6ce-4646-8b1c-ade224a8919d admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:48.612995 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b54da-d6ce-4646-8b1c-ade224a8919d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:48.614606 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b54da-d6ce-4646-8b1c-ade224a8919d admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:48.624831 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1256/2516] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 20:01:48.628775 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b54da-d6ce-4646-8b1c-ade224a8919d admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:48.639762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b54da-d6ce-4646-8b1c-ade224a8919d admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:48.646453 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b2955-43ba-4f19-8971-53934ceea9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:48.646453 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b2955-43ba-4f19-8971-53934ceea9b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:48.646453 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b2955-43ba-4f19-8971-53934ceea9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:48.646743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b2955-43ba-4f19-8971-53934ceea9b1 admin admin] PATH_INFO: `/v3/projects/5be0aee8eac948e49d9f6cd449466349/users/84ced348edf645b09b54b961bb735a1f/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:48.665995 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b2955-43ba-4f19-8971-53934ceea9b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be0aee8eac948e49d9f6cd449466349, user_id=84ced348edf645b09b54b961bb735a1f, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:48.668683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b2955-43ba-4f19-8971-53934ceea9b1 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:48.701985 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-84573e84-16a3-44be-afe0-25fb176464cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32b57ae5ce3b4104bb21a9c1f119db81'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:48.702616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-84573e84-16a3-44be-afe0-25fb176464cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32b57ae5ce3b4104bb21a9c1f119db81'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:48.716008 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-84573e84-16a3-44be-afe0-25fb176464cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32b57ae5ce3b4104bb21a9c1f119db81'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:48.722961 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-84573e84-16a3-44be-afe0-25fb176464cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32b57ae5ce3b4104bb21a9c1f119db81'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:48.729066 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1261/2517] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:01:48 2022] DELETE /identity/v3/users/32b57ae5ce3b4104bb21a9c1f119db81 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:01:48.748209 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1257/2518] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:01:48 2022] PUT /identity/v3/projects/5be0aee8eac948e49d9f6cd449466349/users/84ced348edf645b09b54b961bb735a1f/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:01:48.760589 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3202d-6544-44c9-afd2-83da3ff4640c None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:48.760876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3202d-6544-44c9-afd2-83da3ff4640c None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:48.761153 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3202d-6544-44c9-afd2-83da3ff4640c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:48.795286 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-f2d3202d-6544-44c9-afd2-83da3ff4640c None None] MFA Rules not processed for user `84ced348edf645b09b54b961bb735a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:48.796654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f2d3202d-6544-44c9-afd2-83da3ff4640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:48.811282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:48.883254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1262/2519] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:01:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:01:48.895108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b2955-43ba-4f19-8971-53934ceea9b1 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:48.899304 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f73b2955-43ba-4f19-8971-53934ceea9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:48.986763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b2955-43ba-4f19-8971-53934ceea9b1 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:48.990761 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df0470-0474-4b3b-abf7-378070123626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:48.991389 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df0470-0474-4b3b-abf7-378070123626 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:48.991706 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df0470-0474-4b3b-abf7-378070123626 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:48.991981 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df0470-0474-4b3b-abf7-378070123626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:48.997599 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:49.001380 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df0470-0474-4b3b-abf7-378070123626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:49.002994 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df0470-0474-4b3b-abf7-378070123626 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:49.012863 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1258/2520] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:01:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:01:49.035265 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3202d-6544-44c9-afd2-83da3ff4640c None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:49.037270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f2d3202d-6544-44c9-afd2-83da3ff4640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:49.103987 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3202d-6544-44c9-afd2-83da3ff4640c None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:49.104169 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df0470-0474-4b3b-abf7-378070123626 service cinder] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:49.106065 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d9df0470-0474-4b3b-abf7-378070123626 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:49.109685 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b9e4b-dda6-4df3-8cb3-d9634a5a4aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:49.110896 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b9e4b-dda6-4df3-8cb3-d9634a5a4aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:49.110896 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b9e4b-dda6-4df3-8cb3-d9634a5a4aed admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:49.111116 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b9e4b-dda6-4df3-8cb3-d9634a5a4aed admin admin] PATH_INFO: `/v3/users/84ced348edf645b09b54b961bb735a1f` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:49.112306 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b9e4b-dda6-4df3-8cb3-d9634a5a4aed admin admin] RBAC: Authorizing `identity:delete_user(user_id=84ced348edf645b09b54b961bb735a1f)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:49.115223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b9e4b-dda6-4df3-8cb3-d9634a5a4aed admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:49.121191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df0470-0474-4b3b-abf7-378070123626 service cinder] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:49.126543 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7ce54-5924-4516-b706-09a9db74b4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:49.127621 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7ce54-5924-4516-b706-09a9db74b4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:49.127621 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7ce54-5924-4516-b706-09a9db74b4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:49.127846 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7ce54-5924-4516-b706-09a9db74b4b3 admin admin] PATH_INFO: `/v3/projects/63d0c36f415149259d784c1112542caf` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:49.129480 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7ce54-5924-4516-b706-09a9db74b4b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63d0c36f415149259d784c1112542caf)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:49.131971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7ce54-5924-4516-b706-09a9db74b4b3 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:49.317092 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8da7ce54-5924-4516-b706-09a9db74b4b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63d0c36f415149259d784c1112542caf', 'request_id': 'req-8da7ce54-5924-4516-b706-09a9db74b4b3'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:49.317902 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-883b9e4b-dda6-4df3-8cb3-d9634a5a4aed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84ced348edf645b09b54b961bb735a1f'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:49.388147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-883b9e4b-dda6-4df3-8cb3-d9634a5a4aed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84ced348edf645b09b54b961bb735a1f'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:49.390753 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-883b9e4b-dda6-4df3-8cb3-d9634a5a4aed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84ced348edf645b09b54b961bb735a1f'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:49.403298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-883b9e4b-dda6-4df3-8cb3-d9634a5a4aed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84ced348edf645b09b54b961bb735a1f'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:49.410525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-883b9e4b-dda6-4df3-8cb3-d9634a5a4aed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84ced348edf645b09b54b961bb735a1f'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:49.418832 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1263/2521] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:01:49 2022] DELETE /identity/v3/users/84ced348edf645b09b54b961bb735a1f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:01:49.423257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36def111-39da-4926-9d57-b82b53ab62cb None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:49.423619 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36def111-39da-4926-9d57-b82b53ab62cb None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:49.423849 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36def111-39da-4926-9d57-b82b53ab62cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:49.444785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-36def111-39da-4926-9d57-b82b53ab62cb None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:49.448583 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-36def111-39da-4926-9d57-b82b53ab62cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:49.468071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8da7ce54-5924-4516-b706-09a9db74b4b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63d0c36f415149259d784c1112542caf', 'request_id': 'req-8da7ce54-5924-4516-b706-09a9db74b4b3'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:49.472339 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:49.476800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8da7ce54-5924-4516-b706-09a9db74b4b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63d0c36f415149259d784c1112542caf', 'request_id': 'req-8da7ce54-5924-4516-b706-09a9db74b4b3'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:49.490183 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8da7ce54-5924-4516-b706-09a9db74b4b3 admin admin] The token cache is being invalidate because project 63d0c36f415149259d784c1112542caf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:01:49.490958 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8da7ce54-5924-4516-b706-09a9db74b4b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:49.492265 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8da7ce54-5924-4516-b706-09a9db74b4b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:49.494031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1259/2522] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:01:49 2022] DELETE /identity/v3/projects/63d0c36f415149259d784c1112542caf => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:01:49.498285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7ce54-5924-4516-b706-09a9db74b4b3 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:49.499830 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-8da7ce54-5924-4516-b706-09a9db74b4b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:49.521783 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1264/2523] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:01:49.531831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36def111-39da-4926-9d57-b82b53ab62cb None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:49.533409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-36def111-39da-4926-9d57-b82b53ab62cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:49.593429 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7ce54-5924-4516-b706-09a9db74b4b3 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:49.599195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb22e2-92b8-4370-bf05-c1a8de5381b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:49.600014 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb22e2-92b8-4370-bf05-c1a8de5381b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:49.600394 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb22e2-92b8-4370-bf05-c1a8de5381b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:49.600763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb22e2-92b8-4370-bf05-c1a8de5381b5 admin admin] PATH_INFO: `/v3/users/ddb095fcb81347538f3278ddd6a53c91` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:49.602172 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb22e2-92b8-4370-bf05-c1a8de5381b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb095fcb81347538f3278ddd6a53c91)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:49.604496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb22e2-92b8-4370-bf05-c1a8de5381b5 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:49.610675 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36def111-39da-4926-9d57-b82b53ab62cb None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:49.617227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1dc673-6283-4095-81dd-65eb460ede4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:49.618228 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1dc673-6283-4095-81dd-65eb460ede4d service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:49.618481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1dc673-6283-4095-81dd-65eb460ede4d service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:49.618910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1dc673-6283-4095-81dd-65eb460ede4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:49.630936 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1dc673-6283-4095-81dd-65eb460ede4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:49.632968 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1dc673-6283-4095-81dd-65eb460ede4d service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:49.646400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1265/2524] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:01:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:01:49.797890 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b9bb22e2-92b8-4370-bf05-c1a8de5381b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb095fcb81347538f3278ddd6a53c91'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:49.879824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b9bb22e2-92b8-4370-bf05-c1a8de5381b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb095fcb81347538f3278ddd6a53c91'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:49.880623 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b9bb22e2-92b8-4370-bf05-c1a8de5381b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb095fcb81347538f3278ddd6a53c91'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:49.888925 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b9bb22e2-92b8-4370-bf05-c1a8de5381b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb095fcb81347538f3278ddd6a53c91'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:49.913434 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:49.914413 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-b9bb22e2-92b8-4370-bf05-c1a8de5381b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb095fcb81347538f3278ddd6a53c91'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:49.926354 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1260/2525] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:01:49 2022] DELETE /identity/v3/users/ddb095fcb81347538f3278ddd6a53c91 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:01:50.337952 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1dc673-6283-4095-81dd-65eb460ede4d service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:50.339975 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-eb1dc673-6283-4095-81dd-65eb460ede4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:50.371567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1dc673-6283-4095-81dd-65eb460ede4d service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:50.371902 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb22e2-92b8-4370-bf05-c1a8de5381b5 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:50.373386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b9bb22e2-92b8-4370-bf05-c1a8de5381b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:50.487778 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb22e2-92b8-4370-bf05-c1a8de5381b5 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:50.489276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd40918-a035-459b-b363-c73c7a571e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:50.489961 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd40918-a035-459b-b363-c73c7a571e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:50.490243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd40918-a035-459b-b363-c73c7a571e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:50.490518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd40918-a035-459b-b363-c73c7a571e00 admin admin] PATH_INFO: `/v3/projects/5be0aee8eac948e49d9f6cd449466349` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:50.491795 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd40918-a035-459b-b363-c73c7a571e00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5be0aee8eac948e49d9f6cd449466349)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:50.493732 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd40918-a035-459b-b363-c73c7a571e00 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:50.496093 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b13d0-4cc0-43ff-80eb-1532e5284d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:50.496965 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b13d0-4cc0-43ff-80eb-1532e5284d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:50.497381 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b13d0-4cc0-43ff-80eb-1532e5284d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:50.497806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b13d0-4cc0-43ff-80eb-1532e5284d27 admin admin] PATH_INFO: `/v3/projects/b51bb058430c4b01ad3a4f372e39f43a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:50.499118 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b13d0-4cc0-43ff-80eb-1532e5284d27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b51bb058430c4b01ad3a4f372e39f43a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:50.501291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b13d0-4cc0-43ff-80eb-1532e5284d27 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:50.633396 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-997b13d0-4cc0-43ff-80eb-1532e5284d27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b51bb058430c4b01ad3a4f372e39f43a', 'request_id': 'req-997b13d0-4cc0-43ff-80eb-1532e5284d27'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:50.667868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1dd40918-a035-459b-b363-c73c7a571e00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5be0aee8eac948e49d9f6cd449466349', 'request_id': 'req-1dd40918-a035-459b-b363-c73c7a571e00'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:50.696540 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-997b13d0-4cc0-43ff-80eb-1532e5284d27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b51bb058430c4b01ad3a4f372e39f43a', 'request_id': 'req-997b13d0-4cc0-43ff-80eb-1532e5284d27'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:50.703140 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-997b13d0-4cc0-43ff-80eb-1532e5284d27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b51bb058430c4b01ad3a4f372e39f43a', 'request_id': 'req-997b13d0-4cc0-43ff-80eb-1532e5284d27'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:50.731208 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-997b13d0-4cc0-43ff-80eb-1532e5284d27 admin admin] The token cache is being invalidate because project b51bb058430c4b01ad3a4f372e39f43a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:01:50.731783 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-997b13d0-4cc0-43ff-80eb-1532e5284d27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:50.733866 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-997b13d0-4cc0-43ff-80eb-1532e5284d27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:50.735442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1261/2526] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:01:50 2022] DELETE /identity/v3/projects/b51bb058430c4b01ad3a4f372e39f43a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:01:50.788295 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1dd40918-a035-459b-b363-c73c7a571e00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5be0aee8eac948e49d9f6cd449466349', 'request_id': 'req-1dd40918-a035-459b-b363-c73c7a571e00'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:50.797359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1dd40918-a035-459b-b363-c73c7a571e00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5be0aee8eac948e49d9f6cd449466349', 'request_id': 'req-1dd40918-a035-459b-b363-c73c7a571e00'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:50.817164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1dd40918-a035-459b-b363-c73c7a571e00 admin admin] The token cache is being invalidate because project 5be0aee8eac948e49d9f6cd449466349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:01:50.817913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1dd40918-a035-459b-b363-c73c7a571e00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:50.818854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-1dd40918-a035-459b-b363-c73c7a571e00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:01:50.820926 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1266/2527] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:01:50 2022] DELETE /identity/v3/projects/5be0aee8eac948e49d9f6cd449466349 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:01:50.827052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69c5a9-dd24-4e6f-b9e0-31d449176af1 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:50.827466 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69c5a9-dd24-4e6f-b9e0-31d449176af1 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:50.827952 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69c5a9-dd24-4e6f-b9e0-31d449176af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:50.896976 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-bb69c5a9-dd24-4e6f-b9e0-31d449176af1 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:50.898378 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-bb69c5a9-dd24-4e6f-b9e0-31d449176af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:51.006647 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1262/2528] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:01:51.014845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0dba3-1bc4-4f1a-a91b-2a4add7a2180 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:51.015134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0dba3-1bc4-4f1a-a91b-2a4add7a2180 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:51.015411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0dba3-1bc4-4f1a-a91b-2a4add7a2180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:51.023693 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:51.038462 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-07c0dba3-1bc4-4f1a-a91b-2a4add7a2180 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:51.039749 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-07c0dba3-1bc4-4f1a-a91b-2a4add7a2180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:51.049084 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1267/2529] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:01:51.053827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69c5a9-dd24-4e6f-b9e0-31d449176af1 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:51.068575 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69c5a9-dd24-4e6f-b9e0-31d449176af1 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:51.075031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f48a47-1388-45da-a68e-3e1db7b19ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:51.075701 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f48a47-1388-45da-a68e-3e1db7b19ebf admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:51.075979 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f48a47-1388-45da-a68e-3e1db7b19ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:51.076250 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f48a47-1388-45da-a68e-3e1db7b19ebf admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:51.076981 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f48a47-1388-45da-a68e-3e1db7b19ebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:01:51.077309 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f48a47-1388-45da-a68e-3e1db7b19ebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:51.078912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f48a47-1388-45da-a68e-3e1db7b19ebf admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:51.097957 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1263/2530] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 20:01:51.098714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0dba3-1bc4-4f1a-a91b-2a4add7a2180 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:51.111816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0dba3-1bc4-4f1a-a91b-2a4add7a2180 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:51.117467 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c1cdb-992e-4134-8e96-8ed9979f032d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:51.118011 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c1cdb-992e-4134-8e96-8ed9979f032d admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:51.118604 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c1cdb-992e-4134-8e96-8ed9979f032d admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:51.119112 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c1cdb-992e-4134-8e96-8ed9979f032d admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:51.120136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c1cdb-992e-4134-8e96-8ed9979f032d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:51.122167 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c1cdb-992e-4134-8e96-8ed9979f032d admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:51.272615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1268/2531] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:01:51 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:01:51.276259 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f48a47-1388-45da-a68e-3e1db7b19ebf admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:51.296275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f48a47-1388-45da-a68e-3e1db7b19ebf admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:51.308780 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:51.388023 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1423347-e86a-4792-b6c5-3702252ef153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:51.388650 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1423347-e86a-4792-b6c5-3702252ef153 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:51.389089 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1423347-e86a-4792-b6c5-3702252ef153 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:51.389436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1423347-e86a-4792-b6c5-3702252ef153 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:51.390164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1423347-e86a-4792-b6c5-3702252ef153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:51.392179 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1423347-e86a-4792-b6c5-3702252ef153 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:51.489450 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1264/2532] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:01:51 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:01:51.493855 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c1cdb-992e-4134-8e96-8ed9979f032d admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:51.506933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c1cdb-992e-4134-8e96-8ed9979f032d admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:51.527927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cba424-08a7-4ee1-9b29-9d75b7dfbe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:51.528571 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cba424-08a7-4ee1-9b29-9d75b7dfbe73 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:51.528857 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cba424-08a7-4ee1-9b29-9d75b7dfbe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:51.529134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cba424-08a7-4ee1-9b29-9d75b7dfbe73 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:51.529843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cba424-08a7-4ee1-9b29-9d75b7dfbe73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:51.531774 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cba424-08a7-4ee1-9b29-9d75b7dfbe73 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:51.564674 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1269/2533] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:01:51.566278 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1423347-e86a-4792-b6c5-3702252ef153 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:51.576455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1423347-e86a-4792-b6c5-3702252ef153 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:51.581057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb303c69-6bbd-45e8-99d3-9c796eca5b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:51.581657 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb303c69-6bbd-45e8-99d3-9c796eca5b59 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:51.581935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb303c69-6bbd-45e8-99d3-9c796eca5b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:51.582239 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb303c69-6bbd-45e8-99d3-9c796eca5b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:51.582958 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb303c69-6bbd-45e8-99d3-9c796eca5b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:51.584674 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb303c69-6bbd-45e8-99d3-9c796eca5b59 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:51.597235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1265/2534] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:01:51.604371 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cba424-08a7-4ee1-9b29-9d75b7dfbe73 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:51.615678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cba424-08a7-4ee1-9b29-9d75b7dfbe73 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:51.620698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61753d1e-586d-41f8-b101-04dbdc7e18e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:51.621438 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61753d1e-586d-41f8-b101-04dbdc7e18e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:51.621730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61753d1e-586d-41f8-b101-04dbdc7e18e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:51.621985 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61753d1e-586d-41f8-b101-04dbdc7e18e3 admin admin] PATH_INFO: `/v3/projects/e98765b1c6d246e781c50f35fd5e0bd7/users/1ee0927a8f0647db8926f76474e97167/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:51.639232 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61753d1e-586d-41f8-b101-04dbdc7e18e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e98765b1c6d246e781c50f35fd5e0bd7, user_id=1ee0927a8f0647db8926f76474e97167, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:51.641931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61753d1e-586d-41f8-b101-04dbdc7e18e3 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:51.743639 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1270/2535] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:01:51 2022] PUT /identity/v3/projects/e98765b1c6d246e781c50f35fd5e0bd7/users/1ee0927a8f0647db8926f76474e97167/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:01:51.754091 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff5bc4-4eb8-4fa8-8802-bf03ea423b7c None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:51.754466 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff5bc4-4eb8-4fa8-8802-bf03ea423b7c None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:51.754705 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff5bc4-4eb8-4fa8-8802-bf03ea423b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:51.791733 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-dfff5bc4-4eb8-4fa8-8802-bf03ea423b7c None None] MFA Rules not processed for user `1ee0927a8f0647db8926f76474e97167`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:01:51.793249 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-dfff5bc4-4eb8-4fa8-8802-bf03ea423b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:51.864185 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1266/2536] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:01:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:01:51.874948 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61753d1e-586d-41f8-b101-04dbdc7e18e3 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:51.876689 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-61753d1e-586d-41f8-b101-04dbdc7e18e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:01:51.938489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61753d1e-586d-41f8-b101-04dbdc7e18e3 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:51.942369 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81586d71-1723-4d3a-b890-ac7df2cc8e94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:51.943109 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81586d71-1723-4d3a-b890-ac7df2cc8e94 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:51.943487 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81586d71-1723-4d3a-b890-ac7df2cc8e94 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:51.943831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81586d71-1723-4d3a-b890-ac7df2cc8e94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:51.955715 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81586d71-1723-4d3a-b890-ac7df2cc8e94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:51.958789 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81586d71-1723-4d3a-b890-ac7df2cc8e94 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:51.976475 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1271/2537] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:01:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:01:59.705743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff5bc4-4eb8-4fa8-8802-bf03ea423b7c None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:01:59.780839 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff5bc4-4eb8-4fa8-8802-bf03ea423b7c None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:01:59.789939 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771b669-ee66-484f-a352-7642e8e3d23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:01:59.790954 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771b669-ee66-484f-a352-7642e8e3d23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:01:59.791236 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771b669-ee66-484f-a352-7642e8e3d23f admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:01:59.791512 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771b669-ee66-484f-a352-7642e8e3d23f admin admin] PATH_INFO: `/v3/users/1ee0927a8f0647db8926f76474e97167` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:01:59.792765 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771b669-ee66-484f-a352-7642e8e3d23f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee0927a8f0647db8926f76474e97167)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:01:59.794745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771b669-ee66-484f-a352-7642e8e3d23f admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:01:59.824354 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:00.511843 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f771b669-ee66-484f-a352-7642e8e3d23f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee0927a8f0647db8926f76474e97167'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:00.604821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f771b669-ee66-484f-a352-7642e8e3d23f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee0927a8f0647db8926f76474e97167'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:00.605521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f771b669-ee66-484f-a352-7642e8e3d23f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee0927a8f0647db8926f76474e97167'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:00.613438 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f771b669-ee66-484f-a352-7642e8e3d23f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee0927a8f0647db8926f76474e97167'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:00.626217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f771b669-ee66-484f-a352-7642e8e3d23f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee0927a8f0647db8926f76474e97167'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:00.632982 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1267/2538] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:01:59 2022] DELETE /identity/v3/users/1ee0927a8f0647db8926f76474e97167 => generated 0 bytes in 928 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:00.637465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d08d6-8ec0-46fe-99e1-7586803ce5ac None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:00.638281 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d08d6-8ec0-46fe-99e1-7586803ce5ac None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:00.638555 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d08d6-8ec0-46fe-99e1-7586803ce5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:00.657435 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-ab7d08d6-8ec0-46fe-99e1-7586803ce5ac None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:00.658629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ab7d08d6-8ec0-46fe-99e1-7586803ce5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:00.720012 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1272/2539] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:00.730246 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771b669-ee66-484f-a352-7642e8e3d23f admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:00.731911 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f771b669-ee66-484f-a352-7642e8e3d23f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:00.794284 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771b669-ee66-484f-a352-7642e8e3d23f admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:00.797851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01447e-32c9-49fc-a2a9-84527491a73e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:00.798512 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01447e-32c9-49fc-a2a9-84527491a73e service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:00.798792 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01447e-32c9-49fc-a2a9-84527491a73e service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:00.799063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01447e-32c9-49fc-a2a9-84527491a73e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:00.808865 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01447e-32c9-49fc-a2a9-84527491a73e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:00.810277 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01447e-32c9-49fc-a2a9-84527491a73e service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:00.820615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1268/2540] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:02:01.278101 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d08d6-8ec0-46fe-99e1-7586803ce5ac None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:01.279651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ab7d08d6-8ec0-46fe-99e1-7586803ce5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:01.301604 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d08d6-8ec0-46fe-99e1-7586803ce5ac None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:01.307450 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66790d5e-bc5b-4be7-b5b9-0cd05ff26c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:01.308138 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66790d5e-bc5b-4be7-b5b9-0cd05ff26c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:01.308359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66790d5e-bc5b-4be7-b5b9-0cd05ff26c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:01.308635 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66790d5e-bc5b-4be7-b5b9-0cd05ff26c22 admin admin] PATH_INFO: `/v3/projects/e98765b1c6d246e781c50f35fd5e0bd7` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:01.309767 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66790d5e-bc5b-4be7-b5b9-0cd05ff26c22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e98765b1c6d246e781c50f35fd5e0bd7)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:01.311767 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66790d5e-bc5b-4be7-b5b9-0cd05ff26c22 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:01.413977 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:01.422291 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-66790d5e-bc5b-4be7-b5b9-0cd05ff26c22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e98765b1c6d246e781c50f35fd5e0bd7', 'request_id': 'req-66790d5e-bc5b-4be7-b5b9-0cd05ff26c22'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:01.484953 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-66790d5e-bc5b-4be7-b5b9-0cd05ff26c22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e98765b1c6d246e781c50f35fd5e0bd7', 'request_id': 'req-66790d5e-bc5b-4be7-b5b9-0cd05ff26c22'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:01.491563 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-66790d5e-bc5b-4be7-b5b9-0cd05ff26c22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e98765b1c6d246e781c50f35fd5e0bd7', 'request_id': 'req-66790d5e-bc5b-4be7-b5b9-0cd05ff26c22'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:01.503753 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-66790d5e-bc5b-4be7-b5b9-0cd05ff26c22 admin admin] The token cache is being invalidate because project e98765b1c6d246e781c50f35fd5e0bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:01.504052 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-66790d5e-bc5b-4be7-b5b9-0cd05ff26c22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:01.504731 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-66790d5e-bc5b-4be7-b5b9-0cd05ff26c22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:01.506578 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1273/2541] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:01 2022] DELETE /identity/v3/projects/e98765b1c6d246e781c50f35fd5e0bd7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:01.511835 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3062db6-ccd8-4ec1-8083-c6819a3c5a8b None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:01.512122 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3062db6-ccd8-4ec1-8083-c6819a3c5a8b None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:01.512399 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3062db6-ccd8-4ec1-8083-c6819a3c5a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:01.531849 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-b3062db6-ccd8-4ec1-8083-c6819a3c5a8b None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:01.533060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b3062db6-ccd8-4ec1-8083-c6819a3c5a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:01.595328 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1269/2542] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:01.604296 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963bc5d-c870-4b38-a67a-5d9c967510a4 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:01.604589 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963bc5d-c870-4b38-a67a-5d9c967510a4 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:01.604868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963bc5d-c870-4b38-a67a-5d9c967510a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:01.627925 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-2963bc5d-c870-4b38-a67a-5d9c967510a4 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:01.629138 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2963bc5d-c870-4b38-a67a-5d9c967510a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:01.640020 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1274/2543] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:02:01.644791 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3062db6-ccd8-4ec1-8083-c6819a3c5a8b None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:01.655662 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3062db6-ccd8-4ec1-8083-c6819a3c5a8b None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:01.660463 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca2491-70bc-4a2c-9de6-204ab578cc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:01.661079 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca2491-70bc-4a2c-9de6-204ab578cc1d admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:01.661359 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca2491-70bc-4a2c-9de6-204ab578cc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:01.661631 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca2491-70bc-4a2c-9de6-204ab578cc1d admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:01.662344 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca2491-70bc-4a2c-9de6-204ab578cc1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:02:01.662654 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca2491-70bc-4a2c-9de6-204ab578cc1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:01.664342 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca2491-70bc-4a2c-9de6-204ab578cc1d admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:01.676787 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1270/2544] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 20:02:01.682315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963bc5d-c870-4b38-a67a-5d9c967510a4 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:01.696844 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963bc5d-c870-4b38-a67a-5d9c967510a4 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:01.701928 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7fc27-7181-42b7-97b9-ac7e6ac40442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:01.712164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7fc27-7181-42b7-97b9-ac7e6ac40442 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:01.712164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7fc27-7181-42b7-97b9-ac7e6ac40442 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:01.712164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7fc27-7181-42b7-97b9-ac7e6ac40442 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:01.712164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7fc27-7181-42b7-97b9-ac7e6ac40442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:01.712164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7fc27-7181-42b7-97b9-ac7e6ac40442 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:01.824562 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1275/2545] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:02:01 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:01.828829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca2491-70bc-4a2c-9de6-204ab578cc1d admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:01.838986 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca2491-70bc-4a2c-9de6-204ab578cc1d admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:01.874599 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:01.903744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd2d7d-ed74-4585-a272-7e959f55314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:01.904365 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd2d7d-ed74-4585-a272-7e959f55314a admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:01.904643 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd2d7d-ed74-4585-a272-7e959f55314a admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:01.904904 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd2d7d-ed74-4585-a272-7e959f55314a admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:01.905543 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd2d7d-ed74-4585-a272-7e959f55314a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:01.907509 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd2d7d-ed74-4585-a272-7e959f55314a admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:02.022612 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1271/2546] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:02:01 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:02.027254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7fc27-7181-42b7-97b9-ac7e6ac40442 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:02.040337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7fc27-7181-42b7-97b9-ac7e6ac40442 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:02.044975 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f961f44-03f4-4c43-8c82-3016977d7f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:02.045588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f961f44-03f4-4c43-8c82-3016977d7f0b admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:02.045872 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f961f44-03f4-4c43-8c82-3016977d7f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:02.046147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f961f44-03f4-4c43-8c82-3016977d7f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:02.046787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f961f44-03f4-4c43-8c82-3016977d7f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:02.048451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f961f44-03f4-4c43-8c82-3016977d7f0b admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:02.060128 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1276/2547] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:02.064153 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd2d7d-ed74-4585-a272-7e959f55314a admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:02.078063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd2d7d-ed74-4585-a272-7e959f55314a admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:02.082761 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362259a-633f-4474-a65a-8f2d67f78678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:02.083367 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362259a-633f-4474-a65a-8f2d67f78678 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:02.083690 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362259a-633f-4474-a65a-8f2d67f78678 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:02.083969 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362259a-633f-4474-a65a-8f2d67f78678 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:02.084647 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362259a-633f-4474-a65a-8f2d67f78678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:02.086272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362259a-633f-4474-a65a-8f2d67f78678 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:02.096445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1272/2548] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 20:02:02.101616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f961f44-03f4-4c43-8c82-3016977d7f0b admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:02.111800 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f961f44-03f4-4c43-8c82-3016977d7f0b admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:02.117661 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412a414-784f-4abf-85d5-4da285c83c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:02.119187 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412a414-784f-4abf-85d5-4da285c83c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:02.119465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412a414-784f-4abf-85d5-4da285c83c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:02.119780 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412a414-784f-4abf-85d5-4da285c83c42 admin admin] PATH_INFO: `/v3/projects/addfe681fb8e4234b1287dbc5299ea56/users/1e311c39a06c425b8743fa743d33a899/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:02.134693 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412a414-784f-4abf-85d5-4da285c83c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=addfe681fb8e4234b1287dbc5299ea56, user_id=1e311c39a06c425b8743fa743d33a899, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:02.138433 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412a414-784f-4abf-85d5-4da285c83c42 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:02.229168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1277/2549] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:02 2022] PUT /identity/v3/projects/addfe681fb8e4234b1287dbc5299ea56/users/1e311c39a06c425b8743fa743d33a899/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:02.239930 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6b2fd-8a24-4125-b4fa-ccbac4c3a10b None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:02.240357 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6b2fd-8a24-4125-b4fa-ccbac4c3a10b None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:02.241018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6b2fd-8a24-4125-b4fa-ccbac4c3a10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:02.271043 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-76a6b2fd-8a24-4125-b4fa-ccbac4c3a10b None None] MFA Rules not processed for user `1e311c39a06c425b8743fa743d33a899`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:02.272866 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-76a6b2fd-8a24-4125-b4fa-ccbac4c3a10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:02.343349 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1273/2550] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:02.348042 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412a414-784f-4abf-85d5-4da285c83c42 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:02.418717 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412a414-784f-4abf-85d5-4da285c83c42 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:02.423423 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5f104-918d-4afe-a7d3-4093470befd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:02.424721 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5f104-918d-4afe-a7d3-4093470befd0 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:02.425004 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5f104-918d-4afe-a7d3-4093470befd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:02.425272 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5f104-918d-4afe-a7d3-4093470befd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:02.425921 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5f104-918d-4afe-a7d3-4093470befd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:02.428004 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5f104-918d-4afe-a7d3-4093470befd0 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:02.512283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1278/2551] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:02:02 2022] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:02.518130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6b2fd-8a24-4125-b4fa-ccbac4c3a10b None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:02.529749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6b2fd-8a24-4125-b4fa-ccbac4c3a10b None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:02.588070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a113fc3-93ad-4e60-b832-8c26f27bae28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:02.589210 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a113fc3-93ad-4e60-b832-8c26f27bae28 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:02.589210 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a113fc3-93ad-4e60-b832-8c26f27bae28 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:02.589499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a113fc3-93ad-4e60-b832-8c26f27bae28 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:02.590031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a113fc3-93ad-4e60-b832-8c26f27bae28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:02.592242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a113fc3-93ad-4e60-b832-8c26f27bae28 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:02.664023 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1274/2552] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:02:02 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:02.665280 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5f104-918d-4afe-a7d3-4093470befd0 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:02.677696 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5f104-918d-4afe-a7d3-4093470befd0 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:02.682860 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc196738-c01a-4cd0-a712-29fe9ea0952b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:02.683599 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc196738-c01a-4cd0-a712-29fe9ea0952b admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:02.687235 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc196738-c01a-4cd0-a712-29fe9ea0952b admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:02.687235 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc196738-c01a-4cd0-a712-29fe9ea0952b admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:02.687235 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc196738-c01a-4cd0-a712-29fe9ea0952b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:02.687235 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc196738-c01a-4cd0-a712-29fe9ea0952b admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:02.701512 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1279/2553] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:02.706108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a113fc3-93ad-4e60-b832-8c26f27bae28 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:02.718598 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a113fc3-93ad-4e60-b832-8c26f27bae28 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:02.723238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c47737-1fca-4e8e-ba81-b89a63ce96d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:02.723881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c47737-1fca-4e8e-ba81-b89a63ce96d2 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:02.724158 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c47737-1fca-4e8e-ba81-b89a63ce96d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:02.724428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c47737-1fca-4e8e-ba81-b89a63ce96d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:02.725340 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c47737-1fca-4e8e-ba81-b89a63ce96d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:02.726937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c47737-1fca-4e8e-ba81-b89a63ce96d2 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:02.738980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1275/2554] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:02.746241 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc196738-c01a-4cd0-a712-29fe9ea0952b admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:02.757158 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc196738-c01a-4cd0-a712-29fe9ea0952b admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:02.762041 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd567e74-4e32-4d5e-9bab-a80f610ead12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:02.762701 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd567e74-4e32-4d5e-9bab-a80f610ead12 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:02.762979 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd567e74-4e32-4d5e-9bab-a80f610ead12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:02.763255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd567e74-4e32-4d5e-9bab-a80f610ead12 admin admin] PATH_INFO: `/v3/projects/1b789ca6a86745859c19b000711408e0/users/5d69c5e87c94431db3e5060b4a9f2f16/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:02.780437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd567e74-4e32-4d5e-9bab-a80f610ead12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b789ca6a86745859c19b000711408e0, user_id=5d69c5e87c94431db3e5060b4a9f2f16, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:02.783053 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd567e74-4e32-4d5e-9bab-a80f610ead12 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:02.905518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1280/2555] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:02 2022] PUT /identity/v3/projects/1b789ca6a86745859c19b000711408e0/users/5d69c5e87c94431db3e5060b4a9f2f16/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:02.916441 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea888f4-aa50-4944-a4e0-d497faa1ee31 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:02.916893 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea888f4-aa50-4944-a4e0-d497faa1ee31 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:02.917144 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea888f4-aa50-4944-a4e0-d497faa1ee31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:02.968055 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-cea888f4-aa50-4944-a4e0-d497faa1ee31 None None] MFA Rules not processed for user `5d69c5e87c94431db3e5060b4a9f2f16`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:02.969637 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-cea888f4-aa50-4944-a4e0-d497faa1ee31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:02.976772 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:03.081865 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1276/2556] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:03.086295 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd567e74-4e32-4d5e-9bab-a80f610ead12 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:03.103711 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:03.176924 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd567e74-4e32-4d5e-9bab-a80f610ead12 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:03.182583 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e605608-234e-4ac8-8d00-4ad12b9b9a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:03.183787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e605608-234e-4ac8-8d00-4ad12b9b9a77 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:03.184189 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e605608-234e-4ac8-8d00-4ad12b9b9a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:03.184720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e605608-234e-4ac8-8d00-4ad12b9b9a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:03.185816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e605608-234e-4ac8-8d00-4ad12b9b9a77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:03.187953 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e605608-234e-4ac8-8d00-4ad12b9b9a77 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:03.307567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1281/2557] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:02:03 2022] POST /identity/v3/projects => generated 375 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:03.309215 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea888f4-aa50-4944-a4e0-d497faa1ee31 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:03.321496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea888f4-aa50-4944-a4e0-d497faa1ee31 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:03.385871 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86891d8-baf8-4a26-9d57-749fae3e461f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:03.386901 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86891d8-baf8-4a26-9d57-749fae3e461f admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:03.387185 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86891d8-baf8-4a26-9d57-749fae3e461f admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:03.387454 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86891d8-baf8-4a26-9d57-749fae3e461f admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:03.388283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86891d8-baf8-4a26-9d57-749fae3e461f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:03.390231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86891d8-baf8-4a26-9d57-749fae3e461f admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:03.497332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1277/2558] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:02:03 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:03.498577 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e605608-234e-4ac8-8d00-4ad12b9b9a77 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:03.512992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e605608-234e-4ac8-8d00-4ad12b9b9a77 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:03.519234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab47c87-24e5-4b97-8809-7e5743f355f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:03.520581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab47c87-24e5-4b97-8809-7e5743f355f4 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:03.521134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab47c87-24e5-4b97-8809-7e5743f355f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:03.524156 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab47c87-24e5-4b97-8809-7e5743f355f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:03.525852 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab47c87-24e5-4b97-8809-7e5743f355f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:03.529768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab47c87-24e5-4b97-8809-7e5743f355f4 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:03.550430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1282/2559] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:03.550892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86891d8-baf8-4a26-9d57-749fae3e461f admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:03.562610 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86891d8-baf8-4a26-9d57-749fae3e461f admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:03.569652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce111be-1049-417a-90c5-ce221dda4615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:03.570641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce111be-1049-417a-90c5-ce221dda4615 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:03.570876 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce111be-1049-417a-90c5-ce221dda4615 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:03.571245 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce111be-1049-417a-90c5-ce221dda4615 admin admin] PATH_INFO: `/v3/projects/94f5d7882cae41c9b49bad54d3a48f72/users/14f79927c57645008e07848db72132e7/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:03.589956 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce111be-1049-417a-90c5-ce221dda4615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94f5d7882cae41c9b49bad54d3a48f72, user_id=14f79927c57645008e07848db72132e7, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:03.592699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce111be-1049-417a-90c5-ce221dda4615 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:03.681068 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab47c87-24e5-4b97-8809-7e5743f355f4 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:03.682151 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1278/2560] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:03 2022] PUT /identity/v3/projects/94f5d7882cae41c9b49bad54d3a48f72/users/14f79927c57645008e07848db72132e7/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:03.692902 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab47c87-24e5-4b97-8809-7e5743f355f4 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:03.757618 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee4d6d-d882-406d-b5c5-2db8150f8c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:03.758365 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee4d6d-d882-406d-b5c5-2db8150f8c88 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:03.758648 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee4d6d-d882-406d-b5c5-2db8150f8c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:03.758920 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee4d6d-d882-406d-b5c5-2db8150f8c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:03.759725 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee4d6d-d882-406d-b5c5-2db8150f8c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:03.761439 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee4d6d-d882-406d-b5c5-2db8150f8c88 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:03.773619 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1283/2561] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:03.788389 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce111be-1049-417a-90c5-ce221dda4615 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:03.789817 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce111be-1049-417a-90c5-ce221dda4615 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:03.794565 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9e353-3c68-4fd4-b510-5bfc179a5081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:03.795226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9e353-3c68-4fd4-b510-5bfc179a5081 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:03.795509 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9e353-3c68-4fd4-b510-5bfc179a5081 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:03.795823 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9e353-3c68-4fd4-b510-5bfc179a5081 admin admin] PATH_INFO: `/v3/projects/94f5d7882cae41c9b49bad54d3a48f72/users/14f79927c57645008e07848db72132e7/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:03.797784 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9e353-3c68-4fd4-b510-5bfc179a5081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94f5d7882cae41c9b49bad54d3a48f72, user_id=14f79927c57645008e07848db72132e7, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:03.800743 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9e353-3c68-4fd4-b510-5bfc179a5081 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:03.811837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1279/2562] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:03 2022] PUT /identity/v3/projects/94f5d7882cae41c9b49bad54d3a48f72/users/14f79927c57645008e07848db72132e7/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:03.823795 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfb54d-6858-4e48-95ca-cb6a08f3bea7 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:03.824088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfb54d-6858-4e48-95ca-cb6a08f3bea7 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:03.824367 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfb54d-6858-4e48-95ca-cb6a08f3bea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:03.856766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-d7bfb54d-6858-4e48-95ca-cb6a08f3bea7 None None] MFA Rules not processed for user `14f79927c57645008e07848db72132e7`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:03.858668 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-d7bfb54d-6858-4e48-95ca-cb6a08f3bea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:03.949477 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1284/2563] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:03.963718 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9e353-3c68-4fd4-b510-5bfc179a5081 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:03.966098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-bdb9e353-3c68-4fd4-b510-5bfc179a5081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:04.029005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9e353-3c68-4fd4-b510-5bfc179a5081 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:04.032699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0253e9-6dfa-40f4-a8a0-d1657ad5e653 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:04.033315 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0253e9-6dfa-40f4-a8a0-d1657ad5e653 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:04.033588 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0253e9-6dfa-40f4-a8a0-d1657ad5e653 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:04.033858 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0253e9-6dfa-40f4-a8a0-d1657ad5e653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:04.045818 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:04.090713 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0253e9-6dfa-40f4-a8a0-d1657ad5e653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:04.092641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0253e9-6dfa-40f4-a8a0-d1657ad5e653 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:04.101445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1280/2564] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:02:04.257553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bf65d-a581-488b-ae09-1fa16c38a50d None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:04.257842 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bf65d-a581-488b-ae09-1fa16c38a50d None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:04.258113 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bf65d-a581-488b-ae09-1fa16c38a50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:04.277929 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:04.284603 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-a85bf65d-a581-488b-ae09-1fa16c38a50d None None] MFA Rules not processed for user `15fbda6263b44352b3ac560372bef725`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:04.285832 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a85bf65d-a581-488b-ae09-1fa16c38a50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:04.396823 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1285/2565] 10.222.0.15 () {58 vars in 967 bytes} [Wed Sep 14 20:02:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:04.417386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0253e9-6dfa-40f4-a8a0-d1657ad5e653 service cinder] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:04.417804 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-9d0253e9-6dfa-40f4-a8a0-d1657ad5e653 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:04.515320 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0253e9-6dfa-40f4-a8a0-d1657ad5e653 service cinder] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:04.520505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81cc55-99b2-4a71-ba67-844d768cd87e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee56bf9af257486e94e6ff1b33086f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:04.520906 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81cc55-99b2-4a71-ba67-844d768cd87e service swift] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:04.521209 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81cc55-99b2-4a71-ba67-844d768cd87e service swift] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:04.521525 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81cc55-99b2-4a71-ba67-844d768cd87e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:04.529844 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81cc55-99b2-4a71-ba67-844d768cd87e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:04.531408 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81cc55-99b2-4a71-ba67-844d768cd87e service swift] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:04.539695 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1281/2566] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Sep 14 20:02:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 20:02:06.443993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bf65d-a581-488b-ae09-1fa16c38a50d None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:06.445523 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a85bf65d-a581-488b-ae09-1fa16c38a50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:06.511666 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bf65d-a581-488b-ae09-1fa16c38a50d None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:06.515313 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2b101-fdd2-4716-9a48-fbc73c5cb4e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:06.515953 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2b101-fdd2-4716-9a48-fbc73c5cb4e7 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:06.516228 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2b101-fdd2-4716-9a48-fbc73c5cb4e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:06.516500 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2b101-fdd2-4716-9a48-fbc73c5cb4e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:06.596399 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2b101-fdd2-4716-9a48-fbc73c5cb4e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:06.597850 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2b101-fdd2-4716-9a48-fbc73c5cb4e7 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:06.620653 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1286/2567] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:02:06.647587 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81cc55-99b2-4a71-ba67-844d768cd87e service swift] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:06.649080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-7b81cc55-99b2-4a71-ba67-844d768cd87e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:06.730560 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81cc55-99b2-4a71-ba67-844d768cd87e service swift] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:06.734920 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3c501-15bf-4e73-8173-926dc7bc27c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:06.741308 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3c501-15bf-4e73-8173-926dc7bc27c1 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:06.741758 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3c501-15bf-4e73-8173-926dc7bc27c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:06.742036 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3c501-15bf-4e73-8173-926dc7bc27c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:06.743903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d3e3c501-15bf-4e73-8173-926dc7bc27c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:06.799291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:06.845791 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3c501-15bf-4e73-8173-926dc7bc27c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:06.847341 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3c501-15bf-4e73-8173-926dc7bc27c1 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:06.868494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1282/2568] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:02:08.563892 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2b101-fdd2-4716-9a48-fbc73c5cb4e7 service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:08.583678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2b101-fdd2-4716-9a48-fbc73c5cb4e7 service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:08.588114 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d1a4d-5308-4d29-b559-c4aa25294c23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:08.588752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d1a4d-5308-4d29-b559-c4aa25294c23 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:08.589038 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d1a4d-5308-4d29-b559-c4aa25294c23 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:08.589364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d1a4d-5308-4d29-b559-c4aa25294c23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:08.603606 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d1a4d-5308-4d29-b559-c4aa25294c23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:08.605073 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d1a4d-5308-4d29-b559-c4aa25294c23 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:08.620301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1287/2569] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:02:11.429478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3c501-15bf-4e73-8173-926dc7bc27c1 service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:11.431086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d3e3c501-15bf-4e73-8173-926dc7bc27c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:11.444629 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3c501-15bf-4e73-8173-926dc7bc27c1 service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:11.449588 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f407dfc-2129-4194-ae90-8d2b935014aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:11.450226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f407dfc-2129-4194-ae90-8d2b935014aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:11.450506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f407dfc-2129-4194-ae90-8d2b935014aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:11.450781 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f407dfc-2129-4194-ae90-8d2b935014aa admin admin] PATH_INFO: `/v3/users/7e631060d3e0499d8df476f0b5096b3b` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:11.451936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f407dfc-2129-4194-ae90-8d2b935014aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e631060d3e0499d8df476f0b5096b3b)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:11.453935 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f407dfc-2129-4194-ae90-8d2b935014aa admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:11.643996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5f407dfc-2129-4194-ae90-8d2b935014aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e631060d3e0499d8df476f0b5096b3b'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:11.760168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5f407dfc-2129-4194-ae90-8d2b935014aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e631060d3e0499d8df476f0b5096b3b'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:11.760896 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5f407dfc-2129-4194-ae90-8d2b935014aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e631060d3e0499d8df476f0b5096b3b'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:11.771635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5f407dfc-2129-4194-ae90-8d2b935014aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e631060d3e0499d8df476f0b5096b3b'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:11.800082 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5f407dfc-2129-4194-ae90-8d2b935014aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e631060d3e0499d8df476f0b5096b3b'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:11.810595 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1283/2570] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:02:11 2022] DELETE /identity/v3/users/7e631060d3e0499d8df476f0b5096b3b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:12.087658 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d1a4d-5308-4d29-b559-c4aa25294c23 service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:12.101102 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d1a4d-5308-4d29-b559-c4aa25294c23 service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:12.138416 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:12.162048 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e719b72-aae6-4b69-876a-55b052914ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:12.162625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e719b72-aae6-4b69-876a-55b052914ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:12.162858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e719b72-aae6-4b69-876a-55b052914ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:12.163132 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e719b72-aae6-4b69-876a-55b052914ed6 admin admin] PATH_INFO: `/v3/projects/2dedc4b54c7b43e0a67f1447b89993ea` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:12.164280 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e719b72-aae6-4b69-876a-55b052914ed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dedc4b54c7b43e0a67f1447b89993ea)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:12.166225 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e719b72-aae6-4b69-876a-55b052914ed6 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:12.341791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3e719b72-aae6-4b69-876a-55b052914ed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dedc4b54c7b43e0a67f1447b89993ea', 'request_id': 'req-3e719b72-aae6-4b69-876a-55b052914ed6'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:12.497224 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3e719b72-aae6-4b69-876a-55b052914ed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dedc4b54c7b43e0a67f1447b89993ea', 'request_id': 'req-3e719b72-aae6-4b69-876a-55b052914ed6'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:12.504973 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3e719b72-aae6-4b69-876a-55b052914ed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dedc4b54c7b43e0a67f1447b89993ea', 'request_id': 'req-3e719b72-aae6-4b69-876a-55b052914ed6'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:12.517137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3e719b72-aae6-4b69-876a-55b052914ed6 admin admin] The token cache is being invalidate because project 2dedc4b54c7b43e0a67f1447b89993ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:12.524434 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3e719b72-aae6-4b69-876a-55b052914ed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:12.524434 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3e719b72-aae6-4b69-876a-55b052914ed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:12.524434 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1288/2571] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:12 2022] DELETE /identity/v3/projects/2dedc4b54c7b43e0a67f1447b89993ea => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:12.528228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110745fb-1907-4bfe-b88b-002c8d87a403 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:12.528719 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110745fb-1907-4bfe-b88b-002c8d87a403 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:12.528818 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110745fb-1907-4bfe-b88b-002c8d87a403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:12.590923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-110745fb-1907-4bfe-b88b-002c8d87a403 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:12.592239 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-110745fb-1907-4bfe-b88b-002c8d87a403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:12.638140 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:12.654526 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1284/2572] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:12.663386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476cfb4-7b3f-44a6-974f-db2059bd2706 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:12.663845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476cfb4-7b3f-44a6-974f-db2059bd2706 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:12.664151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476cfb4-7b3f-44a6-974f-db2059bd2706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:12.684175 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-4476cfb4-7b3f-44a6-974f-db2059bd2706 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:12.685409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4476cfb4-7b3f-44a6-974f-db2059bd2706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:12.693413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1289/2573] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:12.703409 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110745fb-1907-4bfe-b88b-002c8d87a403 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:12.713614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110745fb-1907-4bfe-b88b-002c8d87a403 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:12.718483 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5beb1c-965d-4634-9dd3-86129055fb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:12.719090 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5beb1c-965d-4634-9dd3-86129055fb23 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:12.719373 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5beb1c-965d-4634-9dd3-86129055fb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:12.719729 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5beb1c-965d-4634-9dd3-86129055fb23 admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:12.720398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5beb1c-965d-4634-9dd3-86129055fb23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:02:12.720705 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5beb1c-965d-4634-9dd3-86129055fb23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:12.722398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5beb1c-965d-4634-9dd3-86129055fb23 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:12.734647 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1285/2574] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 20:02:12.739079 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476cfb4-7b3f-44a6-974f-db2059bd2706 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:12.748454 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476cfb4-7b3f-44a6-974f-db2059bd2706 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:12.753133 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d37bc-5733-407c-97f7-dfd4f6eac0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:12.755440 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d37bc-5733-407c-97f7-dfd4f6eac0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:12.755440 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d37bc-5733-407c-97f7-dfd4f6eac0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:12.755440 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d37bc-5733-407c-97f7-dfd4f6eac0a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:12.755440 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d37bc-5733-407c-97f7-dfd4f6eac0a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:12.756840 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d37bc-5733-407c-97f7-dfd4f6eac0a1 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:12.880823 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1290/2575] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:02:12 2022] POST /identity/v3/projects => generated 405 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:12.885411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5beb1c-965d-4634-9dd3-86129055fb23 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:12.895388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5beb1c-965d-4634-9dd3-86129055fb23 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:12.956413 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc93c7-3082-4f01-99cd-90c9d43788c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:12.957036 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc93c7-3082-4f01-99cd-90c9d43788c1 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:12.957426 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc93c7-3082-4f01-99cd-90c9d43788c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:12.957705 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc93c7-3082-4f01-99cd-90c9d43788c1 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:12.958330 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc93c7-3082-4f01-99cd-90c9d43788c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:12.961009 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc93c7-3082-4f01-99cd-90c9d43788c1 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:13.062741 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1286/2576] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:02:12 2022] POST /identity/v3/users => generated 303 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:13.066875 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d37bc-5733-407c-97f7-dfd4f6eac0a1 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:13.078756 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d37bc-5733-407c-97f7-dfd4f6eac0a1 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:13.083910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928ac39-3c73-4990-82b1-afc3f652bac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:13.085732 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928ac39-3c73-4990-82b1-afc3f652bac1 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:13.085850 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928ac39-3c73-4990-82b1-afc3f652bac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:13.086196 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928ac39-3c73-4990-82b1-afc3f652bac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:13.087279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928ac39-3c73-4990-82b1-afc3f652bac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:13.088967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928ac39-3c73-4990-82b1-afc3f652bac1 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:13.100795 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1291/2577] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:13.104594 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc93c7-3082-4f01-99cd-90c9d43788c1 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:13.116056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc93c7-3082-4f01-99cd-90c9d43788c1 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:13.121353 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d8946-fcad-4d32-be94-6d38a695ce59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:13.121971 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d8946-fcad-4d32-be94-6d38a695ce59 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:13.122262 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d8946-fcad-4d32-be94-6d38a695ce59 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:13.122878 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d8946-fcad-4d32-be94-6d38a695ce59 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:13.123172 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d8946-fcad-4d32-be94-6d38a695ce59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:13.124819 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d8946-fcad-4d32-be94-6d38a695ce59 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:13.139561 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1287/2578] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:13.147657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928ac39-3c73-4990-82b1-afc3f652bac1 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:13.157688 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928ac39-3c73-4990-82b1-afc3f652bac1 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:13.162847 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce51b1-4ba5-41a6-8fda-2f4a6d5c95ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:13.163521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce51b1-4ba5-41a6-8fda-2f4a6d5c95ba admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:13.163840 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce51b1-4ba5-41a6-8fda-2f4a6d5c95ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:13.164117 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce51b1-4ba5-41a6-8fda-2f4a6d5c95ba admin admin] PATH_INFO: `/v3/projects/776932fd6eac4abe900cc40a9f79418b/users/2aca46730929415daf15702fa8e669d8/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:13.180286 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce51b1-4ba5-41a6-8fda-2f4a6d5c95ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=776932fd6eac4abe900cc40a9f79418b, user_id=2aca46730929415daf15702fa8e669d8, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:13.182949 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce51b1-4ba5-41a6-8fda-2f4a6d5c95ba admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:13.279492 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1292/2579] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:13 2022] PUT /identity/v3/projects/776932fd6eac4abe900cc40a9f79418b/users/2aca46730929415daf15702fa8e669d8/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:13.284776 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026a75a-779b-41eb-b5e5-ea8dd4827626 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:13.286818 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026a75a-779b-41eb-b5e5-ea8dd4827626 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:13.286818 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026a75a-779b-41eb-b5e5-ea8dd4827626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:13.304608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-c026a75a-779b-41eb-b5e5-ea8dd4827626 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:13.305874 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-c026a75a-779b-41eb-b5e5-ea8dd4827626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:13.365988 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1288/2580] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:13.375757 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce51b1-4ba5-41a6-8fda-2f4a6d5c95ba admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:13.377581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-67ce51b1-4ba5-41a6-8fda-2f4a6d5c95ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:13.435469 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:13.456717 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce51b1-4ba5-41a6-8fda-2f4a6d5c95ba admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:13.460615 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d808c-cb0d-4cd5-be64-aac98a15b44b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:13.461224 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d808c-cb0d-4cd5-be64-aac98a15b44b service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:13.461499 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d808c-cb0d-4cd5-be64-aac98a15b44b service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:13.461768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d808c-cb0d-4cd5-be64-aac98a15b44b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:13.471393 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d808c-cb0d-4cd5-be64-aac98a15b44b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:13.472838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d808c-cb0d-4cd5-be64-aac98a15b44b service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:13.482288 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1293/2581] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:02:13.622721 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026a75a-779b-41eb-b5e5-ea8dd4827626 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:13.624196 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-c026a75a-779b-41eb-b5e5-ea8dd4827626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:13.637194 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026a75a-779b-41eb-b5e5-ea8dd4827626 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:13.641972 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdcad7-ffea-4c20-9b6b-19e6dc404fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:13.642422 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdcad7-ffea-4c20-9b6b-19e6dc404fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:13.642703 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdcad7-ffea-4c20-9b6b-19e6dc404fab admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:13.642979 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdcad7-ffea-4c20-9b6b-19e6dc404fab admin admin] PATH_INFO: `/v3/users/1e311c39a06c425b8743fa743d33a899` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:13.644145 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdcad7-ffea-4c20-9b6b-19e6dc404fab admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e311c39a06c425b8743fa743d33a899)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:13.646062 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdcad7-ffea-4c20-9b6b-19e6dc404fab admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:13.916096 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-9fcdcad7-ffea-4c20-9b6b-19e6dc404fab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e311c39a06c425b8743fa743d33a899'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:13.918994 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:13.987447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-9fcdcad7-ffea-4c20-9b6b-19e6dc404fab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e311c39a06c425b8743fa743d33a899'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:13.988133 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-9fcdcad7-ffea-4c20-9b6b-19e6dc404fab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e311c39a06c425b8743fa743d33a899'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:13.996534 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-9fcdcad7-ffea-4c20-9b6b-19e6dc404fab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e311c39a06c425b8743fa743d33a899'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:14.008839 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-9fcdcad7-ffea-4c20-9b6b-19e6dc404fab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e311c39a06c425b8743fa743d33a899'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:14.015230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1289/2582] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:02:13 2022] DELETE /identity/v3/users/1e311c39a06c425b8743fa743d33a899 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:14.019848 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d694c1-d13b-4074-a149-2cc0ef405f22 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:14.020207 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d694c1-d13b-4074-a149-2cc0ef405f22 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:14.020556 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d694c1-d13b-4074-a149-2cc0ef405f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:14.040433 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-51d694c1-d13b-4074-a149-2cc0ef405f22 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:14.041744 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-51d694c1-d13b-4074-a149-2cc0ef405f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:14.104190 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1294/2583] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:02:14.114509 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdcad7-ffea-4c20-9b6b-19e6dc404fab admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:14.117316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-9fcdcad7-ffea-4c20-9b6b-19e6dc404fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:14.175489 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdcad7-ffea-4c20-9b6b-19e6dc404fab admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:14.179182 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8faeb8-87f5-4be3-a6cf-9caecbd6eb90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:14.179819 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8faeb8-87f5-4be3-a6cf-9caecbd6eb90 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:14.180097 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8faeb8-87f5-4be3-a6cf-9caecbd6eb90 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:14.180366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8faeb8-87f5-4be3-a6cf-9caecbd6eb90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:14.189157 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8faeb8-87f5-4be3-a6cf-9caecbd6eb90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:14.190584 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8faeb8-87f5-4be3-a6cf-9caecbd6eb90 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:14.199983 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1290/2584] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 20:02:14.717599 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d694c1-d13b-4074-a149-2cc0ef405f22 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:14.719033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-51d694c1-d13b-4074-a149-2cc0ef405f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:14.731883 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d694c1-d13b-4074-a149-2cc0ef405f22 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:14.736957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384118db-8f3d-4cce-8f5d-cb013c1e5fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:14.737597 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384118db-8f3d-4cce-8f5d-cb013c1e5fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:14.737874 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384118db-8f3d-4cce-8f5d-cb013c1e5fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:14.738174 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384118db-8f3d-4cce-8f5d-cb013c1e5fcb admin admin] PATH_INFO: `/v3/projects/addfe681fb8e4234b1287dbc5299ea56` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:14.739813 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384118db-8f3d-4cce-8f5d-cb013c1e5fcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=addfe681fb8e4234b1287dbc5299ea56)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:14.742360 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384118db-8f3d-4cce-8f5d-cb013c1e5fcb admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:14.858329 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-384118db-8f3d-4cce-8f5d-cb013c1e5fcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'addfe681fb8e4234b1287dbc5299ea56', 'request_id': 'req-384118db-8f3d-4cce-8f5d-cb013c1e5fcb'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:14.881526 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600229f-fd8a-4d47-9081-591d146da990 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:14.882264 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600229f-fd8a-4d47-9081-591d146da990 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:14.882648 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600229f-fd8a-4d47-9081-591d146da990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:14.913570 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-3600229f-fd8a-4d47-9081-591d146da990 None None] MFA Rules not processed for user `2aca46730929415daf15702fa8e669d8`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:14.914802 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3600229f-fd8a-4d47-9081-591d146da990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:14.925360 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-384118db-8f3d-4cce-8f5d-cb013c1e5fcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'addfe681fb8e4234b1287dbc5299ea56', 'request_id': 'req-384118db-8f3d-4cce-8f5d-cb013c1e5fcb'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:14.933095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-384118db-8f3d-4cce-8f5d-cb013c1e5fcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'addfe681fb8e4234b1287dbc5299ea56', 'request_id': 'req-384118db-8f3d-4cce-8f5d-cb013c1e5fcb'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:14.953916 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-384118db-8f3d-4cce-8f5d-cb013c1e5fcb admin admin] The token cache is being invalidate because project addfe681fb8e4234b1287dbc5299ea56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:14.954254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-384118db-8f3d-4cce-8f5d-cb013c1e5fcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:14.955428 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-384118db-8f3d-4cce-8f5d-cb013c1e5fcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:14.961914 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1295/2585] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:14 2022] DELETE /identity/v3/projects/addfe681fb8e4234b1287dbc5299ea56 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:14.962874 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384118db-8f3d-4cce-8f5d-cb013c1e5fcb admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:14.964416 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-384118db-8f3d-4cce-8f5d-cb013c1e5fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:14.988043 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1291/2586] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:14 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:02:14.998240 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600229f-fd8a-4d47-9081-591d146da990 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:14.999683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3600229f-fd8a-4d47-9081-591d146da990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:15.055316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384118db-8f3d-4cce-8f5d-cb013c1e5fcb admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:15.061110 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcfeae-7759-4ee4-a36a-7fbbfc563288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:15.061759 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcfeae-7759-4ee4-a36a-7fbbfc563288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:15.062171 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcfeae-7759-4ee4-a36a-7fbbfc563288 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:15.062456 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcfeae-7759-4ee4-a36a-7fbbfc563288 admin admin] PATH_INFO: `/v3/users/5d69c5e87c94431db3e5060b4a9f2f16` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:15.063792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcfeae-7759-4ee4-a36a-7fbbfc563288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d69c5e87c94431db3e5060b4a9f2f16)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:15.065780 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcfeae-7759-4ee4-a36a-7fbbfc563288 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:15.067667 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:15.075340 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600229f-fd8a-4d47-9081-591d146da990 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:15.080404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb3a2f-bb3f-4ec8-9539-2b8d7242bd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:15.081433 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb3a2f-bb3f-4ec8-9539-2b8d7242bd76 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:15.081678 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb3a2f-bb3f-4ec8-9539-2b8d7242bd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:15.082287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb3a2f-bb3f-4ec8-9539-2b8d7242bd76 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:15.082938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb3a2f-bb3f-4ec8-9539-2b8d7242bd76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:15.085912 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb3a2f-bb3f-4ec8-9539-2b8d7242bd76 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:15.092162 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:15.213726 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1292/2587] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:02:14 2022] POST /identity/v3/projects => generated 403 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 20:02:15.217540 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb3a2f-bb3f-4ec8-9539-2b8d7242bd76 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:15.279079 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb3a2f-bb3f-4ec8-9539-2b8d7242bd76 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:15.283795 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c4a43-44b5-4e4e-bf66-59c50b388d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:15.284402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c4a43-44b5-4e4e-bf66-59c50b388d1d admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:15.284682 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c4a43-44b5-4e4e-bf66-59c50b388d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:15.284958 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c4a43-44b5-4e4e-bf66-59c50b388d1d admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:15.285590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c4a43-44b5-4e4e-bf66-59c50b388d1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:15.287588 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c4a43-44b5-4e4e-bf66-59c50b388d1d admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:15.334669 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-f4dcfeae-7759-4ee4-a36a-7fbbfc563288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d69c5e87c94431db3e5060b4a9f2f16'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:15.410980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1293/2588] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:02:15 2022] POST /identity/v3/users => generated 308 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 20:02:15.414848 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c4a43-44b5-4e4e-bf66-59c50b388d1d admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:15.415941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-f4dcfeae-7759-4ee4-a36a-7fbbfc563288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d69c5e87c94431db3e5060b4a9f2f16'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:15.417142 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-f4dcfeae-7759-4ee4-a36a-7fbbfc563288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d69c5e87c94431db3e5060b4a9f2f16'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:15.424563 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c4a43-44b5-4e4e-bf66-59c50b388d1d admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:15.429782 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5a2f6-69d5-42b4-9736-6d1e6ff29e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:15.430083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-f4dcfeae-7759-4ee4-a36a-7fbbfc563288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d69c5e87c94431db3e5060b4a9f2f16'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:15.430570 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5a2f6-69d5-42b4-9736-6d1e6ff29e5e admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:15.430964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5a2f6-69d5-42b4-9736-6d1e6ff29e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:15.431332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5a2f6-69d5-42b4-9736-6d1e6ff29e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:15.432144 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5a2f6-69d5-42b4-9736-6d1e6ff29e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:15.434309 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5a2f6-69d5-42b4-9736-6d1e6ff29e5e admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:15.437601 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-f4dcfeae-7759-4ee4-a36a-7fbbfc563288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d69c5e87c94431db3e5060b4a9f2f16'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:15.444459 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1296/2589] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:02:14 2022] DELETE /identity/v3/users/5d69c5e87c94431db3e5060b4a9f2f16 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:15.448494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1294/2590] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 20:02:15.449561 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcfeae-7759-4ee4-a36a-7fbbfc563288 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:15.450910 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f4dcfeae-7759-4ee4-a36a-7fbbfc563288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:15.518743 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcfeae-7759-4ee4-a36a-7fbbfc563288 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:15.524327 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb263717-c179-4dd8-940e-89645fc09e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:15.525009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb263717-c179-4dd8-940e-89645fc09e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:15.525464 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb263717-c179-4dd8-940e-89645fc09e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:15.525740 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb263717-c179-4dd8-940e-89645fc09e8f admin admin] PATH_INFO: `/v3/projects/adc6a92f90a44c42aacb43c36359d295/users/75bab0acb4a945bd87c068b340612371/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:15.541429 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb263717-c179-4dd8-940e-89645fc09e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=adc6a92f90a44c42aacb43c36359d295, user_id=75bab0acb4a945bd87c068b340612371, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:15.544164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb263717-c179-4dd8-940e-89645fc09e8f admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:15.634367 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1297/2591] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:15 2022] PUT /identity/v3/projects/adc6a92f90a44c42aacb43c36359d295/users/75bab0acb4a945bd87c068b340612371/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:15.638878 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5a2f6-69d5-42b4-9736-6d1e6ff29e5e admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:15.649070 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5a2f6-69d5-42b4-9736-6d1e6ff29e5e admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:15.708857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db130111-70f6-4372-ad0e-f33c0215dcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:15.709773 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db130111-70f6-4372-ad0e-f33c0215dcb1 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:15.710136 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db130111-70f6-4372-ad0e-f33c0215dcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:15.710487 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db130111-70f6-4372-ad0e-f33c0215dcb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:15.711228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db130111-70f6-4372-ad0e-f33c0215dcb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:15.712880 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db130111-70f6-4372-ad0e-f33c0215dcb1 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:15.727163 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1295/2592] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:15.729855 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb263717-c179-4dd8-940e-89645fc09e8f admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:15.739394 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb263717-c179-4dd8-940e-89645fc09e8f admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:15.745660 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145c78c-da50-458e-b928-6aaf1e107b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:15.746525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145c78c-da50-458e-b928-6aaf1e107b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:15.746875 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145c78c-da50-458e-b928-6aaf1e107b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:15.747232 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145c78c-da50-458e-b928-6aaf1e107b4a admin admin] PATH_INFO: `/v3/projects/adc6a92f90a44c42aacb43c36359d295/users/75bab0acb4a945bd87c068b340612371/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:15.749336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145c78c-da50-458e-b928-6aaf1e107b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=adc6a92f90a44c42aacb43c36359d295, user_id=75bab0acb4a945bd87c068b340612371, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:15.752120 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145c78c-da50-458e-b928-6aaf1e107b4a admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:15.767522 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1298/2593] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:15 2022] PUT /identity/v3/projects/adc6a92f90a44c42aacb43c36359d295/users/75bab0acb4a945bd87c068b340612371/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:15.886940 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db130111-70f6-4372-ad0e-f33c0215dcb1 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:15.888919 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-db130111-70f6-4372-ad0e-f33c0215dcb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:15.919986 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db130111-70f6-4372-ad0e-f33c0215dcb1 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:15.978952 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d0139-b713-477b-b2bd-1652dfdf13d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:15.979510 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d0139-b713-477b-b2bd-1652dfdf13d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:15.979814 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d0139-b713-477b-b2bd-1652dfdf13d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:15.980083 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d0139-b713-477b-b2bd-1652dfdf13d0 admin admin] PATH_INFO: `/v3/projects/1b789ca6a86745859c19b000711408e0` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:15.981201 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d0139-b713-477b-b2bd-1652dfdf13d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b789ca6a86745859c19b000711408e0)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:15.983338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d0139-b713-477b-b2bd-1652dfdf13d0 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:15.984791 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:16.084705 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-da9d0139-b713-477b-b2bd-1652dfdf13d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b789ca6a86745859c19b000711408e0', 'request_id': 'req-da9d0139-b713-477b-b2bd-1652dfdf13d0'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:16.147366 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-da9d0139-b713-477b-b2bd-1652dfdf13d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b789ca6a86745859c19b000711408e0', 'request_id': 'req-da9d0139-b713-477b-b2bd-1652dfdf13d0'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:16.153687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-da9d0139-b713-477b-b2bd-1652dfdf13d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b789ca6a86745859c19b000711408e0', 'request_id': 'req-da9d0139-b713-477b-b2bd-1652dfdf13d0'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:16.286265 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-da9d0139-b713-477b-b2bd-1652dfdf13d0 admin admin] The token cache is being invalidate because project 1b789ca6a86745859c19b000711408e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:16.286560 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-da9d0139-b713-477b-b2bd-1652dfdf13d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:16.291034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-da9d0139-b713-477b-b2bd-1652dfdf13d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:16.295694 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1296/2594] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:15 2022] DELETE /identity/v3/projects/1b789ca6a86745859c19b000711408e0 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:16.302169 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145c78c-da50-458e-b928-6aaf1e107b4a admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:16.302169 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-5145c78c-da50-458e-b928-6aaf1e107b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:16.317112 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145c78c-da50-458e-b928-6aaf1e107b4a admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:16.365971 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:16.379422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c94654-7cbf-41e0-b125-5ee2d75aa2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:16.380181 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c94654-7cbf-41e0-b125-5ee2d75aa2ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:16.380445 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c94654-7cbf-41e0-b125-5ee2d75aa2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:16.380764 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c94654-7cbf-41e0-b125-5ee2d75aa2ad admin admin] PATH_INFO: `/v3/users/14f79927c57645008e07848db72132e7` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:16.384171 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c94654-7cbf-41e0-b125-5ee2d75aa2ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f79927c57645008e07848db72132e7)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:16.386168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c94654-7cbf-41e0-b125-5ee2d75aa2ad admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:16.572728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-62c94654-7cbf-41e0-b125-5ee2d75aa2ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f79927c57645008e07848db72132e7'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:16.633035 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-62c94654-7cbf-41e0-b125-5ee2d75aa2ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f79927c57645008e07848db72132e7'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:16.633683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-62c94654-7cbf-41e0-b125-5ee2d75aa2ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f79927c57645008e07848db72132e7'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:16.651964 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-62c94654-7cbf-41e0-b125-5ee2d75aa2ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f79927c57645008e07848db72132e7'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:16.658875 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-62c94654-7cbf-41e0-b125-5ee2d75aa2ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f79927c57645008e07848db72132e7'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:16.666266 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1299/2595] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:02:16 2022] DELETE /identity/v3/users/14f79927c57645008e07848db72132e7 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:16.927695 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdc2b0-6df4-4288-9eb2-27386d6619a0 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:16.928240 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdc2b0-6df4-4288-9eb2-27386d6619a0 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:16.928240 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdc2b0-6df4-4288-9eb2-27386d6619a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:16.960369 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-4bcdc2b0-6df4-4288-9eb2-27386d6619a0 None None] MFA Rules not processed for user `75bab0acb4a945bd87c068b340612371`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:16.961614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-4bcdc2b0-6df4-4288-9eb2-27386d6619a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:17.038175 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1297/2596] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:16 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:17.126352 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c94654-7cbf-41e0-b125-5ee2d75aa2ad admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:17.128169 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-62c94654-7cbf-41e0-b125-5ee2d75aa2ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:17.208525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c94654-7cbf-41e0-b125-5ee2d75aa2ad admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:17.213756 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7938ba-c45d-4a2f-b5f0-ea36e964457e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:17.214400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7938ba-c45d-4a2f-b5f0-ea36e964457e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:17.214677 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7938ba-c45d-4a2f-b5f0-ea36e964457e admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:17.216096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7938ba-c45d-4a2f-b5f0-ea36e964457e admin admin] PATH_INFO: `/v3/projects/94f5d7882cae41c9b49bad54d3a48f72` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:17.216096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7938ba-c45d-4a2f-b5f0-ea36e964457e admin admin] RBAC: Authorizing `identity:delete_project(project_id=94f5d7882cae41c9b49bad54d3a48f72)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:17.218041 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7938ba-c45d-4a2f-b5f0-ea36e964457e admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:17.332765 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-0f7938ba-c45d-4a2f-b5f0-ea36e964457e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94f5d7882cae41c9b49bad54d3a48f72', 'request_id': 'req-0f7938ba-c45d-4a2f-b5f0-ea36e964457e'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:17.428084 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-0f7938ba-c45d-4a2f-b5f0-ea36e964457e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94f5d7882cae41c9b49bad54d3a48f72', 'request_id': 'req-0f7938ba-c45d-4a2f-b5f0-ea36e964457e'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:17.434605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-0f7938ba-c45d-4a2f-b5f0-ea36e964457e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94f5d7882cae41c9b49bad54d3a48f72', 'request_id': 'req-0f7938ba-c45d-4a2f-b5f0-ea36e964457e'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:17.442303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:17.446770 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-0f7938ba-c45d-4a2f-b5f0-ea36e964457e admin admin] The token cache is being invalidate because project 94f5d7882cae41c9b49bad54d3a48f72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:17.447062 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-0f7938ba-c45d-4a2f-b5f0-ea36e964457e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:17.447771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-0f7938ba-c45d-4a2f-b5f0-ea36e964457e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:17.449247 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1300/2597] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:17 2022] DELETE /identity/v3/projects/94f5d7882cae41c9b49bad54d3a48f72 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:17.454108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac6bbd-9a7b-4104-a682-3f898f3758d1 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:17.454399 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac6bbd-9a7b-4104-a682-3f898f3758d1 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:17.454676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac6bbd-9a7b-4104-a682-3f898f3758d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:17.474028 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-83ac6bbd-9a7b-4104-a682-3f898f3758d1 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:17.475791 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-83ac6bbd-9a7b-4104-a682-3f898f3758d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:17.535986 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1298/2598] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:17.544205 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6766c-62db-4497-a499-3194ef2069c1 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:17.545834 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6766c-62db-4497-a499-3194ef2069c1 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:17.545834 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6766c-62db-4497-a499-3194ef2069c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:17.565160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-03f6766c-62db-4497-a499-3194ef2069c1 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:17.566367 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-03f6766c-62db-4497-a499-3194ef2069c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:17.575156 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1301/2599] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:17.579144 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac6bbd-9a7b-4104-a682-3f898f3758d1 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:17.589146 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac6bbd-9a7b-4104-a682-3f898f3758d1 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:17.593780 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca954741-6cb7-4ed7-99aa-866719f80626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:17.594530 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca954741-6cb7-4ed7-99aa-866719f80626 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:17.594812 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca954741-6cb7-4ed7-99aa-866719f80626 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:17.595147 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca954741-6cb7-4ed7-99aa-866719f80626 admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:17.595873 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca954741-6cb7-4ed7-99aa-866719f80626 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:02:17.596174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca954741-6cb7-4ed7-99aa-866719f80626 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:17.597810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca954741-6cb7-4ed7-99aa-866719f80626 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:17.627086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1299/2600] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 20:02:17.633570 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6766c-62db-4497-a499-3194ef2069c1 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:17.638766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6766c-62db-4497-a499-3194ef2069c1 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:17.643631 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3c3a7-a0ea-46be-a1fe-6615f3764614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:17.644243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3c3a7-a0ea-46be-a1fe-6615f3764614 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:17.644526 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3c3a7-a0ea-46be-a1fe-6615f3764614 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:17.644799 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3c3a7-a0ea-46be-a1fe-6615f3764614 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:17.645452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3c3a7-a0ea-46be-a1fe-6615f3764614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:17.647894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3c3a7-a0ea-46be-a1fe-6615f3764614 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:17.722677 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1302/2601] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:02:17 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:17.728711 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca954741-6cb7-4ed7-99aa-866719f80626 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:17.734411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:17.740638 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca954741-6cb7-4ed7-99aa-866719f80626 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:17.800398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca4894-5b12-4e57-90b9-2203b1d95f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:17.801012 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca4894-5b12-4e57-90b9-2203b1d95f88 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:17.801282 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca4894-5b12-4e57-90b9-2203b1d95f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:17.801550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca4894-5b12-4e57-90b9-2203b1d95f88 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:17.802231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca4894-5b12-4e57-90b9-2203b1d95f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:17.804749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca4894-5b12-4e57-90b9-2203b1d95f88 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:17.897276 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1300/2602] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:02:17 2022] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:17.901463 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3c3a7-a0ea-46be-a1fe-6615f3764614 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:17.912764 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3c3a7-a0ea-46be-a1fe-6615f3764614 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:17.917843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f57a7d-b249-4d7e-9e6b-0a553b71defc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:17.918445 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f57a7d-b249-4d7e-9e6b-0a553b71defc admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:17.918725 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f57a7d-b249-4d7e-9e6b-0a553b71defc admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:17.919001 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f57a7d-b249-4d7e-9e6b-0a553b71defc admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:17.922090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f57a7d-b249-4d7e-9e6b-0a553b71defc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:17.922090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f57a7d-b249-4d7e-9e6b-0a553b71defc admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:17.932092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1303/2603] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:17.936052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca4894-5b12-4e57-90b9-2203b1d95f88 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:17.946803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca4894-5b12-4e57-90b9-2203b1d95f88 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:17.951629 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0b482-0962-42ea-93b4-7ac499d068ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:17.952226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0b482-0962-42ea-93b4-7ac499d068ee admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:17.952498 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0b482-0962-42ea-93b4-7ac499d068ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:17.952810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0b482-0962-42ea-93b4-7ac499d068ee admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:17.953467 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0b482-0962-42ea-93b4-7ac499d068ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:17.955115 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0b482-0962-42ea-93b4-7ac499d068ee admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:17.966917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1301/2604] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:17.971078 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f57a7d-b249-4d7e-9e6b-0a553b71defc admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:17.981638 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f57a7d-b249-4d7e-9e6b-0a553b71defc admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:17.986670 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3024e13-4b4e-427c-be04-0b189f6e1db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:17.987375 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3024e13-4b4e-427c-be04-0b189f6e1db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:17.987809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3024e13-4b4e-427c-be04-0b189f6e1db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:17.987977 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3024e13-4b4e-427c-be04-0b189f6e1db6 admin admin] PATH_INFO: `/v3/projects/fcbaf7cbf8664d739555ea29f7e56698/users/a79186949f4a4c7b8d050bdd964121a8/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:18.003260 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3024e13-4b4e-427c-be04-0b189f6e1db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcbaf7cbf8664d739555ea29f7e56698, user_id=a79186949f4a4c7b8d050bdd964121a8, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:18.006141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3024e13-4b4e-427c-be04-0b189f6e1db6 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:18.108462 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1304/2605] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:17 2022] PUT /identity/v3/projects/fcbaf7cbf8664d739555ea29f7e56698/users/a79186949f4a4c7b8d050bdd964121a8/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:18.120594 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270fd77-25ca-468d-8286-474c45f507bd None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:18.120885 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270fd77-25ca-468d-8286-474c45f507bd None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:18.121189 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270fd77-25ca-468d-8286-474c45f507bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:18.150160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-e270fd77-25ca-468d-8286-474c45f507bd None None] MFA Rules not processed for user `a79186949f4a4c7b8d050bdd964121a8`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:18.151283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e270fd77-25ca-468d-8286-474c45f507bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:18.218937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1302/2606] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:18.223395 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3024e13-4b4e-427c-be04-0b189f6e1db6 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:18.263729 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270fd77-25ca-468d-8286-474c45f507bd None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:18.265125 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e270fd77-25ca-468d-8286-474c45f507bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:18.293159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3024e13-4b4e-427c-be04-0b189f6e1db6 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:18.298622 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7948d-0e06-4f8b-b4dc-c6f7a9c44e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:18.299242 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7948d-0e06-4f8b-b4dc-c6f7a9c44e6b admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:18.299532 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7948d-0e06-4f8b-b4dc-c6f7a9c44e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:18.299926 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7948d-0e06-4f8b-b4dc-c6f7a9c44e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:18.300696 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7948d-0e06-4f8b-b4dc-c6f7a9c44e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:18.302860 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7948d-0e06-4f8b-b4dc-c6f7a9c44e6b admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:18.341903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270fd77-25ca-468d-8286-474c45f507bd None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:18.346959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ba539-a02e-4a60-ad2e-9e1ad182cb55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6942a851a69b446e90a2b138f4482465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:18.347595 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ba539-a02e-4a60-ad2e-9e1ad182cb55 service placement] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:18.347880 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ba539-a02e-4a60-ad2e-9e1ad182cb55 service placement] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:18.348154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ba539-a02e-4a60-ad2e-9e1ad182cb55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:18.349994 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-545ba539-a02e-4a60-ad2e-9e1ad182cb55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:18.361610 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ba539-a02e-4a60-ad2e-9e1ad182cb55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:18.363222 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ba539-a02e-4a60-ad2e-9e1ad182cb55 service placement] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:18.369393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:18.374048 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1303/2607] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 20:02:18.402583 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1305/2608] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:02:18 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 20:02:18.409818 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ba539-a02e-4a60-ad2e-9e1ad182cb55 service placement] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:18.412269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7948d-0e06-4f8b-b4dc-c6f7a9c44e6b admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:18.416347 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-cae7948d-0e06-4f8b-b4dc-c6f7a9c44e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:18.419950 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ba539-a02e-4a60-ad2e-9e1ad182cb55 service placement] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:18.479034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b9389-9a04-4e8d-bfcd-5a60126b2497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:18.479689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b9389-9a04-4e8d-bfcd-5a60126b2497 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:18.479967 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b9389-9a04-4e8d-bfcd-5a60126b2497 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:18.480244 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b9389-9a04-4e8d-bfcd-5a60126b2497 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:18.480882 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b9389-9a04-4e8d-bfcd-5a60126b2497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:18.482810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b9389-9a04-4e8d-bfcd-5a60126b2497 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:18.486875 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7948d-0e06-4f8b-b4dc-c6f7a9c44e6b admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:18.492114 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aae0b1-83f5-4658-a23d-24a965a75aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:18.492757 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aae0b1-83f5-4658-a23d-24a965a75aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:18.493036 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aae0b1-83f5-4658-a23d-24a965a75aac admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:18.493306 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aae0b1-83f5-4658-a23d-24a965a75aac admin admin] PATH_INFO: `/v3/users/2aca46730929415daf15702fa8e669d8` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:18.494538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aae0b1-83f5-4658-a23d-24a965a75aac admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aca46730929415daf15702fa8e669d8)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:18.496587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aae0b1-83f5-4658-a23d-24a965a75aac admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:18.518967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:18.582239 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1304/2609] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:02:18 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:18.586696 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b9389-9a04-4e8d-bfcd-5a60126b2497 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:18.596259 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b9389-9a04-4e8d-bfcd-5a60126b2497 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:18.600908 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a650e50-648c-458f-8ca3-5c2f9e04c479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:18.601484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a650e50-648c-458f-8ca3-5c2f9e04c479 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:18.601761 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a650e50-648c-458f-8ca3-5c2f9e04c479 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:18.602033 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a650e50-648c-458f-8ca3-5c2f9e04c479 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:18.602662 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a650e50-648c-458f-8ca3-5c2f9e04c479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:18.604386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a650e50-648c-458f-8ca3-5c2f9e04c479 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:18.615483 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1305/2610] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 20:02:18.619347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a650e50-648c-458f-8ca3-5c2f9e04c479 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:18.628834 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a650e50-648c-458f-8ca3-5c2f9e04c479 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:18.634168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d349f-30be-440f-8c97-7c2a18eca904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:18.634734 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d349f-30be-440f-8c97-7c2a18eca904 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:18.635015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d349f-30be-440f-8c97-7c2a18eca904 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:18.639635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d349f-30be-440f-8c97-7c2a18eca904 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:18.639635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d349f-30be-440f-8c97-7c2a18eca904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:18.639635 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d349f-30be-440f-8c97-7c2a18eca904 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:18.647042 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1306/2611] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 20:02:18.650793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d349f-30be-440f-8c97-7c2a18eca904 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:18.659995 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d349f-30be-440f-8c97-7c2a18eca904 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:18.664605 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3b3c4-e01e-47d2-bd73-a4dd28e2bf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:18.665209 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3b3c4-e01e-47d2-bd73-a4dd28e2bf35 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:18.665494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3b3c4-e01e-47d2-bd73-a4dd28e2bf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:18.665773 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3b3c4-e01e-47d2-bd73-a4dd28e2bf35 admin admin] PATH_INFO: `/v3/projects/2ab4282fdbad4a8c8a3f741771994bb5/users/a13ec52530724a1780b21ae8e8271e48/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:18.681835 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3b3c4-e01e-47d2-bd73-a4dd28e2bf35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab4282fdbad4a8c8a3f741771994bb5, user_id=a13ec52530724a1780b21ae8e8271e48, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:18.684545 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3b3c4-e01e-47d2-bd73-a4dd28e2bf35 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:18.710001 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-21aae0b1-83f5-4658-a23d-24a965a75aac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aca46730929415daf15702fa8e669d8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:18.781572 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1307/2612] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:18 2022] PUT /identity/v3/projects/2ab4282fdbad4a8c8a3f741771994bb5/users/a13ec52530724a1780b21ae8e8271e48/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:18.787729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-21aae0b1-83f5-4658-a23d-24a965a75aac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aca46730929415daf15702fa8e669d8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:18.788353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-21aae0b1-83f5-4658-a23d-24a965a75aac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aca46730929415daf15702fa8e669d8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:18.792241 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2fbae-499d-4955-9e76-cea33498c0db None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:18.792527 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2fbae-499d-4955-9e76-cea33498c0db None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:18.792801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2fbae-499d-4955-9e76-cea33498c0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:18.802223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-21aae0b1-83f5-4658-a23d-24a965a75aac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aca46730929415daf15702fa8e669d8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:18.811010 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-21aae0b1-83f5-4658-a23d-24a965a75aac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aca46730929415daf15702fa8e669d8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:18.817607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1306/2613] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:02:18 2022] DELETE /identity/v3/users/2aca46730929415daf15702fa8e669d8 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:18.824575 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-59c2fbae-499d-4955-9e76-cea33498c0db None None] MFA Rules not processed for user `a13ec52530724a1780b21ae8e8271e48`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:18.825851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-59c2fbae-499d-4955-9e76-cea33498c0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:18.893761 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1308/2614] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:02:18.898589 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aae0b1-83f5-4658-a23d-24a965a75aac admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:18.900081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-21aae0b1-83f5-4658-a23d-24a965a75aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:18.972749 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aae0b1-83f5-4658-a23d-24a965a75aac admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:18.980346 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb9e35-54a1-4ece-a2b0-d7b3d73dea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:18.980981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb9e35-54a1-4ece-a2b0-d7b3d73dea6b admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:18.981262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb9e35-54a1-4ece-a2b0-d7b3d73dea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:18.981540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb9e35-54a1-4ece-a2b0-d7b3d73dea6b admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:18.982199 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb9e35-54a1-4ece-a2b0-d7b3d73dea6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:18.984415 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb9e35-54a1-4ece-a2b0-d7b3d73dea6b admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:19.104723 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2fbae-499d-4955-9e76-cea33498c0db None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:19.106204 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-59c2fbae-499d-4955-9e76-cea33498c0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:19.122754 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2fbae-499d-4955-9e76-cea33498c0db None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:19.127419 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1307/2615] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:02:18 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:19.129382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb9e35-54a1-4ece-a2b0-d7b3d73dea6b admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:19.164808 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:19.194476 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1337e-c831-40af-a898-2caceee3ae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:19.195035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1337e-c831-40af-a898-2caceee3ae71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:19.195300 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1337e-c831-40af-a898-2caceee3ae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:19.195591 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1337e-c831-40af-a898-2caceee3ae71 admin admin] PATH_INFO: `/v3/projects/776932fd6eac4abe900cc40a9f79418b` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:19.196122 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb9e35-54a1-4ece-a2b0-d7b3d73dea6b admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:19.196820 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1337e-c831-40af-a898-2caceee3ae71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=776932fd6eac4abe900cc40a9f79418b)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:19.198828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1337e-c831-40af-a898-2caceee3ae71 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:19.200799 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711a0e9-6848-43d4-8291-9ea03379b31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:19.201412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711a0e9-6848-43d4-8291-9ea03379b31c admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:19.201690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711a0e9-6848-43d4-8291-9ea03379b31c admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:19.201961 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711a0e9-6848-43d4-8291-9ea03379b31c admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:19.202602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711a0e9-6848-43d4-8291-9ea03379b31c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:19.204556 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711a0e9-6848-43d4-8291-9ea03379b31c admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:19.302153 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1308/2616] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:02:19 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 20:02:19.306869 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711a0e9-6848-43d4-8291-9ea03379b31c admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:19.317734 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711a0e9-6848-43d4-8291-9ea03379b31c admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:19.324771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cc5d5-44d3-4a6c-b535-653eade84638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:19.325429 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cc5d5-44d3-4a6c-b535-653eade84638 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:19.325712 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cc5d5-44d3-4a6c-b535-653eade84638 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:19.325988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cc5d5-44d3-4a6c-b535-653eade84638 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:19.326672 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3cc5d5-44d3-4a6c-b535-653eade84638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:19.328315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3cc5d5-44d3-4a6c-b535-653eade84638 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:19.339761 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1309/2617] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 20:02:19.343887 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cc5d5-44d3-4a6c-b535-653eade84638 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:19.344104 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5ab1337e-c831-40af-a898-2caceee3ae71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '776932fd6eac4abe900cc40a9f79418b', 'request_id': 'req-5ab1337e-c831-40af-a898-2caceee3ae71'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:19.348947 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:19.355229 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cc5d5-44d3-4a6c-b535-653eade84638 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:19.413542 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c2e01-5301-4b00-b014-21fea2475441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:19.414215 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c2e01-5301-4b00-b014-21fea2475441 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:19.414528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c2e01-5301-4b00-b014-21fea2475441 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:19.414804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c2e01-5301-4b00-b014-21fea2475441 admin admin] PATH_INFO: `/v3/projects/493e40e929b14e0c8db947838d40a049/users/6f71bce59adb42d9a65187454d75eee5/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:19.427219 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5ab1337e-c831-40af-a898-2caceee3ae71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '776932fd6eac4abe900cc40a9f79418b', 'request_id': 'req-5ab1337e-c831-40af-a898-2caceee3ae71'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:19.430206 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c2e01-5301-4b00-b014-21fea2475441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=493e40e929b14e0c8db947838d40a049, user_id=6f71bce59adb42d9a65187454d75eee5, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:19.433038 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c2e01-5301-4b00-b014-21fea2475441 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:19.433751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5ab1337e-c831-40af-a898-2caceee3ae71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '776932fd6eac4abe900cc40a9f79418b', 'request_id': 'req-5ab1337e-c831-40af-a898-2caceee3ae71'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:19.445052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5ab1337e-c831-40af-a898-2caceee3ae71 admin admin] The token cache is being invalidate because project 776932fd6eac4abe900cc40a9f79418b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:19.445282 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5ab1337e-c831-40af-a898-2caceee3ae71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:19.445927 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5ab1337e-c831-40af-a898-2caceee3ae71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:19.447397 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1309/2618] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:19 2022] DELETE /identity/v3/projects/776932fd6eac4abe900cc40a9f79418b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:19.451463 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1337e-c831-40af-a898-2caceee3ae71 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:19.452875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-5ab1337e-c831-40af-a898-2caceee3ae71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:19.465828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1337e-c831-40af-a898-2caceee3ae71 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:19.470397 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d3d0f-f848-42db-97ac-009a3367ec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:19.471002 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d3d0f-f848-42db-97ac-009a3367ec2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:19.471275 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d3d0f-f848-42db-97ac-009a3367ec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:19.471566 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d3d0f-f848-42db-97ac-009a3367ec2b admin admin] PATH_INFO: `/v3/users/75bab0acb4a945bd87c068b340612371` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:19.472716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d3d0f-f848-42db-97ac-009a3367ec2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=75bab0acb4a945bd87c068b340612371)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:19.475290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d3d0f-f848-42db-97ac-009a3367ec2b admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:19.518789 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1310/2619] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:19 2022] PUT /identity/v3/projects/493e40e929b14e0c8db947838d40a049/users/6f71bce59adb42d9a65187454d75eee5/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:19.523332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c2e01-5301-4b00-b014-21fea2475441 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:19.525005 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-b20c2e01-5301-4b00-b014-21fea2475441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:19.696030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c63d3d0f-f848-42db-97ac-009a3367ec2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75bab0acb4a945bd87c068b340612371'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:19.719262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c2e01-5301-4b00-b014-21fea2475441 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:19.723960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c133750-9651-455d-bef2-bca94ef4ed4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:19.725101 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c133750-9651-455d-bef2-bca94ef4ed4c admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:19.725376 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c133750-9651-455d-bef2-bca94ef4ed4c admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:19.725645 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c133750-9651-455d-bef2-bca94ef4ed4c admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:19.726336 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c133750-9651-455d-bef2-bca94ef4ed4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:19.727992 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c133750-9651-455d-bef2-bca94ef4ed4c admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:19.737920 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1311/2620] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 20:02:19.742562 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c133750-9651-455d-bef2-bca94ef4ed4c admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:19.751963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c133750-9651-455d-bef2-bca94ef4ed4c admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:19.756750 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea226305-561b-4a78-8f21-0feb40bcf632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:19.757374 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea226305-561b-4a78-8f21-0feb40bcf632 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:19.757646 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea226305-561b-4a78-8f21-0feb40bcf632 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:19.757912 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea226305-561b-4a78-8f21-0feb40bcf632 admin admin] PATH_INFO: `/v3/projects/493e40e929b14e0c8db947838d40a049/users/6f71bce59adb42d9a65187454d75eee5/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:19.759814 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea226305-561b-4a78-8f21-0feb40bcf632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=493e40e929b14e0c8db947838d40a049, user_id=6f71bce59adb42d9a65187454d75eee5, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:19.769593 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea226305-561b-4a78-8f21-0feb40bcf632 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:19.780967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1312/2621] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:19 2022] PUT /identity/v3/projects/493e40e929b14e0c8db947838d40a049/users/6f71bce59adb42d9a65187454d75eee5/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:19.791702 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8600070-e2b8-4c88-b99c-77257b3158cb None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:19.795600 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8600070-e2b8-4c88-b99c-77257b3158cb None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:19.795600 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8600070-e2b8-4c88-b99c-77257b3158cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:19.821092 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-c8600070-e2b8-4c88-b99c-77257b3158cb None None] MFA Rules not processed for user `6f71bce59adb42d9a65187454d75eee5`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:19.822299 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c8600070-e2b8-4c88-b99c-77257b3158cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:19.833103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c63d3d0f-f848-42db-97ac-009a3367ec2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75bab0acb4a945bd87c068b340612371'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:19.833763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c63d3d0f-f848-42db-97ac-009a3367ec2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75bab0acb4a945bd87c068b340612371'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:19.843203 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c63d3d0f-f848-42db-97ac-009a3367ec2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75bab0acb4a945bd87c068b340612371'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:19.856538 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c63d3d0f-f848-42db-97ac-009a3367ec2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75bab0acb4a945bd87c068b340612371'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:19.863050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1310/2622] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:02:19 2022] DELETE /identity/v3/users/75bab0acb4a945bd87c068b340612371 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:19.883422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:19.893239 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1313/2623] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:02:19.905203 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d3d0f-f848-42db-97ac-009a3367ec2b admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:19.906623 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-c63d3d0f-f848-42db-97ac-009a3367ec2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:19.949277 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:19.967125 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d3d0f-f848-42db-97ac-009a3367ec2b admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:19.971042 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a060e9-7987-4615-98c9-dbe5bdb7ae1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:19.971777 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a060e9-7987-4615-98c9-dbe5bdb7ae1a service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:19.972133 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a060e9-7987-4615-98c9-dbe5bdb7ae1a service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:19.972480 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a060e9-7987-4615-98c9-dbe5bdb7ae1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:19.974835 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e4a060e9-7987-4615-98c9-dbe5bdb7ae1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:20.036221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a060e9-7987-4615-98c9-dbe5bdb7ae1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:20.038451 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a060e9-7987-4615-98c9-dbe5bdb7ae1a service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:20.047265 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1311/2624] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:02:20.109649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8600070-e2b8-4c88-b99c-77257b3158cb None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:20.111172 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c8600070-e2b8-4c88-b99c-77257b3158cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:20.191712 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8600070-e2b8-4c88-b99c-77257b3158cb None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:20.248730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f056df-4b12-4147-9bf6-46d73ac666d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:20.249251 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f056df-4b12-4147-9bf6-46d73ac666d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:20.249529 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f056df-4b12-4147-9bf6-46d73ac666d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:20.249801 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f056df-4b12-4147-9bf6-46d73ac666d4 admin admin] PATH_INFO: `/v3/projects/adc6a92f90a44c42aacb43c36359d295` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:20.250918 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f056df-4b12-4147-9bf6-46d73ac666d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adc6a92f90a44c42aacb43c36359d295)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:20.252877 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f056df-4b12-4147-9bf6-46d73ac666d4 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:20.362820 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-55f056df-4b12-4147-9bf6-46d73ac666d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adc6a92f90a44c42aacb43c36359d295', 'request_id': 'req-55f056df-4b12-4147-9bf6-46d73ac666d4'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:20.484583 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-55f056df-4b12-4147-9bf6-46d73ac666d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adc6a92f90a44c42aacb43c36359d295', 'request_id': 'req-55f056df-4b12-4147-9bf6-46d73ac666d4'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:20.491576 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-55f056df-4b12-4147-9bf6-46d73ac666d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adc6a92f90a44c42aacb43c36359d295', 'request_id': 'req-55f056df-4b12-4147-9bf6-46d73ac666d4'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:20.501907 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-55f056df-4b12-4147-9bf6-46d73ac666d4 admin admin] The token cache is being invalidate because project adc6a92f90a44c42aacb43c36359d295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:20.502138 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-55f056df-4b12-4147-9bf6-46d73ac666d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:20.502769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-55f056df-4b12-4147-9bf6-46d73ac666d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:20.504284 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1314/2625] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:20 2022] DELETE /identity/v3/projects/adc6a92f90a44c42aacb43c36359d295 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:20.509967 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036897b-ba8d-4c64-962b-446982062174 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:20.510430 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036897b-ba8d-4c64-962b-446982062174 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:20.510528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036897b-ba8d-4c64-962b-446982062174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:20.530485 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-c036897b-ba8d-4c64-962b-446982062174 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:20.531706 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-c036897b-ba8d-4c64-962b-446982062174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:20.593433 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1312/2626] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:20.601469 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a6e63-8e4e-40f7-bf75-d82086a19d54 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:20.601943 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a6e63-8e4e-40f7-bf75-d82086a19d54 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:20.602038 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a6e63-8e4e-40f7-bf75-d82086a19d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:20.622173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-890a6e63-8e4e-40f7-bf75-d82086a19d54 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:20.623378 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-890a6e63-8e4e-40f7-bf75-d82086a19d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:20.632337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1315/2627] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:20.636746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036897b-ba8d-4c64-962b-446982062174 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:20.651714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036897b-ba8d-4c64-962b-446982062174 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:20.658872 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dededfca-92c6-482d-b47b-70b3f0ed4098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:20.659821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dededfca-92c6-482d-b47b-70b3f0ed4098 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:20.660098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dededfca-92c6-482d-b47b-70b3f0ed4098 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:20.660369 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dededfca-92c6-482d-b47b-70b3f0ed4098 admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:20.661022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dededfca-92c6-482d-b47b-70b3f0ed4098 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:02:20.661323 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dededfca-92c6-482d-b47b-70b3f0ed4098 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:20.663595 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dededfca-92c6-482d-b47b-70b3f0ed4098 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:20.688478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1313/2628] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 20:02:20.693737 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a6e63-8e4e-40f7-bf75-d82086a19d54 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:20.704616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a6e63-8e4e-40f7-bf75-d82086a19d54 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:20.710497 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094a47c-b00c-442b-b053-b6855fb563c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:20.711123 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094a47c-b00c-442b-b053-b6855fb563c8 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:20.711405 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094a47c-b00c-442b-b053-b6855fb563c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:20.711962 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094a47c-b00c-442b-b053-b6855fb563c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:20.712612 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094a47c-b00c-442b-b053-b6855fb563c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:20.714517 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094a47c-b00c-442b-b053-b6855fb563c8 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:20.831511 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1316/2629] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:02:20 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:20.837688 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dededfca-92c6-482d-b47b-70b3f0ed4098 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:20.849512 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dededfca-92c6-482d-b47b-70b3f0ed4098 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:20.912356 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b0fee-ca93-4df0-bdb4-6a9df70715d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:20.913106 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b0fee-ca93-4df0-bdb4-6a9df70715d9 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:20.913385 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b0fee-ca93-4df0-bdb4-6a9df70715d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:20.913657 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b0fee-ca93-4df0-bdb4-6a9df70715d9 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:20.914301 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b0fee-ca93-4df0-bdb4-6a9df70715d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:20.916681 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b0fee-ca93-4df0-bdb4-6a9df70715d9 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:21.018909 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1314/2630] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:02:20 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 20:02:21.024889 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094a47c-b00c-442b-b053-b6855fb563c8 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:21.030487 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:21.035813 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094a47c-b00c-442b-b053-b6855fb563c8 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:21.040839 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdee29e-d67e-4c3e-bada-129ce2851471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:21.041621 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdee29e-d67e-4c3e-bada-129ce2851471 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:21.041974 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdee29e-d67e-4c3e-bada-129ce2851471 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:21.042316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdee29e-d67e-4c3e-bada-129ce2851471 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:21.043031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdee29e-d67e-4c3e-bada-129ce2851471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:21.044896 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdee29e-d67e-4c3e-bada-129ce2851471 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:21.055986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1317/2631] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:21.060008 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b0fee-ca93-4df0-bdb4-6a9df70715d9 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:21.070585 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b0fee-ca93-4df0-bdb4-6a9df70715d9 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:21.075836 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de24c8-d648-4b03-9c76-0a26e32aed2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:21.076447 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de24c8-d648-4b03-9c76-0a26e32aed2c admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:21.076730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de24c8-d648-4b03-9c76-0a26e32aed2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:21.077006 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de24c8-d648-4b03-9c76-0a26e32aed2c admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:21.077658 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de24c8-d648-4b03-9c76-0a26e32aed2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:21.079249 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de24c8-d648-4b03-9c76-0a26e32aed2c admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:21.080628 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:21.090488 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1315/2632] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:21.094659 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdee29e-d67e-4c3e-bada-129ce2851471 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:21.104692 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdee29e-d67e-4c3e-bada-129ce2851471 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:21.109536 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c9013-ea09-4281-8cd4-eabc3ff8000a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:21.110192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c9013-ea09-4281-8cd4-eabc3ff8000a admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:21.110483 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c9013-ea09-4281-8cd4-eabc3ff8000a admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:21.110760 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c9013-ea09-4281-8cd4-eabc3ff8000a admin admin] PATH_INFO: `/v3/projects/8832edf1d0b64c6a93e140e14108cb4f/users/1b843bbcf5a446728cac66a2ad05454f/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:21.126605 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c9013-ea09-4281-8cd4-eabc3ff8000a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8832edf1d0b64c6a93e140e14108cb4f, user_id=1b843bbcf5a446728cac66a2ad05454f, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:21.129323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c9013-ea09-4281-8cd4-eabc3ff8000a admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:21.262528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1318/2633] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:21 2022] PUT /identity/v3/projects/8832edf1d0b64c6a93e140e14108cb4f/users/1b843bbcf5a446728cac66a2ad05454f/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:21.272943 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da0fa0-d201-443f-a64d-c16d4c34be88 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:21.273228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da0fa0-d201-443f-a64d-c16d4c34be88 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:21.273507 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da0fa0-d201-443f-a64d-c16d4c34be88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:21.301910 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-04da0fa0-d201-443f-a64d-c16d4c34be88 None None] MFA Rules not processed for user `1b843bbcf5a446728cac66a2ad05454f`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:21.303749 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-04da0fa0-d201-443f-a64d-c16d4c34be88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:21.382393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1316/2634] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:21.386989 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c9013-ea09-4281-8cd4-eabc3ff8000a admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:21.448919 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c9013-ea09-4281-8cd4-eabc3ff8000a admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:21.453697 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84b04e-2158-4918-ad69-35abd8671e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:21.454306 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84b04e-2158-4918-ad69-35abd8671e09 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:21.454587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84b04e-2158-4918-ad69-35abd8671e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:21.454916 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84b04e-2158-4918-ad69-35abd8671e09 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:21.455562 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84b04e-2158-4918-ad69-35abd8671e09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:21.457473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84b04e-2158-4918-ad69-35abd8671e09 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:21.560420 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1319/2635] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:02:21 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:21.564559 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da0fa0-d201-443f-a64d-c16d4c34be88 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:21.575106 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da0fa0-d201-443f-a64d-c16d4c34be88 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:21.631389 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8e087-280b-4e27-acc6-84d1b6aee4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:21.631963 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8e087-280b-4e27-acc6-84d1b6aee4ad admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:21.632250 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8e087-280b-4e27-acc6-84d1b6aee4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:21.642609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8e087-280b-4e27-acc6-84d1b6aee4ad admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:21.642609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8e087-280b-4e27-acc6-84d1b6aee4ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:21.642609 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8e087-280b-4e27-acc6-84d1b6aee4ad admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:21.742468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1317/2636] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:02:21 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:21.746597 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84b04e-2158-4918-ad69-35abd8671e09 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:21.757470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84b04e-2158-4918-ad69-35abd8671e09 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:21.762077 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f40ae-283a-429f-ae70-bb6cd93d108b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:21.762682 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f40ae-283a-429f-ae70-bb6cd93d108b admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:21.762998 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f40ae-283a-429f-ae70-bb6cd93d108b admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:21.763269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f40ae-283a-429f-ae70-bb6cd93d108b admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:21.763940 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f40ae-283a-429f-ae70-bb6cd93d108b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:21.765546 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f40ae-283a-429f-ae70-bb6cd93d108b admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:21.776502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1320/2637] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 20:02:21.783015 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8e087-280b-4e27-acc6-84d1b6aee4ad admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:21.794029 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8e087-280b-4e27-acc6-84d1b6aee4ad admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:21.798710 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafe961-cd25-4bb8-b622-fbfdda636672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:21.799367 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafe961-cd25-4bb8-b622-fbfdda636672 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:21.799679 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafe961-cd25-4bb8-b622-fbfdda636672 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:21.799955 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafe961-cd25-4bb8-b622-fbfdda636672 admin admin] PATH_INFO: `/v3/projects/51d1cbd9ecca4a9c92f027c74321538f/users/6c7c0df494ad41248f40a8c656cea928/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:21.815475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafe961-cd25-4bb8-b622-fbfdda636672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d1cbd9ecca4a9c92f027c74321538f, user_id=6c7c0df494ad41248f40a8c656cea928, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:21.818325 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafe961-cd25-4bb8-b622-fbfdda636672 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:21.890109 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1318/2638] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:21 2022] PUT /identity/v3/projects/51d1cbd9ecca4a9c92f027c74321538f/users/6c7c0df494ad41248f40a8c656cea928/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:21.894437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f40ae-283a-429f-ae70-bb6cd93d108b admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:21.904916 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f40ae-283a-429f-ae70-bb6cd93d108b admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:21.969700 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f192c36-97a9-458f-bd6e-52159e42d9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:21.970952 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f192c36-97a9-458f-bd6e-52159e42d9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:21.971234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f192c36-97a9-458f-bd6e-52159e42d9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:21.971510 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f192c36-97a9-458f-bd6e-52159e42d9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:21.972182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f192c36-97a9-458f-bd6e-52159e42d9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:21.973752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f192c36-97a9-458f-bd6e-52159e42d9c8 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:21.984691 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1321/2639] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:21.988899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafe961-cd25-4bb8-b622-fbfdda636672 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:22.002171 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafe961-cd25-4bb8-b622-fbfdda636672 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:22.007498 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5727bbb-c3e4-4a8f-bc82-5ae3ed4e07b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:22.008179 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5727bbb-c3e4-4a8f-bc82-5ae3ed4e07b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:22.008456 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5727bbb-c3e4-4a8f-bc82-5ae3ed4e07b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:22.008724 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5727bbb-c3e4-4a8f-bc82-5ae3ed4e07b3 admin admin] PATH_INFO: `/v3/projects/51d1cbd9ecca4a9c92f027c74321538f/users/6c7c0df494ad41248f40a8c656cea928/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:22.010608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5727bbb-c3e4-4a8f-bc82-5ae3ed4e07b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d1cbd9ecca4a9c92f027c74321538f, user_id=6c7c0df494ad41248f40a8c656cea928, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:22.013235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5727bbb-c3e4-4a8f-bc82-5ae3ed4e07b3 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:22.024403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1319/2640] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:21 2022] PUT /identity/v3/projects/51d1cbd9ecca4a9c92f027c74321538f/users/6c7c0df494ad41248f40a8c656cea928/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:22.035093 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f74c4d-1cc1-435f-9039-a8417b1b3f6f None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:22.035383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f74c4d-1cc1-435f-9039-a8417b1b3f6f None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:22.035705 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f74c4d-1cc1-435f-9039-a8417b1b3f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:22.063109 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-a7f74c4d-1cc1-435f-9039-a8417b1b3f6f None None] MFA Rules not processed for user `6c7c0df494ad41248f40a8c656cea928`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:22.064353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a7f74c4d-1cc1-435f-9039-a8417b1b3f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:22.094274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:22.147279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1322/2641] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:22.157597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5727bbb-c3e4-4a8f-bc82-5ae3ed4e07b3 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:22.159465 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f5727bbb-c3e4-4a8f-bc82-5ae3ed4e07b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:22.186876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f74c4d-1cc1-435f-9039-a8417b1b3f6f None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:22.188274 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a7f74c4d-1cc1-435f-9039-a8417b1b3f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:22.205165 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:22.220903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5727bbb-c3e4-4a8f-bc82-5ae3ed4e07b3 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:22.224649 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea8d23-56c5-411a-88db-e6e6d95eadc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:22.225339 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea8d23-56c5-411a-88db-e6e6d95eadc0 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:22.225616 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea8d23-56c5-411a-88db-e6e6d95eadc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:22.225885 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea8d23-56c5-411a-88db-e6e6d95eadc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:22.235224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea8d23-56c5-411a-88db-e6e6d95eadc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:22.237639 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea8d23-56c5-411a-88db-e6e6d95eadc0 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:22.246458 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1320/2642] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:02:22.249764 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f74c4d-1cc1-435f-9039-a8417b1b3f6f None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:22.253797 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e1b75-06a2-45b2-93e8-53cbcd6827e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:22.254524 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e1b75-06a2-45b2-93e8-53cbcd6827e2 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:22.254804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e1b75-06a2-45b2-93e8-53cbcd6827e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:22.255159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e1b75-06a2-45b2-93e8-53cbcd6827e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:22.257804 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-aa5e1b75-06a2-45b2-93e8-53cbcd6827e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:22.316390 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e1b75-06a2-45b2-93e8-53cbcd6827e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:22.317809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e1b75-06a2-45b2-93e8-53cbcd6827e2 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:22.327237 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1323/2643] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 20:02:23.385062 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea8d23-56c5-411a-88db-e6e6d95eadc0 service cinder] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:23.461017 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea8d23-56c5-411a-88db-e6e6d95eadc0 service cinder] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:23.465581 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaac240-8bea-4035-b320-a6dba6288b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:23.466205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaac240-8bea-4035-b320-a6dba6288b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:23.466483 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaac240-8bea-4035-b320-a6dba6288b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:23.466758 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaac240-8bea-4035-b320-a6dba6288b4a admin admin] PATH_INFO: `/v3/users/1b843bbcf5a446728cac66a2ad05454f` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:23.467909 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaac240-8bea-4035-b320-a6dba6288b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b843bbcf5a446728cac66a2ad05454f)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:23.469798 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaac240-8bea-4035-b320-a6dba6288b4a admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:23.689824 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-abaac240-8bea-4035-b320-a6dba6288b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b843bbcf5a446728cac66a2ad05454f'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:23.816511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-abaac240-8bea-4035-b320-a6dba6288b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b843bbcf5a446728cac66a2ad05454f'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:23.817226 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-abaac240-8bea-4035-b320-a6dba6288b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b843bbcf5a446728cac66a2ad05454f'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:23.837547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-abaac240-8bea-4035-b320-a6dba6288b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b843bbcf5a446728cac66a2ad05454f'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:23.851610 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-abaac240-8bea-4035-b320-a6dba6288b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b843bbcf5a446728cac66a2ad05454f'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:23.862844 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1321/2644] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:02:23 2022] DELETE /identity/v3/users/1b843bbcf5a446728cac66a2ad05454f => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:23.869491 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81143a-c12f-447e-adfc-c31c10ecf2ce None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:23.870284 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81143a-c12f-447e-adfc-c31c10ecf2ce None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:23.870748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81143a-c12f-447e-adfc-c31c10ecf2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:23.891019 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-af81143a-c12f-447e-adfc-c31c10ecf2ce None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:23.892390 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-af81143a-c12f-447e-adfc-c31c10ecf2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:23.953847 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaac240-8bea-4035-b320-a6dba6288b4a admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:23.955344 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-abaac240-8bea-4035-b320-a6dba6288b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:23.956589 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1324/2645] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:23.967628 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81143a-c12f-447e-adfc-c31c10ecf2ce None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:23.968990 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-af81143a-c12f-447e-adfc-c31c10ecf2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:23.989026 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:24.014505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaac240-8bea-4035-b320-a6dba6288b4a admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:24.018338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341235ad-b48d-49dc-ac2d-9305ecc09fed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:24.018983 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341235ad-b48d-49dc-ac2d-9305ecc09fed service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:24.019260 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341235ad-b48d-49dc-ac2d-9305ecc09fed service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:24.019533 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341235ad-b48d-49dc-ac2d-9305ecc09fed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:24.021363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-341235ad-b48d-49dc-ac2d-9305ecc09fed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:24.034774 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81143a-c12f-447e-adfc-c31c10ecf2ce None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:24.038091 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:24.041257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf562fb-16f1-43b0-8b38-f15d9b8121d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:24.041894 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf562fb-16f1-43b0-8b38-f15d9b8121d4 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:24.042176 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf562fb-16f1-43b0-8b38-f15d9b8121d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:24.042452 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf562fb-16f1-43b0-8b38-f15d9b8121d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:24.052171 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf562fb-16f1-43b0-8b38-f15d9b8121d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:24.054704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf562fb-16f1-43b0-8b38-f15d9b8121d4 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:24.066354 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1325/2646] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 20:02:24.094248 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341235ad-b48d-49dc-ac2d-9305ecc09fed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:24.095804 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341235ad-b48d-49dc-ac2d-9305ecc09fed service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:24.109776 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1322/2647] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 20:02:24.526698 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf562fb-16f1-43b0-8b38-f15d9b8121d4 service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:24.528203 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4bf562fb-16f1-43b0-8b38-f15d9b8121d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:24.542387 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf562fb-16f1-43b0-8b38-f15d9b8121d4 service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:24.547998 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5e278-da01-4378-b6cc-168753a67acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:24.548915 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5e278-da01-4378-b6cc-168753a67acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:24.549182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5e278-da01-4378-b6cc-168753a67acc admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:24.549458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5e278-da01-4378-b6cc-168753a67acc admin admin] PATH_INFO: `/v3/projects/8832edf1d0b64c6a93e140e14108cb4f` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:24.550640 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5e278-da01-4378-b6cc-168753a67acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8832edf1d0b64c6a93e140e14108cb4f)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:24.552644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5e278-da01-4378-b6cc-168753a67acc admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:24.690350 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-84e5e278-da01-4378-b6cc-168753a67acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8832edf1d0b64c6a93e140e14108cb4f', 'request_id': 'req-84e5e278-da01-4378-b6cc-168753a67acc'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:24.775886 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-84e5e278-da01-4378-b6cc-168753a67acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8832edf1d0b64c6a93e140e14108cb4f', 'request_id': 'req-84e5e278-da01-4378-b6cc-168753a67acc'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:24.782072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-84e5e278-da01-4378-b6cc-168753a67acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8832edf1d0b64c6a93e140e14108cb4f', 'request_id': 'req-84e5e278-da01-4378-b6cc-168753a67acc'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:24.794110 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-84e5e278-da01-4378-b6cc-168753a67acc admin admin] The token cache is being invalidate because project 8832edf1d0b64c6a93e140e14108cb4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:24.794395 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-84e5e278-da01-4378-b6cc-168753a67acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:24.795074 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-84e5e278-da01-4378-b6cc-168753a67acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:24.796633 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1326/2648] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:24 2022] DELETE /identity/v3/projects/8832edf1d0b64c6a93e140e14108cb4f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:24.800691 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341235ad-b48d-49dc-ac2d-9305ecc09fed service cinder] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:24.811422 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341235ad-b48d-49dc-ac2d-9305ecc09fed service cinder] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:24.868050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477534c9-cc51-48c2-8e3b-8afaeb0857b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:24.868705 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477534c9-cc51-48c2-8e3b-8afaeb0857b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:24.869008 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477534c9-cc51-48c2-8e3b-8afaeb0857b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:24.869279 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477534c9-cc51-48c2-8e3b-8afaeb0857b2 admin admin] PATH_INFO: `/v3/users/6c7c0df494ad41248f40a8c656cea928` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:24.870410 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477534c9-cc51-48c2-8e3b-8afaeb0857b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c7c0df494ad41248f40a8c656cea928)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:24.872398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477534c9-cc51-48c2-8e3b-8afaeb0857b2 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:25.071224 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-477534c9-cc51-48c2-8e3b-8afaeb0857b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c7c0df494ad41248f40a8c656cea928'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:25.204737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-477534c9-cc51-48c2-8e3b-8afaeb0857b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c7c0df494ad41248f40a8c656cea928'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:25.205365 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-477534c9-cc51-48c2-8e3b-8afaeb0857b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c7c0df494ad41248f40a8c656cea928'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:25.214338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-477534c9-cc51-48c2-8e3b-8afaeb0857b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c7c0df494ad41248f40a8c656cea928'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:25.227218 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-477534c9-cc51-48c2-8e3b-8afaeb0857b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c7c0df494ad41248f40a8c656cea928'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:25.233511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1323/2649] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:02:24 2022] DELETE /identity/v3/users/6c7c0df494ad41248f40a8c656cea928 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:25.870039 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5e278-da01-4378-b6cc-168753a67acc admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:25.871867 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-84e5e278-da01-4378-b6cc-168753a67acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:25.887284 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5e278-da01-4378-b6cc-168753a67acc admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:25.950896 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd829dc-d107-4758-b8cd-1bd61a98bf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:25.951580 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd829dc-d107-4758-b8cd-1bd61a98bf8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:25.951913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd829dc-d107-4758-b8cd-1bd61a98bf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:25.952196 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd829dc-d107-4758-b8cd-1bd61a98bf8a admin admin] PATH_INFO: `/v3/projects/51d1cbd9ecca4a9c92f027c74321538f` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:25.953366 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd829dc-d107-4758-b8cd-1bd61a98bf8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d1cbd9ecca4a9c92f027c74321538f)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:25.955330 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd829dc-d107-4758-b8cd-1bd61a98bf8a admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:26.078704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:26.081512 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-dfd829dc-d107-4758-b8cd-1bd61a98bf8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d1cbd9ecca4a9c92f027c74321538f', 'request_id': 'req-dfd829dc-d107-4758-b8cd-1bd61a98bf8a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:26.158875 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-dfd829dc-d107-4758-b8cd-1bd61a98bf8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d1cbd9ecca4a9c92f027c74321538f', 'request_id': 'req-dfd829dc-d107-4758-b8cd-1bd61a98bf8a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:26.165926 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-dfd829dc-d107-4758-b8cd-1bd61a98bf8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d1cbd9ecca4a9c92f027c74321538f', 'request_id': 'req-dfd829dc-d107-4758-b8cd-1bd61a98bf8a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:26.177323 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-dfd829dc-d107-4758-b8cd-1bd61a98bf8a admin admin] The token cache is being invalidate because project 51d1cbd9ecca4a9c92f027c74321538f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:26.177612 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-dfd829dc-d107-4758-b8cd-1bd61a98bf8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:26.178276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-dfd829dc-d107-4758-b8cd-1bd61a98bf8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:26.179795 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1327/2650] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:25 2022] DELETE /identity/v3/projects/51d1cbd9ecca4a9c92f027c74321538f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:26.185258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c94f7-7c67-412b-91f4-94763de44586 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:26.190020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c94f7-7c67-412b-91f4-94763de44586 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:26.190020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c94f7-7c67-412b-91f4-94763de44586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:26.207904 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-824c94f7-7c67-412b-91f4-94763de44586 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:26.209187 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-824c94f7-7c67-412b-91f4-94763de44586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:26.237316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:26.273191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1324/2651] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:02:26.281799 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e446a-799f-45d8-9ce1-3307cc0fa5b2 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:26.282139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e446a-799f-45d8-9ce1-3307cc0fa5b2 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:26.282475 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e446a-799f-45d8-9ce1-3307cc0fa5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:26.302854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-af4e446a-799f-45d8-9ce1-3307cc0fa5b2 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:26.304349 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-af4e446a-799f-45d8-9ce1-3307cc0fa5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:26.313772 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1328/2652] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:26.318034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c94f7-7c67-412b-91f4-94763de44586 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:26.329631 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c94f7-7c67-412b-91f4-94763de44586 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:26.335890 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e0b5d-0077-4b7f-8487-95876d7d2dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:26.336506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e0b5d-0077-4b7f-8487-95876d7d2dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:26.336785 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e0b5d-0077-4b7f-8487-95876d7d2dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:26.337059 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e0b5d-0077-4b7f-8487-95876d7d2dd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:26.337714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e0b5d-0077-4b7f-8487-95876d7d2dd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:02:26.338018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e0b5d-0077-4b7f-8487-95876d7d2dd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:26.339655 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e0b5d-0077-4b7f-8487-95876d7d2dd0 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:26.352684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1325/2653] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 20:02:26.357098 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e446a-799f-45d8-9ce1-3307cc0fa5b2 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:26.366919 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e446a-799f-45d8-9ce1-3307cc0fa5b2 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:26.374831 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0d5b8-76d8-4171-8858-f00a0d767b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:26.375602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0d5b8-76d8-4171-8858-f00a0d767b98 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:26.375889 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0d5b8-76d8-4171-8858-f00a0d767b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:26.376159 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0d5b8-76d8-4171-8858-f00a0d767b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:26.376805 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0d5b8-76d8-4171-8858-f00a0d767b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:26.378816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0d5b8-76d8-4171-8858-f00a0d767b98 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:26.492343 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1329/2654] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:02:26 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 20:02:26.496590 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e0b5d-0077-4b7f-8487-95876d7d2dd0 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:26.507525 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e0b5d-0077-4b7f-8487-95876d7d2dd0 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:26.563724 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bd2e8-bb48-4f60-96ed-77d97c76c2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:26.564332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bd2e8-bb48-4f60-96ed-77d97c76c2be admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:26.564608 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bd2e8-bb48-4f60-96ed-77d97c76c2be admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:26.564878 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bd2e8-bb48-4f60-96ed-77d97c76c2be admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:26.565514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bd2e8-bb48-4f60-96ed-77d97c76c2be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:26.567435 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bd2e8-bb48-4f60-96ed-77d97c76c2be admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:26.667778 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1326/2655] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:02:26 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:26.671933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0d5b8-76d8-4171-8858-f00a0d767b98 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:26.682431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0d5b8-76d8-4171-8858-f00a0d767b98 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:26.687337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2acce1-a9bb-441e-8758-e36290bdca07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:26.692303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2acce1-a9bb-441e-8758-e36290bdca07 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:26.692303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2acce1-a9bb-441e-8758-e36290bdca07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:26.692303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2acce1-a9bb-441e-8758-e36290bdca07 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:26.692303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2acce1-a9bb-441e-8758-e36290bdca07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:26.692303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2acce1-a9bb-441e-8758-e36290bdca07 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:26.706315 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1330/2656] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:26.711026 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bd2e8-bb48-4f60-96ed-77d97c76c2be admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:26.721755 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bd2e8-bb48-4f60-96ed-77d97c76c2be admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:26.726940 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84ac8e-847d-44f6-9562-3f8b386a9e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:26.727554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84ac8e-847d-44f6-9562-3f8b386a9e9c admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:26.727841 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84ac8e-847d-44f6-9562-3f8b386a9e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:26.728107 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84ac8e-847d-44f6-9562-3f8b386a9e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:26.728785 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84ac8e-847d-44f6-9562-3f8b386a9e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:26.730451 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84ac8e-847d-44f6-9562-3f8b386a9e9c admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:26.743522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1327/2657] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:26.754822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2acce1-a9bb-441e-8758-e36290bdca07 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:26.758752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2acce1-a9bb-441e-8758-e36290bdca07 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:26.764148 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed305bb0-61b8-4f54-8738-10e15b166981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:26.764887 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed305bb0-61b8-4f54-8738-10e15b166981 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:26.765191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed305bb0-61b8-4f54-8738-10e15b166981 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:26.765470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed305bb0-61b8-4f54-8738-10e15b166981 admin admin] PATH_INFO: `/v3/projects/025b873c4639416888b7e3cb093069ec/users/22d491e6e1b345bda4295a18128706e7/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:26.781385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed305bb0-61b8-4f54-8738-10e15b166981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=025b873c4639416888b7e3cb093069ec, user_id=22d491e6e1b345bda4295a18128706e7, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:26.784072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed305bb0-61b8-4f54-8738-10e15b166981 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:26.844761 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1331/2658] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:26 2022] PUT /identity/v3/projects/025b873c4639416888b7e3cb093069ec/users/22d491e6e1b345bda4295a18128706e7/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:26.855719 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c02733-cf60-4ad6-baf8-9fd4590d0eab None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:26.856007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c02733-cf60-4ad6-baf8-9fd4590d0eab None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:26.856283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c02733-cf60-4ad6-baf8-9fd4590d0eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:26.885595 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-d9c02733-cf60-4ad6-baf8-9fd4590d0eab None None] MFA Rules not processed for user `22d491e6e1b345bda4295a18128706e7`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:26.886806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d9c02733-cf60-4ad6-baf8-9fd4590d0eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:26.950254 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1328/2659] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:26.954710 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed305bb0-61b8-4f54-8738-10e15b166981 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:27.019458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed305bb0-61b8-4f54-8738-10e15b166981 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:27.025262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3766340-4b9e-4e09-9d57-adce23d30db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:27.025876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3766340-4b9e-4e09-9d57-adce23d30db3 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:27.026153 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3766340-4b9e-4e09-9d57-adce23d30db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:27.026427 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3766340-4b9e-4e09-9d57-adce23d30db3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:27.027055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3766340-4b9e-4e09-9d57-adce23d30db3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:27.029029 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3766340-4b9e-4e09-9d57-adce23d30db3 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:27.135314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1332/2660] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:02:26 2022] POST /identity/v3/projects => generated 381 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:27.136483 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c02733-cf60-4ad6-baf8-9fd4590d0eab None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:27.148615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c02733-cf60-4ad6-baf8-9fd4590d0eab None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:27.171182 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:27.210801 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f95c1-d3e8-4608-8081-504132d2f241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:27.211495 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f95c1-d3e8-4608-8081-504132d2f241 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:27.211830 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f95c1-d3e8-4608-8081-504132d2f241 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:27.212098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f95c1-d3e8-4608-8081-504132d2f241 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:27.212741 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f95c1-d3e8-4608-8081-504132d2f241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:27.214736 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f95c1-d3e8-4608-8081-504132d2f241 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:27.313637 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1329/2661] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:02:27 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 20:02:27.317619 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3766340-4b9e-4e09-9d57-adce23d30db3 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:27.328936 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3766340-4b9e-4e09-9d57-adce23d30db3 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:27.334001 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f344a-e723-4e4d-b6a3-25e5f1d50b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:27.335388 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f344a-e723-4e4d-b6a3-25e5f1d50b83 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:27.335701 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f344a-e723-4e4d-b6a3-25e5f1d50b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:27.335978 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f344a-e723-4e4d-b6a3-25e5f1d50b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:27.336644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f344a-e723-4e4d-b6a3-25e5f1d50b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:27.338228 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f344a-e723-4e4d-b6a3-25e5f1d50b83 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:27.351988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1333/2662] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:27.356454 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f95c1-d3e8-4608-8081-504132d2f241 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:27.366931 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f95c1-d3e8-4608-8081-504132d2f241 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:27.377648 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44e5d3-0237-4081-b5fe-81d4cd5f0fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:27.378228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44e5d3-0237-4081-b5fe-81d4cd5f0fc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:27.378661 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44e5d3-0237-4081-b5fe-81d4cd5f0fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:27.379000 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44e5d3-0237-4081-b5fe-81d4cd5f0fc6 admin admin] PATH_INFO: `/v3/projects/8b5f451a486540868a39ccf483e7b766/users/fc4ec4826272483e959f48e3f7dfa55c/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:27.395651 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44e5d3-0237-4081-b5fe-81d4cd5f0fc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5f451a486540868a39ccf483e7b766, user_id=fc4ec4826272483e959f48e3f7dfa55c, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:27.398842 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44e5d3-0237-4081-b5fe-81d4cd5f0fc6 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:27.496545 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1330/2663] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:27 2022] PUT /identity/v3/projects/8b5f451a486540868a39ccf483e7b766/users/fc4ec4826272483e959f48e3f7dfa55c/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:27.500491 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f344a-e723-4e4d-b6a3-25e5f1d50b83 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:27.511074 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f344a-e723-4e4d-b6a3-25e5f1d50b83 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:27.551723 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:27.567370 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430087f-ff03-4111-817f-eee5b09d3c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:27.568031 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430087f-ff03-4111-817f-eee5b09d3c0c admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:27.568322 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430087f-ff03-4111-817f-eee5b09d3c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:27.568600 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430087f-ff03-4111-817f-eee5b09d3c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:27.569868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430087f-ff03-4111-817f-eee5b09d3c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:27.571586 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430087f-ff03-4111-817f-eee5b09d3c0c admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:27.581608 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1334/2664] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 20:02:27.586528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44e5d3-0237-4081-b5fe-81d4cd5f0fc6 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:27.601799 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44e5d3-0237-4081-b5fe-81d4cd5f0fc6 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:27.602032 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29c7c0-5c16-4c5a-a516-e62c4d233873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:27.602648 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29c7c0-5c16-4c5a-a516-e62c4d233873 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:27.602931 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29c7c0-5c16-4c5a-a516-e62c4d233873 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:27.603266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29c7c0-5c16-4c5a-a516-e62c4d233873 admin admin] PATH_INFO: `/v3/projects/8b5f451a486540868a39ccf483e7b766/users/fc4ec4826272483e959f48e3f7dfa55c/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:27.605206 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29c7c0-5c16-4c5a-a516-e62c4d233873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5f451a486540868a39ccf483e7b766, user_id=fc4ec4826272483e959f48e3f7dfa55c, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:27.607822 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29c7c0-5c16-4c5a-a516-e62c4d233873 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:27.619126 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1331/2665] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:27 2022] PUT /identity/v3/projects/8b5f451a486540868a39ccf483e7b766/users/fc4ec4826272483e959f48e3f7dfa55c/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:27.633421 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89030c1-1e75-43e3-ac8c-96aa52eb9217 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:27.633616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89030c1-1e75-43e3-ac8c-96aa52eb9217 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:27.633912 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89030c1-1e75-43e3-ac8c-96aa52eb9217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:27.663257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-c89030c1-1e75-43e3-ac8c-96aa52eb9217 None None] MFA Rules not processed for user `fc4ec4826272483e959f48e3f7dfa55c`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:27.664678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c89030c1-1e75-43e3-ac8c-96aa52eb9217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:27.737759 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1335/2666] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:27.750928 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29c7c0-5c16-4c5a-a516-e62c4d233873 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:27.752684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1d29c7c0-5c16-4c5a-a516-e62c4d233873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:27.814075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29c7c0-5c16-4c5a-a516-e62c4d233873 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:27.819342 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412430a3-bdb3-4727-b9e4-faf46e357454 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:27.820242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412430a3-bdb3-4727-b9e4-faf46e357454 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:27.820657 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412430a3-bdb3-4727-b9e4-faf46e357454 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:27.820977 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412430a3-bdb3-4727-b9e4-faf46e357454 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:27.830170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412430a3-bdb3-4727-b9e4-faf46e357454 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:27.834886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412430a3-bdb3-4727-b9e4-faf46e357454 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:27.843077 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1332/2667] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:02:28.894021 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89030c1-1e75-43e3-ac8c-96aa52eb9217 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:28.905300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89030c1-1e75-43e3-ac8c-96aa52eb9217 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:28.910173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427ffea-9368-402c-baf8-160084779e0a tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc4ec4826272483e959f48e3f7dfa55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b5f451a486540868a39ccf483e7b766', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:28.910823 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427ffea-9368-402c-baf8-160084779e0a tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:28.911104 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427ffea-9368-402c-baf8-160084779e0a tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:28.911379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427ffea-9368-402c-baf8-160084779e0a tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:28.912150 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427ffea-9368-402c-baf8-160084779e0a tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:02:28.912456 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427ffea-9368-402c-baf8-160084779e0a tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:28.914051 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427ffea-9368-402c-baf8-160084779e0a tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:28.930624 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1336/2668] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 20:02:28.931891 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412430a3-bdb3-4727-b9e4-faf46e357454 service cinder] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:28.941324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412430a3-bdb3-4727-b9e4-faf46e357454 service cinder] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:28.950100 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21915a3c-9cc3-43b9-b21f-ce0cd0b69743 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc4ec4826272483e959f48e3f7dfa55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b5f451a486540868a39ccf483e7b766', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:28.950706 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21915a3c-9cc3-43b9-b21f-ce0cd0b69743 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:28.950984 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21915a3c-9cc3-43b9-b21f-ce0cd0b69743 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:28.951260 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21915a3c-9cc3-43b9-b21f-ce0cd0b69743 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:28.951932 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21915a3c-9cc3-43b9-b21f-ce0cd0b69743 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:28.953811 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21915a3c-9cc3-43b9-b21f-ce0cd0b69743 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:28.998515 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427ffea-9368-402c-baf8-160084779e0a tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:29.000383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4427ffea-9368-402c-baf8-160084779e0a tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:29.068533 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1333/2669] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:02:28 2022] POST /identity/v3/projects => generated 353 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:29.070769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21915a3c-9cc3-43b9-b21f-ce0cd0b69743 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:29.103004 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427ffea-9368-402c-baf8-160084779e0a tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:29.144407 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:29.148978 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21915a3c-9cc3-43b9-b21f-ce0cd0b69743 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:29.153947 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80409f-5aa9-4e0f-849c-8e8217ece269 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc4ec4826272483e959f48e3f7dfa55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b5f451a486540868a39ccf483e7b766', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:29.164046 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80409f-5aa9-4e0f-849c-8e8217ece269 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:29.164046 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80409f-5aa9-4e0f-849c-8e8217ece269 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:29.164046 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80409f-5aa9-4e0f-849c-8e8217ece269 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:29.164046 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80409f-5aa9-4e0f-849c-8e8217ece269 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:02:29.164046 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80409f-5aa9-4e0f-849c-8e8217ece269 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:29.164575 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80409f-5aa9-4e0f-849c-8e8217ece269 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:29.168380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69ec4f-7250-437d-ad96-d8f90508b71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:29.169061 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69ec4f-7250-437d-ad96-d8f90508b71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:29.169334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69ec4f-7250-437d-ad96-d8f90508b71e admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:29.169604 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69ec4f-7250-437d-ad96-d8f90508b71e admin admin] PATH_INFO: `/v3/users/a79186949f4a4c7b8d050bdd964121a8` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:29.170778 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69ec4f-7250-437d-ad96-d8f90508b71e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a79186949f4a4c7b8d050bdd964121a8)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:29.172732 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69ec4f-7250-437d-ad96-d8f90508b71e admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:29.174493 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:29.175616 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1334/2670] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 20:02:29.220810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80409f-5aa9-4e0f-849c-8e8217ece269 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:29.232287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80409f-5aa9-4e0f-849c-8e8217ece269 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:29.239141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a3d84-8121-41bf-86e7-90f018224e24 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc4ec4826272483e959f48e3f7dfa55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b5f451a486540868a39ccf483e7b766', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:29.240160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a3d84-8121-41bf-86e7-90f018224e24 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:29.241001 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a3d84-8121-41bf-86e7-90f018224e24 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:29.241349 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a3d84-8121-41bf-86e7-90f018224e24 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] PATH_INFO: `/v3/projects/227e34b7ab6b486fb076e6a05067aa4d` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:29.243002 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a3d84-8121-41bf-86e7-90f018224e24 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] RBAC: Authorizing `identity:delete_project(project_id=227e34b7ab6b486fb076e6a05067aa4d)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:29.245086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a3d84-8121-41bf-86e7-90f018224e24 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:29.355073 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-9e69ec4f-7250-437d-ad96-d8f90508b71e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a79186949f4a4c7b8d050bdd964121a8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:29.379679 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-2f6a3d84-8121-41bf-86e7-90f018224e24 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '227e34b7ab6b486fb076e6a05067aa4d', 'request_id': 'req-2f6a3d84-8121-41bf-86e7-90f018224e24'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:29.404562 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-9e69ec4f-7250-437d-ad96-d8f90508b71e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a79186949f4a4c7b8d050bdd964121a8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:29.405344 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-9e69ec4f-7250-437d-ad96-d8f90508b71e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a79186949f4a4c7b8d050bdd964121a8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:29.422785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-9e69ec4f-7250-437d-ad96-d8f90508b71e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a79186949f4a4c7b8d050bdd964121a8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:29.433920 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-9e69ec4f-7250-437d-ad96-d8f90508b71e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a79186949f4a4c7b8d050bdd964121a8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:29.438953 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-2f6a3d84-8121-41bf-86e7-90f018224e24 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '227e34b7ab6b486fb076e6a05067aa4d', 'request_id': 'req-2f6a3d84-8121-41bf-86e7-90f018224e24'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:29.439441 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1337/2671] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:02:28 2022] DELETE /identity/v3/users/a79186949f4a4c7b8d050bdd964121a8 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:29.445085 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8fe94-d016-4e8f-8989-d63f46b069ff None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:29.445595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8fe94-d016-4e8f-8989-d63f46b069ff None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:29.445880 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8fe94-d016-4e8f-8989-d63f46b069ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:29.450658 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-2f6a3d84-8121-41bf-86e7-90f018224e24 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '227e34b7ab6b486fb076e6a05067aa4d', 'request_id': 'req-2f6a3d84-8121-41bf-86e7-90f018224e24'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:29.462388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-2f6a3d84-8121-41bf-86e7-90f018224e24 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] The token cache is being invalidate because project 227e34b7ab6b486fb076e6a05067aa4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:29.462679 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-2f6a3d84-8121-41bf-86e7-90f018224e24 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:29.463381 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-2f6a3d84-8121-41bf-86e7-90f018224e24 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:29.464918 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1335/2672] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:29 2022] DELETE /identity/v3/projects/227e34b7ab6b486fb076e6a05067aa4d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:29.473965 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-55b8fe94-d016-4e8f-8989-d63f46b069ff None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:29.476147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-55b8fe94-d016-4e8f-8989-d63f46b069ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:29.550192 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1338/2673] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:02:29.561304 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a3d84-8121-41bf-86e7-90f018224e24 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:29.562766 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-2f6a3d84-8121-41bf-86e7-90f018224e24 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:29.639124 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a3d84-8121-41bf-86e7-90f018224e24 tempest-VolumeQuotaClassesTest-1902484647 tempest-VolumeQuotaClassesTest-1902484647-project-admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:29.700499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9290612-7beb-4825-8361-8f0ac8c2e4f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:29.701146 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9290612-7beb-4825-8361-8f0ac8c2e4f1 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:29.701425 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9290612-7beb-4825-8361-8f0ac8c2e4f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:29.701698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9290612-7beb-4825-8361-8f0ac8c2e4f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:29.713531 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9290612-7beb-4825-8361-8f0ac8c2e4f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:29.715035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9290612-7beb-4825-8361-8f0ac8c2e4f1 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:29.727020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1336/2674] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:02:30.111475 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8fe94-d016-4e8f-8989-d63f46b069ff None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:30.112988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-55b8fe94-d016-4e8f-8989-d63f46b069ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:30.125327 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8fe94-d016-4e8f-8989-d63f46b069ff None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:30.129968 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e75c1-8831-4c2b-911a-8432e9d54b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:30.132011 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e75c1-8831-4c2b-911a-8432e9d54b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:30.132011 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e75c1-8831-4c2b-911a-8432e9d54b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:30.132011 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e75c1-8831-4c2b-911a-8432e9d54b26 admin admin] PATH_INFO: `/v3/users/22d491e6e1b345bda4295a18128706e7` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:30.132305 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e75c1-8831-4c2b-911a-8432e9d54b26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d491e6e1b345bda4295a18128706e7)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:30.134181 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e75c1-8831-4c2b-911a-8432e9d54b26 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:30.155709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9290612-7beb-4825-8361-8f0ac8c2e4f1 service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:30.157229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d9290612-7beb-4825-8361-8f0ac8c2e4f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:30.172744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9290612-7beb-4825-8361-8f0ac8c2e4f1 service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:30.177650 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd339e75-0469-4423-bccc-bd6e32882972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:30.178441 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd339e75-0469-4423-bccc-bd6e32882972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:30.178816 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd339e75-0469-4423-bccc-bd6e32882972 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:30.179209 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd339e75-0469-4423-bccc-bd6e32882972 admin admin] PATH_INFO: `/v3/projects/fcbaf7cbf8664d739555ea29f7e56698` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:30.181509 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd339e75-0469-4423-bccc-bd6e32882972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcbaf7cbf8664d739555ea29f7e56698)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:30.184260 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd339e75-0469-4423-bccc-bd6e32882972 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:30.281120 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:30.310049 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-fc2e75c1-8831-4c2b-911a-8432e9d54b26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d491e6e1b345bda4295a18128706e7'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:30.312069 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-cd339e75-0469-4423-bccc-bd6e32882972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcbaf7cbf8664d739555ea29f7e56698', 'request_id': 'req-cd339e75-0469-4423-bccc-bd6e32882972'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:30.382642 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-fc2e75c1-8831-4c2b-911a-8432e9d54b26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d491e6e1b345bda4295a18128706e7'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:30.383353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-fc2e75c1-8831-4c2b-911a-8432e9d54b26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d491e6e1b345bda4295a18128706e7'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:30.396429 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-fc2e75c1-8831-4c2b-911a-8432e9d54b26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d491e6e1b345bda4295a18128706e7'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:30.399104 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:30.404346 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-fc2e75c1-8831-4c2b-911a-8432e9d54b26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d491e6e1b345bda4295a18128706e7'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:30.410248 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1339/2675] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:02:30 2022] DELETE /identity/v3/users/22d491e6e1b345bda4295a18128706e7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:30.414704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8149c-d3da-470c-a8ae-509a5475b357 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:30.417827 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8149c-d3da-470c-a8ae-509a5475b357 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:30.417827 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8149c-d3da-470c-a8ae-509a5475b357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:30.433816 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-18b8149c-d3da-470c-a8ae-509a5475b357 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:30.434963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-18b8149c-d3da-470c-a8ae-509a5475b357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:30.445029 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-cd339e75-0469-4423-bccc-bd6e32882972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcbaf7cbf8664d739555ea29f7e56698', 'request_id': 'req-cd339e75-0469-4423-bccc-bd6e32882972'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:30.460256 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-cd339e75-0469-4423-bccc-bd6e32882972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcbaf7cbf8664d739555ea29f7e56698', 'request_id': 'req-cd339e75-0469-4423-bccc-bd6e32882972'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:30.463207 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-cd339e75-0469-4423-bccc-bd6e32882972 admin admin] The token cache is being invalidate because project fcbaf7cbf8664d739555ea29f7e56698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:30.463500 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-cd339e75-0469-4423-bccc-bd6e32882972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:30.464187 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-cd339e75-0469-4423-bccc-bd6e32882972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:30.465674 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1337/2676] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:30 2022] DELETE /identity/v3/projects/fcbaf7cbf8664d739555ea29f7e56698 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:30.469485 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd339e75-0469-4423-bccc-bd6e32882972 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:30.470842 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-cd339e75-0469-4423-bccc-bd6e32882972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:30.496313 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1340/2677] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:02:30.505821 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8149c-d3da-470c-a8ae-509a5475b357 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:30.507924 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-18b8149c-d3da-470c-a8ae-509a5475b357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:30.535426 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd339e75-0469-4423-bccc-bd6e32882972 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:30.540554 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ebc7f-aa11-4933-99a4-6bbbb3e39e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:30.541264 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ebc7f-aa11-4933-99a4-6bbbb3e39e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:30.541564 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ebc7f-aa11-4933-99a4-6bbbb3e39e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:30.541857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ebc7f-aa11-4933-99a4-6bbbb3e39e86 admin admin] PATH_INFO: `/v3/users/a13ec52530724a1780b21ae8e8271e48` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:30.543176 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ebc7f-aa11-4933-99a4-6bbbb3e39e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a13ec52530724a1780b21ae8e8271e48)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:30.545309 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ebc7f-aa11-4933-99a4-6bbbb3e39e86 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:30.564674 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8149c-d3da-470c-a8ae-509a5475b357 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:30.568330 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82197d1-0a70-4e05-ab88-209c3201bb1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:30.569729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82197d1-0a70-4e05-ab88-209c3201bb1d service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:30.570013 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82197d1-0a70-4e05-ab88-209c3201bb1d service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:30.570271 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82197d1-0a70-4e05-ab88-209c3201bb1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:30.579430 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82197d1-0a70-4e05-ab88-209c3201bb1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:30.581038 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82197d1-0a70-4e05-ab88-209c3201bb1d service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:30.590906 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1341/2678] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 20:02:30.848230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-1f5ebc7f-aa11-4933-99a4-6bbbb3e39e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a13ec52530724a1780b21ae8e8271e48'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:30.936292 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-1f5ebc7f-aa11-4933-99a4-6bbbb3e39e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a13ec52530724a1780b21ae8e8271e48'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:30.936862 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-1f5ebc7f-aa11-4933-99a4-6bbbb3e39e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a13ec52530724a1780b21ae8e8271e48'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:30.945716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-1f5ebc7f-aa11-4933-99a4-6bbbb3e39e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a13ec52530724a1780b21ae8e8271e48'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:30.958628 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-1f5ebc7f-aa11-4933-99a4-6bbbb3e39e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a13ec52530724a1780b21ae8e8271e48'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:30.965290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1338/2679] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:02:30 2022] DELETE /identity/v3/users/a13ec52530724a1780b21ae8e8271e48 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:31.117695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82197d1-0a70-4e05-ab88-209c3201bb1d service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:31.119641 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f82197d1-0a70-4e05-ab88-209c3201bb1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:31.133802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82197d1-0a70-4e05-ab88-209c3201bb1d service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:31.196766 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba7231-eba7-4697-8222-c86836f8502b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:31.197342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba7231-eba7-4697-8222-c86836f8502b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:31.197617 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba7231-eba7-4697-8222-c86836f8502b admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:31.197887 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba7231-eba7-4697-8222-c86836f8502b admin admin] PATH_INFO: `/v3/projects/025b873c4639416888b7e3cb093069ec` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:31.199006 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba7231-eba7-4697-8222-c86836f8502b admin admin] RBAC: Authorizing `identity:delete_project(project_id=025b873c4639416888b7e3cb093069ec)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:31.205929 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba7231-eba7-4697-8222-c86836f8502b admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:31.455372 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:31.458518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d0ba7231-eba7-4697-8222-c86836f8502b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '025b873c4639416888b7e3cb093069ec', 'request_id': 'req-d0ba7231-eba7-4697-8222-c86836f8502b'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:31.566270 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ebc7f-aa11-4933-99a4-6bbbb3e39e86 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:31.567840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1f5ebc7f-aa11-4933-99a4-6bbbb3e39e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:31.581644 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ebc7f-aa11-4933-99a4-6bbbb3e39e86 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:31.588683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d0ba7231-eba7-4697-8222-c86836f8502b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '025b873c4639416888b7e3cb093069ec', 'request_id': 'req-d0ba7231-eba7-4697-8222-c86836f8502b'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:31.595607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d0ba7231-eba7-4697-8222-c86836f8502b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '025b873c4639416888b7e3cb093069ec', 'request_id': 'req-d0ba7231-eba7-4697-8222-c86836f8502b'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:31.609367 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d0ba7231-eba7-4697-8222-c86836f8502b admin admin] The token cache is being invalidate because project 025b873c4639416888b7e3cb093069ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:31.609664 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d0ba7231-eba7-4697-8222-c86836f8502b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:31.610345 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-d0ba7231-eba7-4697-8222-c86836f8502b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:31.611886 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1342/2680] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:31 2022] DELETE /identity/v3/projects/025b873c4639416888b7e3cb093069ec => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:31.615665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba7231-eba7-4697-8222-c86836f8502b admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:31.617311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-d0ba7231-eba7-4697-8222-c86836f8502b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:31.626513 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:31.651945 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa482223-80fc-4251-b228-9235d288437c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:31.652593 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa482223-80fc-4251-b228-9235d288437c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:31.652878 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa482223-80fc-4251-b228-9235d288437c admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:31.653152 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa482223-80fc-4251-b228-9235d288437c admin admin] PATH_INFO: `/v3/projects/2ab4282fdbad4a8c8a3f741771994bb5` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:31.654338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa482223-80fc-4251-b228-9235d288437c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab4282fdbad4a8c8a3f741771994bb5)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:31.656283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa482223-80fc-4251-b228-9235d288437c admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:31.683560 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba7231-eba7-4697-8222-c86836f8502b admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:31.688850 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cf6ef-2d0f-47cb-b59c-d43eeea8e35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:31.694298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cf6ef-2d0f-47cb-b59c-d43eeea8e35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:31.694298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cf6ef-2d0f-47cb-b59c-d43eeea8e35e admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:31.694298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cf6ef-2d0f-47cb-b59c-d43eeea8e35e admin admin] PATH_INFO: `/v3/users/fc4ec4826272483e959f48e3f7dfa55c` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:31.694298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cf6ef-2d0f-47cb-b59c-d43eeea8e35e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc4ec4826272483e959f48e3f7dfa55c)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:31.694298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cf6ef-2d0f-47cb-b59c-d43eeea8e35e admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:31.788100 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-fa482223-80fc-4251-b228-9235d288437c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab4282fdbad4a8c8a3f741771994bb5', 'request_id': 'req-fa482223-80fc-4251-b228-9235d288437c'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:31.873325 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-fa482223-80fc-4251-b228-9235d288437c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab4282fdbad4a8c8a3f741771994bb5', 'request_id': 'req-fa482223-80fc-4251-b228-9235d288437c'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:31.883371 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-fa482223-80fc-4251-b228-9235d288437c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab4282fdbad4a8c8a3f741771994bb5', 'request_id': 'req-fa482223-80fc-4251-b228-9235d288437c'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:31.899683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-fa482223-80fc-4251-b228-9235d288437c admin admin] The token cache is being invalidate because project 2ab4282fdbad4a8c8a3f741771994bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:31.900154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-fa482223-80fc-4251-b228-9235d288437c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:31.901399 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-fa482223-80fc-4251-b228-9235d288437c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:31.904063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1339/2681] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:31 2022] DELETE /identity/v3/projects/2ab4282fdbad4a8c8a3f741771994bb5 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:31.907992 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa482223-80fc-4251-b228-9235d288437c admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:31.909311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-fa482223-80fc-4251-b228-9235d288437c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:31.915622 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2d8cf6ef-2d0f-47cb-b59c-d43eeea8e35e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc4ec4826272483e959f48e3f7dfa55c'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:31.971598 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa482223-80fc-4251-b228-9235d288437c admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:31.976229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e4397-8dd0-4e65-9c05-ddfb28fbfa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:31.976850 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e4397-8dd0-4e65-9c05-ddfb28fbfa75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:31.977126 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e4397-8dd0-4e65-9c05-ddfb28fbfa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:31.977395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e4397-8dd0-4e65-9c05-ddfb28fbfa75 admin admin] PATH_INFO: `/v3/users/6f71bce59adb42d9a65187454d75eee5` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:31.978511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e4397-8dd0-4e65-9c05-ddfb28fbfa75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f71bce59adb42d9a65187454d75eee5)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:31.980496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e4397-8dd0-4e65-9c05-ddfb28fbfa75 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:32.010391 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2d8cf6ef-2d0f-47cb-b59c-d43eeea8e35e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc4ec4826272483e959f48e3f7dfa55c'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:32.011028 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2d8cf6ef-2d0f-47cb-b59c-d43eeea8e35e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc4ec4826272483e959f48e3f7dfa55c'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:32.024372 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2d8cf6ef-2d0f-47cb-b59c-d43eeea8e35e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc4ec4826272483e959f48e3f7dfa55c'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:32.031664 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2d8cf6ef-2d0f-47cb-b59c-d43eeea8e35e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc4ec4826272483e959f48e3f7dfa55c'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:32.037797 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1343/2682] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:02:31 2022] DELETE /identity/v3/users/fc4ec4826272483e959f48e3f7dfa55c => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:32.207161 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-0d5e4397-8dd0-4e65-9c05-ddfb28fbfa75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f71bce59adb42d9a65187454d75eee5'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:32.295849 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-0d5e4397-8dd0-4e65-9c05-ddfb28fbfa75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f71bce59adb42d9a65187454d75eee5'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:32.296536 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-0d5e4397-8dd0-4e65-9c05-ddfb28fbfa75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f71bce59adb42d9a65187454d75eee5'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:32.305197 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-0d5e4397-8dd0-4e65-9c05-ddfb28fbfa75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f71bce59adb42d9a65187454d75eee5'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:32.317418 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-0d5e4397-8dd0-4e65-9c05-ddfb28fbfa75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f71bce59adb42d9a65187454d75eee5'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:32.324760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1340/2683] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:02:31 2022] DELETE /identity/v3/users/6f71bce59adb42d9a65187454d75eee5 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:32.354011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:32.474379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cf6ef-2d0f-47cb-b59c-d43eeea8e35e admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:32.476668 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-2d8cf6ef-2d0f-47cb-b59c-d43eeea8e35e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:32.529799 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:32.555447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cf6ef-2d0f-47cb-b59c-d43eeea8e35e admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:32.611763 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd8e11-ba64-4d71-9af9-241e4ad9bd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:32.612407 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd8e11-ba64-4d71-9af9-241e4ad9bd9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:32.612845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd8e11-ba64-4d71-9af9-241e4ad9bd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:32.613131 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd8e11-ba64-4d71-9af9-241e4ad9bd9e admin admin] PATH_INFO: `/v3/projects/8b5f451a486540868a39ccf483e7b766` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:32.614307 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd8e11-ba64-4d71-9af9-241e4ad9bd9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5f451a486540868a39ccf483e7b766)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:32.617045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd8e11-ba64-4d71-9af9-241e4ad9bd9e admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:32.730496 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-93bd8e11-ba64-4d71-9af9-241e4ad9bd9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5f451a486540868a39ccf483e7b766', 'request_id': 'req-93bd8e11-ba64-4d71-9af9-241e4ad9bd9e'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:32.749348 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e4397-8dd0-4e65-9c05-ddfb28fbfa75 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:32.750906 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0d5e4397-8dd0-4e65-9c05-ddfb28fbfa75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:32.764333 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e4397-8dd0-4e65-9c05-ddfb28fbfa75 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:32.821700 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-93bd8e11-ba64-4d71-9af9-241e4ad9bd9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5f451a486540868a39ccf483e7b766', 'request_id': 'req-93bd8e11-ba64-4d71-9af9-241e4ad9bd9e'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:32.821940 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50339f57-2b4e-466b-8b5e-8de92fe206b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:32.822596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50339f57-2b4e-466b-8b5e-8de92fe206b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:32.822917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50339f57-2b4e-466b-8b5e-8de92fe206b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:32.823152 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50339f57-2b4e-466b-8b5e-8de92fe206b0 admin admin] PATH_INFO: `/v3/projects/493e40e929b14e0c8db947838d40a049` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:32.824344 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50339f57-2b4e-466b-8b5e-8de92fe206b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=493e40e929b14e0c8db947838d40a049)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:32.826259 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50339f57-2b4e-466b-8b5e-8de92fe206b0 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:32.827818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-93bd8e11-ba64-4d71-9af9-241e4ad9bd9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5f451a486540868a39ccf483e7b766', 'request_id': 'req-93bd8e11-ba64-4d71-9af9-241e4ad9bd9e'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:32.839979 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-93bd8e11-ba64-4d71-9af9-241e4ad9bd9e admin admin] The token cache is being invalidate because project 8b5f451a486540868a39ccf483e7b766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:32.840297 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-93bd8e11-ba64-4d71-9af9-241e4ad9bd9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:32.840958 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-93bd8e11-ba64-4d71-9af9-241e4ad9bd9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:32.842654 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1344/2684] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:32 2022] DELETE /identity/v3/projects/8b5f451a486540868a39ccf483e7b766 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:32.847384 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a2720-7b85-42a9-a2fa-77f7ac624031 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:32.847772 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a2720-7b85-42a9-a2fa-77f7ac624031 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:32.848043 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a2720-7b85-42a9-a2fa-77f7ac624031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:32.868164 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-4d8a2720-7b85-42a9-a2fa-77f7ac624031 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:32.869361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4d8a2720-7b85-42a9-a2fa-77f7ac624031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:32.877145 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1345/2685] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:32.886752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b35b9-f46e-4984-9065-77bf60d0ce2e None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:32.887036 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b35b9-f46e-4984-9065-77bf60d0ce2e None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:32.887304 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b35b9-f46e-4984-9065-77bf60d0ce2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:32.907602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-4f1b35b9-f46e-4984-9065-77bf60d0ce2e None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:32.908770 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4f1b35b9-f46e-4984-9065-77bf60d0ce2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:32.917290 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1346/2686] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:02:32.921276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b35b9-f46e-4984-9065-77bf60d0ce2e None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:32.930303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b35b9-f46e-4984-9065-77bf60d0ce2e None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:32.936010 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bc3a1-d821-431d-8c8d-a00802e6accf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:32.936611 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bc3a1-d821-431d-8c8d-a00802e6accf admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:32.936886 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bc3a1-d821-431d-8c8d-a00802e6accf admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:32.937151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bc3a1-d821-431d-8c8d-a00802e6accf admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:32.937771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046bc3a1-d821-431d-8c8d-a00802e6accf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:02:32.938071 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046bc3a1-d821-431d-8c8d-a00802e6accf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:32.939733 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046bc3a1-d821-431d-8c8d-a00802e6accf admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:32.952179 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1347/2687] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 20:02:32.958248 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bc3a1-d821-431d-8c8d-a00802e6accf admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:32.966622 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-50339f57-2b4e-466b-8b5e-8de92fe206b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '493e40e929b14e0c8db947838d40a049', 'request_id': 'req-50339f57-2b4e-466b-8b5e-8de92fe206b0'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:32.968332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bc3a1-d821-431d-8c8d-a00802e6accf admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:33.019182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:33.026594 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1458d-cf2e-44bb-8c29-d45afc701861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:33.027203 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1458d-cf2e-44bb-8c29-d45afc701861 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:33.027482 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1458d-cf2e-44bb-8c29-d45afc701861 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:33.027782 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1458d-cf2e-44bb-8c29-d45afc701861 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:33.028401 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1458d-cf2e-44bb-8c29-d45afc701861 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:33.030411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1458d-cf2e-44bb-8c29-d45afc701861 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:33.056074 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-50339f57-2b4e-466b-8b5e-8de92fe206b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '493e40e929b14e0c8db947838d40a049', 'request_id': 'req-50339f57-2b4e-466b-8b5e-8de92fe206b0'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:33.062430 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-50339f57-2b4e-466b-8b5e-8de92fe206b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '493e40e929b14e0c8db947838d40a049', 'request_id': 'req-50339f57-2b4e-466b-8b5e-8de92fe206b0'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:33.074272 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-50339f57-2b4e-466b-8b5e-8de92fe206b0 admin admin] The token cache is being invalidate because project 493e40e929b14e0c8db947838d40a049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:33.074504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-50339f57-2b4e-466b-8b5e-8de92fe206b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:33.075188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-50339f57-2b4e-466b-8b5e-8de92fe206b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:33.076828 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1341/2688] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:32 2022] DELETE /identity/v3/projects/493e40e929b14e0c8db947838d40a049 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:33.081387 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd56ec-b441-4e1f-9c66-9b391254f457 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:33.081676 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd56ec-b441-4e1f-9c66-9b391254f457 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:33.081955 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd56ec-b441-4e1f-9c66-9b391254f457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:33.103330 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-76bd56ec-b441-4e1f-9c66-9b391254f457 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:33.104672 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-76bd56ec-b441-4e1f-9c66-9b391254f457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:33.112768 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1342/2689] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:02:33.121957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1348/2690] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:02:32 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 20:02:33.126888 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd56ec-b441-4e1f-9c66-9b391254f457 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:33.128407 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-76bd56ec-b441-4e1f-9c66-9b391254f457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:33.141610 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd56ec-b441-4e1f-9c66-9b391254f457 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:33.177855 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98296d2-ec63-46e3-b0f0-958054a4dd15 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:33.178212 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98296d2-ec63-46e3-b0f0-958054a4dd15 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:33.178538 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98296d2-ec63-46e3-b0f0-958054a4dd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:33.198505 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-c98296d2-ec63-46e3-b0f0-958054a4dd15 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:33.199744 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c98296d2-ec63-46e3-b0f0-958054a4dd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:33.202511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d4996-ae00-4b9e-81d2-ea85c34fcff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:33.203128 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d4996-ae00-4b9e-81d2-ea85c34fcff3 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:33.203422 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d4996-ae00-4b9e-81d2-ea85c34fcff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:33.203703 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d4996-ae00-4b9e-81d2-ea85c34fcff3 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:33.204340 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d4996-ae00-4b9e-81d2-ea85c34fcff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:33.206240 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d4996-ae00-4b9e-81d2-ea85c34fcff3 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:33.208444 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1349/2691] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:33.213243 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98296d2-ec63-46e3-b0f0-958054a4dd15 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:33.224068 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98296d2-ec63-46e3-b0f0-958054a4dd15 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:33.233930 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71950edb-47de-4287-b618-0cd9bc16ab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:33.233930 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71950edb-47de-4287-b618-0cd9bc16ab20 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:33.233930 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71950edb-47de-4287-b618-0cd9bc16ab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:33.233930 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71950edb-47de-4287-b618-0cd9bc16ab20 admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:33.234343 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71950edb-47de-4287-b618-0cd9bc16ab20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:02:33.234343 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71950edb-47de-4287-b618-0cd9bc16ab20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:33.234343 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71950edb-47de-4287-b618-0cd9bc16ab20 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:33.248600 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1350/2692] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 20:02:33.249865 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71950edb-47de-4287-b618-0cd9bc16ab20 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:33.261048 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71950edb-47de-4287-b618-0cd9bc16ab20 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:33.266876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b347f19-36bd-4845-98a3-bd32efb9d9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:33.266876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b347f19-36bd-4845-98a3-bd32efb9d9ff admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:33.266876 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b347f19-36bd-4845-98a3-bd32efb9d9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:33.267197 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b347f19-36bd-4845-98a3-bd32efb9d9ff admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:33.267563 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b347f19-36bd-4845-98a3-bd32efb9d9ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:33.269448 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b347f19-36bd-4845-98a3-bd32efb9d9ff admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:33.388159 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:33.394188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1343/2693] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:02:33 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:33.398953 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d4996-ae00-4b9e-81d2-ea85c34fcff3 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:33.408246 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d4996-ae00-4b9e-81d2-ea85c34fcff3 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:33.412897 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296be1ce-298d-4e03-b81f-800d3e8b08a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:33.413502 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296be1ce-298d-4e03-b81f-800d3e8b08a0 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:33.413780 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296be1ce-298d-4e03-b81f-800d3e8b08a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:33.414053 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296be1ce-298d-4e03-b81f-800d3e8b08a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:33.414738 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296be1ce-298d-4e03-b81f-800d3e8b08a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:33.417273 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296be1ce-298d-4e03-b81f-800d3e8b08a0 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:33.423150 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1351/2694] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:02:33 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 20:02:33.427566 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b347f19-36bd-4845-98a3-bd32efb9d9ff admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:33.427693 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1344/2695] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 20:02:33.442737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296be1ce-298d-4e03-b81f-800d3e8b08a0 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:33.453288 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296be1ce-298d-4e03-b81f-800d3e8b08a0 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:33.489762 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b347f19-36bd-4845-98a3-bd32efb9d9ff admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:33.494754 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6e83d-8a90-49dd-b053-887e136598a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:33.495364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6e83d-8a90-49dd-b053-887e136598a6 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:33.495660 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6e83d-8a90-49dd-b053-887e136598a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:33.495929 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6e83d-8a90-49dd-b053-887e136598a6 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:33.496547 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6e83d-8a90-49dd-b053-887e136598a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:33.498505 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6e83d-8a90-49dd-b053-887e136598a6 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:33.509658 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c37a42-c8ab-4af6-9a4e-e971dc9517b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:33.510323 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c37a42-c8ab-4af6-9a4e-e971dc9517b3 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:33.510598 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c37a42-c8ab-4af6-9a4e-e971dc9517b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:33.510868 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c37a42-c8ab-4af6-9a4e-e971dc9517b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:33.511506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c37a42-c8ab-4af6-9a4e-e971dc9517b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:33.513117 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c37a42-c8ab-4af6-9a4e-e971dc9517b3 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:33.523390 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1345/2696] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 20:02:33.527434 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c37a42-c8ab-4af6-9a4e-e971dc9517b3 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:33.536729 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c37a42-c8ab-4af6-9a4e-e971dc9517b3 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:33.542542 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd9316-58b5-48fe-b229-474ac508e79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:33.543157 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd9316-58b5-48fe-b229-474ac508e79e admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:33.543563 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd9316-58b5-48fe-b229-474ac508e79e admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:33.543843 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd9316-58b5-48fe-b229-474ac508e79e admin admin] PATH_INFO: `/v3/projects/d60663c8c63a4a8cb68dd16c4cfb707f/users/47b13f23d57f4b368b82f3e77137feb5/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:33.559154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd9316-58b5-48fe-b229-474ac508e79e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60663c8c63a4a8cb68dd16c4cfb707f, user_id=47b13f23d57f4b368b82f3e77137feb5, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:33.561997 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd9316-58b5-48fe-b229-474ac508e79e admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:33.582237 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1352/2697] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:02:33 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 20:02:33.587402 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6e83d-8a90-49dd-b053-887e136598a6 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:33.597114 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6e83d-8a90-49dd-b053-887e136598a6 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:33.601756 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e774b-0498-4145-aca5-1817fb6d8a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:33.602335 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e774b-0498-4145-aca5-1817fb6d8a5a admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:33.602610 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e774b-0498-4145-aca5-1817fb6d8a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:33.602882 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e774b-0498-4145-aca5-1817fb6d8a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:33.603514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e774b-0498-4145-aca5-1817fb6d8a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:33.605101 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e774b-0498-4145-aca5-1817fb6d8a5a admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:33.615120 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1353/2698] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 20:02:33.619456 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e774b-0498-4145-aca5-1817fb6d8a5a admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:33.628783 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e774b-0498-4145-aca5-1817fb6d8a5a admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:33.633980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658cc2f5-789e-4255-ae72-ba910f81c9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:33.634537 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cc2f5-789e-4255-ae72-ba910f81c9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:33.634813 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cc2f5-789e-4255-ae72-ba910f81c9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:33.635084 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cc2f5-789e-4255-ae72-ba910f81c9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:33.635712 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658cc2f5-789e-4255-ae72-ba910f81c9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:33.637226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658cc2f5-789e-4255-ae72-ba910f81c9c0 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:33.647451 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1354/2699] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 20:02:33.651409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658cc2f5-789e-4255-ae72-ba910f81c9c0 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:33.653084 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1346/2700] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:33 2022] PUT /identity/v3/projects/d60663c8c63a4a8cb68dd16c4cfb707f/users/47b13f23d57f4b368b82f3e77137feb5/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:33.661075 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658cc2f5-789e-4255-ae72-ba910f81c9c0 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:33.663189 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db1e12-7e16-4562-be50-2b44af0fb276 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:33.663477 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db1e12-7e16-4562-be50-2b44af0fb276 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:33.663942 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db1e12-7e16-4562-be50-2b44af0fb276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:33.692084 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-e5db1e12-7e16-4562-be50-2b44af0fb276 None None] MFA Rules not processed for user `47b13f23d57f4b368b82f3e77137feb5`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:33.693328 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e5db1e12-7e16-4562-be50-2b44af0fb276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:33.719116 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4a33d-9658-4cfd-b088-21d047e52a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:33.719818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4a33d-9658-4cfd-b088-21d047e52a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:33.720108 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4a33d-9658-4cfd-b088-21d047e52a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:33.720387 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4a33d-9658-4cfd-b088-21d047e52a50 admin admin] PATH_INFO: `/v3/projects/474add9dfa224541b97aadfd9a731322/users/1fbf649476634298be17ca1b8e958850/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:33.731582 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:33.735872 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4a33d-9658-4cfd-b088-21d047e52a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=474add9dfa224541b97aadfd9a731322, user_id=1fbf649476634298be17ca1b8e958850, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:33.738588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4a33d-9658-4cfd-b088-21d047e52a50 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:33.764738 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1347/2701] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:02:33.769221 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db1e12-7e16-4562-be50-2b44af0fb276 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:33.779377 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db1e12-7e16-4562-be50-2b44af0fb276 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:33.784059 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56693fa-0ac9-499b-8a77-4340f762b265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:33.784646 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56693fa-0ac9-499b-8a77-4340f762b265 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:33.784927 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56693fa-0ac9-499b-8a77-4340f762b265 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:33.785198 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56693fa-0ac9-499b-8a77-4340f762b265 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:33.785826 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56693fa-0ac9-499b-8a77-4340f762b265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:33.787757 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56693fa-0ac9-499b-8a77-4340f762b265 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:33.828135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1355/2702] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:33 2022] PUT /identity/v3/projects/474add9dfa224541b97aadfd9a731322/users/1fbf649476634298be17ca1b8e958850/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:33.838426 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9d290-b31d-497c-a990-4e3d41ffc4c7 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:33.838708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9d290-b31d-497c-a990-4e3d41ffc4c7 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:33.838983 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9d290-b31d-497c-a990-4e3d41ffc4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:33.867083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-f8d9d290-b31d-497c-a990-4e3d41ffc4c7 None None] MFA Rules not processed for user `1fbf649476634298be17ca1b8e958850`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:33.868431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f8d9d290-b31d-497c-a990-4e3d41ffc4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:33.912328 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1348/2703] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:02:33 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 20:02:33.916383 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56693fa-0ac9-499b-8a77-4340f762b265 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:33.936808 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1356/2704] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:02:33.948558 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:33.950501 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9d290-b31d-497c-a990-4e3d41ffc4c7 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:33.951993 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f8d9d290-b31d-497c-a990-4e3d41ffc4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:33.980487 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56693fa-0ac9-499b-8a77-4340f762b265 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:33.985420 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ff677-c164-4da1-afdd-25a5031bec0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:33.986028 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ff677-c164-4da1-afdd-25a5031bec0b admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:33.986314 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ff677-c164-4da1-afdd-25a5031bec0b admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:33.986585 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ff677-c164-4da1-afdd-25a5031bec0b admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:33.987225 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ff677-c164-4da1-afdd-25a5031bec0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:33.989225 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ff677-c164-4da1-afdd-25a5031bec0b admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:34.012259 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9d290-b31d-497c-a990-4e3d41ffc4c7 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:34.060893 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b88b1a-58ef-4322-89d4-97852858479f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:34.061511 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b88b1a-58ef-4322-89d4-97852858479f service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:34.061789 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b88b1a-58ef-4322-89d4-97852858479f service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:34.062062 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b88b1a-58ef-4322-89d4-97852858479f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:34.096509 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1349/2705] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:02:33 2022] POST /identity/v3/users => generated 299 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 20:02:34.101605 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ff677-c164-4da1-afdd-25a5031bec0b admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:34.109381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:34.111903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ff677-c164-4da1-afdd-25a5031bec0b admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:34.117757 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915c38a-81ee-4752-8d31-3cb8388490a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:34.118353 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915c38a-81ee-4752-8d31-3cb8388490a1 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:34.118633 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915c38a-81ee-4752-8d31-3cb8388490a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:34.118904 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915c38a-81ee-4752-8d31-3cb8388490a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:34.119570 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915c38a-81ee-4752-8d31-3cb8388490a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:34.119688 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b88b1a-58ef-4322-89d4-97852858479f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:34.121025 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b88b1a-58ef-4322-89d4-97852858479f service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:34.121149 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915c38a-81ee-4752-8d31-3cb8388490a1 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:34.130029 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1357/2706] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 20:02:34.139664 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1350/2707] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 20:02:34.142539 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b88b1a-58ef-4322-89d4-97852858479f service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:34.155873 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915c38a-81ee-4752-8d31-3cb8388490a1 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:34.156607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b88b1a-58ef-4322-89d4-97852858479f service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:34.161977 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c09af0-d0a2-4c5d-b55b-c395a3d28d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:34.163448 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c09af0-d0a2-4c5d-b55b-c395a3d28d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:34.163701 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c09af0-d0a2-4c5d-b55b-c395a3d28d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:34.168688 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c09af0-d0a2-4c5d-b55b-c395a3d28d84 admin admin] PATH_INFO: `/v3/projects/b42aa86248d1433996466db4651ed033/users/3939e37ce7a24eb29aa6d0ab2364cca4/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:34.168800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915c38a-81ee-4752-8d31-3cb8388490a1 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:34.171495 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382dd8c-ff86-4215-b249-493866227ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:34.172163 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382dd8c-ff86-4215-b249-493866227ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:34.172437 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382dd8c-ff86-4215-b249-493866227ead admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:34.172704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382dd8c-ff86-4215-b249-493866227ead admin admin] PATH_INFO: `/v3/users/1fbf649476634298be17ca1b8e958850` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:34.173948 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382dd8c-ff86-4215-b249-493866227ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fbf649476634298be17ca1b8e958850)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:34.175771 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382dd8c-ff86-4215-b249-493866227ead admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:34.179931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c09af0-d0a2-4c5d-b55b-c395a3d28d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b42aa86248d1433996466db4651ed033, user_id=3939e37ce7a24eb29aa6d0ab2364cca4, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:34.183710 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c09af0-d0a2-4c5d-b55b-c395a3d28d84 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:34.279460 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1358/2708] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:34 2022] PUT /identity/v3/projects/b42aa86248d1433996466db4651ed033/users/3939e37ce7a24eb29aa6d0ab2364cca4/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:34.283492 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c09af0-d0a2-4c5d-b55b-c395a3d28d84 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:34.348644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c09af0-d0a2-4c5d-b55b-c395a3d28d84 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:34.354616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c63489-84a7-4aee-ac12-605fc39f4452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:34.355223 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c63489-84a7-4aee-ac12-605fc39f4452 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:34.355504 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c63489-84a7-4aee-ac12-605fc39f4452 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:34.355799 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c63489-84a7-4aee-ac12-605fc39f4452 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:34.356448 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c63489-84a7-4aee-ac12-605fc39f4452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:34.358090 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c63489-84a7-4aee-ac12-605fc39f4452 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:34.368840 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1359/2709] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 20:02:34.373042 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c63489-84a7-4aee-ac12-605fc39f4452 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:34.386986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c63489-84a7-4aee-ac12-605fc39f4452 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:34.391341 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-a382dd8c-ff86-4215-b249-493866227ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fbf649476634298be17ca1b8e958850'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:34.391688 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b65a71-7af5-45e5-bcc6-e5956148f909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:34.392350 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65a71-7af5-45e5-bcc6-e5956148f909 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:34.392625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65a71-7af5-45e5-bcc6-e5956148f909 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:34.392896 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65a71-7af5-45e5-bcc6-e5956148f909 admin admin] PATH_INFO: `/v3/projects/b42aa86248d1433996466db4651ed033/users/3939e37ce7a24eb29aa6d0ab2364cca4/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:34.394829 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b65a71-7af5-45e5-bcc6-e5956148f909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b42aa86248d1433996466db4651ed033, user_id=3939e37ce7a24eb29aa6d0ab2364cca4, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:34.398020 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b65a71-7af5-45e5-bcc6-e5956148f909 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:34.408556 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1360/2710] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:34 2022] PUT /identity/v3/projects/b42aa86248d1433996466db4651ed033/users/3939e37ce7a24eb29aa6d0ab2364cca4/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:34.473604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-a382dd8c-ff86-4215-b249-493866227ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fbf649476634298be17ca1b8e958850'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:34.474186 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-a382dd8c-ff86-4215-b249-493866227ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fbf649476634298be17ca1b8e958850'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:34.483772 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-a382dd8c-ff86-4215-b249-493866227ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fbf649476634298be17ca1b8e958850'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:34.496262 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f6f83-fc3e-4ab1-9920-da12d8bf65df None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:34.496833 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f6f83-fc3e-4ab1-9920-da12d8bf65df None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:34.496833 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f6f83-fc3e-4ab1-9920-da12d8bf65df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:34.497817 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-a382dd8c-ff86-4215-b249-493866227ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fbf649476634298be17ca1b8e958850'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:34.511261 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1351/2711] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:02:34 2022] DELETE /identity/v3/users/1fbf649476634298be17ca1b8e958850 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:34.516020 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061cda6-e158-4fda-b930-1eaf55893498 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:34.516305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061cda6-e158-4fda-b930-1eaf55893498 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:34.516577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061cda6-e158-4fda-b930-1eaf55893498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:34.526411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-1b6f6f83-fc3e-4ab1-9920-da12d8bf65df None None] MFA Rules not processed for user `3939e37ce7a24eb29aa6d0ab2364cca4`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:34.527666 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-1b6f6f83-fc3e-4ab1-9920-da12d8bf65df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:34.536306 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-d061cda6-e158-4fda-b930-1eaf55893498 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:34.538525 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d061cda6-e158-4fda-b930-1eaf55893498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:34.597379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1361/2712] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:02:34.598751 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1352/2713] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:34.609544 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f6f83-fc3e-4ab1-9920-da12d8bf65df None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:34.610188 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061cda6-e158-4fda-b930-1eaf55893498 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:34.611126 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-1b6f6f83-fc3e-4ab1-9920-da12d8bf65df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:34.611602 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d061cda6-e158-4fda-b930-1eaf55893498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:34.631878 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:34.647114 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:34.669705 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f6f83-fc3e-4ab1-9920-da12d8bf65df None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:34.672432 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061cda6-e158-4fda-b930-1eaf55893498 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:34.673483 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b207a0-4e3e-4ea2-ad51-76a76671040c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:34.674091 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b207a0-4e3e-4ea2-ad51-76a76671040c service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:34.674379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b207a0-4e3e-4ea2-ad51-76a76671040c service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:34.674589 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c771a57-1ca2-456a-a83b-9882da10b99d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:34.674729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b207a0-4e3e-4ea2-ad51-76a76671040c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:34.675170 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c771a57-1ca2-456a-a83b-9882da10b99d service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:34.675446 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c771a57-1ca2-456a-a83b-9882da10b99d service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:34.675746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c771a57-1ca2-456a-a83b-9882da10b99d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:34.676415 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-b4b207a0-4e3e-4ea2-ad51-76a76671040c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:34.684762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c771a57-1ca2-456a-a83b-9882da10b99d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:34.686183 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c771a57-1ca2-456a-a83b-9882da10b99d service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:34.697268 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1353/2714] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 20:02:34.741106 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b207a0-4e3e-4ea2-ad51-76a76671040c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:34.741106 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b207a0-4e3e-4ea2-ad51-76a76671040c service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:34.748850 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1362/2715] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:02:35.223143 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c771a57-1ca2-456a-a83b-9882da10b99d service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:35.224665 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1c771a57-1ca2-456a-a83b-9882da10b99d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:35.239714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c771a57-1ca2-456a-a83b-9882da10b99d service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:35.245219 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb1793-13b7-4f32-9ba5-b8edc98a9881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:35.250600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1793-13b7-4f32-9ba5-b8edc98a9881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:35.250600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1793-13b7-4f32-9ba5-b8edc98a9881 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:35.250600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1793-13b7-4f32-9ba5-b8edc98a9881 admin admin] PATH_INFO: `/v3/projects/474add9dfa224541b97aadfd9a731322` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:35.250600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb1793-13b7-4f32-9ba5-b8edc98a9881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=474add9dfa224541b97aadfd9a731322)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:35.251186 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb1793-13b7-4f32-9ba5-b8edc98a9881 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:35.446311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5bbb1793-13b7-4f32-9ba5-b8edc98a9881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '474add9dfa224541b97aadfd9a731322', 'request_id': 'req-5bbb1793-13b7-4f32-9ba5-b8edc98a9881'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:35.638923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5bbb1793-13b7-4f32-9ba5-b8edc98a9881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '474add9dfa224541b97aadfd9a731322', 'request_id': 'req-5bbb1793-13b7-4f32-9ba5-b8edc98a9881'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:35.645075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5bbb1793-13b7-4f32-9ba5-b8edc98a9881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '474add9dfa224541b97aadfd9a731322', 'request_id': 'req-5bbb1793-13b7-4f32-9ba5-b8edc98a9881'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:35.656837 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5bbb1793-13b7-4f32-9ba5-b8edc98a9881 admin admin] The token cache is being invalidate because project 474add9dfa224541b97aadfd9a731322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:35.657132 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5bbb1793-13b7-4f32-9ba5-b8edc98a9881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:35.657768 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-5bbb1793-13b7-4f32-9ba5-b8edc98a9881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:35.659235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1354/2716] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:35 2022] DELETE /identity/v3/projects/474add9dfa224541b97aadfd9a731322 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:35.664157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67521a69-228a-4762-9e1b-7538131da1a2 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:35.664616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67521a69-228a-4762-9e1b-7538131da1a2 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:35.664710 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67521a69-228a-4762-9e1b-7538131da1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:35.684002 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-67521a69-228a-4762-9e1b-7538131da1a2 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:35.685208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-67521a69-228a-4762-9e1b-7538131da1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:35.750702 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1363/2717] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:35.758963 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffeda83-74f9-48ca-a633-dea17b15b0eb None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:35.759247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffeda83-74f9-48ca-a633-dea17b15b0eb None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:35.759520 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffeda83-74f9-48ca-a633-dea17b15b0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:35.781747 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-5ffeda83-74f9-48ca-a633-dea17b15b0eb None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:35.783010 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-5ffeda83-74f9-48ca-a633-dea17b15b0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:35.791587 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1355/2718] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:35.797219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67521a69-228a-4762-9e1b-7538131da1a2 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:35.810458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67521a69-228a-4762-9e1b-7538131da1a2 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:35.816494 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a17b9d-a997-4f52-bab7-06364eebbef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:35.817107 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a17b9d-a997-4f52-bab7-06364eebbef9 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:35.817383 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a17b9d-a997-4f52-bab7-06364eebbef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:35.817684 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a17b9d-a997-4f52-bab7-06364eebbef9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:35.818327 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a17b9d-a997-4f52-bab7-06364eebbef9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:02:35.819218 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a17b9d-a997-4f52-bab7-06364eebbef9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:35.821007 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a17b9d-a997-4f52-bab7-06364eebbef9 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:35.833431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1364/2719] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 20:02:35.839244 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffeda83-74f9-48ca-a633-dea17b15b0eb None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:35.849025 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffeda83-74f9-48ca-a633-dea17b15b0eb None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:35.853890 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6312eb0-fc67-4017-8fac-c3b40937fdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:35.854434 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6312eb0-fc67-4017-8fac-c3b40937fdb0 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:35.854706 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6312eb0-fc67-4017-8fac-c3b40937fdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:35.854970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6312eb0-fc67-4017-8fac-c3b40937fdb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:35.855698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6312eb0-fc67-4017-8fac-c3b40937fdb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:35.857636 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6312eb0-fc67-4017-8fac-c3b40937fdb0 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:35.966445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1356/2720] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:02:35 2022] POST /identity/v3/projects => generated 389 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 20:02:35.970641 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a17b9d-a997-4f52-bab7-06364eebbef9 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:35.980554 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a17b9d-a997-4f52-bab7-06364eebbef9 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:36.039311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59897839-e8de-4f00-9617-a9bc8a6ccee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:36.040006 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59897839-e8de-4f00-9617-a9bc8a6ccee0 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:36.040285 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59897839-e8de-4f00-9617-a9bc8a6ccee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:36.040591 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59897839-e8de-4f00-9617-a9bc8a6ccee0 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:36.041527 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59897839-e8de-4f00-9617-a9bc8a6ccee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:36.043650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59897839-e8de-4f00-9617-a9bc8a6ccee0 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:36.130715 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1365/2721] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:02:35 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:36.135900 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6312eb0-fc67-4017-8fac-c3b40937fdb0 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:36.146510 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6312eb0-fc67-4017-8fac-c3b40937fdb0 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:36.151779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acc6f5-2237-4df6-862e-3fe77437bd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:36.152347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acc6f5-2237-4df6-862e-3fe77437bd39 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:36.155508 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acc6f5-2237-4df6-862e-3fe77437bd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:36.155508 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acc6f5-2237-4df6-862e-3fe77437bd39 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:36.155508 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acc6f5-2237-4df6-862e-3fe77437bd39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:36.155508 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acc6f5-2237-4df6-862e-3fe77437bd39 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:36.165497 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1357/2722] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:36.169534 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59897839-e8de-4f00-9617-a9bc8a6ccee0 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:36.176198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:36.180887 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59897839-e8de-4f00-9617-a9bc8a6ccee0 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:36.185744 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22c387-2bd9-4a1b-b820-26a0d9c8084e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:36.186354 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22c387-2bd9-4a1b-b820-26a0d9c8084e admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:36.186632 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22c387-2bd9-4a1b-b820-26a0d9c8084e admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:36.186901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22c387-2bd9-4a1b-b820-26a0d9c8084e admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:36.187569 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22c387-2bd9-4a1b-b820-26a0d9c8084e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:36.189157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22c387-2bd9-4a1b-b820-26a0d9c8084e admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:36.201230 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1366/2723] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:36.206501 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acc6f5-2237-4df6-862e-3fe77437bd39 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:36.219715 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acc6f5-2237-4df6-862e-3fe77437bd39 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:36.227809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6b8f9-de81-40d0-a728-4bde668c3282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:36.227809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6b8f9-de81-40d0-a728-4bde668c3282 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:36.227809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6b8f9-de81-40d0-a728-4bde668c3282 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:36.227809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6b8f9-de81-40d0-a728-4bde668c3282 admin admin] PATH_INFO: `/v3/projects/6a80c200333a478cb37a40c3b4ce638b/users/45ba7bbea97140c084cef031f2645d9c/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:36.241403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb6b8f9-de81-40d0-a728-4bde668c3282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a80c200333a478cb37a40c3b4ce638b, user_id=45ba7bbea97140c084cef031f2645d9c, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:36.244049 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb6b8f9-de81-40d0-a728-4bde668c3282 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:37.023390 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1358/2724] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:36 2022] PUT /identity/v3/projects/6a80c200333a478cb37a40c3b4ce638b/users/45ba7bbea97140c084cef031f2645d9c/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:37.033481 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1185097-0040-4dd4-876d-5ad104ee4e2c None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:37.033940 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1185097-0040-4dd4-876d-5ad104ee4e2c None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:37.034037 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1185097-0040-4dd4-876d-5ad104ee4e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:37.062321 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-c1185097-0040-4dd4-876d-5ad104ee4e2c None None] MFA Rules not processed for user `45ba7bbea97140c084cef031f2645d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:37.063469 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c1185097-0040-4dd4-876d-5ad104ee4e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:37.127086 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1367/2725] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:37.148597 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6b8f9-de81-40d0-a728-4bde668c3282 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:37.150284 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-eeb6b8f9-de81-40d0-a728-4bde668c3282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:37.192901 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:37.207616 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6b8f9-de81-40d0-a728-4bde668c3282 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:37.211605 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7686b5-8bd8-4a86-92a1-6344f0d80af3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:37.212207 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7686b5-8bd8-4a86-92a1-6344f0d80af3 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:37.212509 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7686b5-8bd8-4a86-92a1-6344f0d80af3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:37.212778 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7686b5-8bd8-4a86-92a1-6344f0d80af3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:37.220928 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7686b5-8bd8-4a86-92a1-6344f0d80af3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:37.222345 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7686b5-8bd8-4a86-92a1-6344f0d80af3 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:37.231616 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1359/2726] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:02:41.534562 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1185097-0040-4dd4-876d-5ad104ee4e2c None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:41.535901 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c1185097-0040-4dd4-876d-5ad104ee4e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:41.548030 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1185097-0040-4dd4-876d-5ad104ee4e2c None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:41.551922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16f5f3-34f1-4d8b-ad12-bb4bde3739da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:41.552553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16f5f3-34f1-4d8b-ad12-bb4bde3739da service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:41.552856 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16f5f3-34f1-4d8b-ad12-bb4bde3739da service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:41.553124 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16f5f3-34f1-4d8b-ad12-bb4bde3739da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:41.554890 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-bb16f5f3-34f1-4d8b-ad12-bb4bde3739da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:41.618351 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16f5f3-34f1-4d8b-ad12-bb4bde3739da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:41.619832 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16f5f3-34f1-4d8b-ad12-bb4bde3739da service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:41.632086 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1368/2727] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:02:47.655532 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=8 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:47.749231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7686b5-8bd8-4a86-92a1-6344f0d80af3 service cinder] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:47.750714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ed7686b5-8bd8-4a86-92a1-6344f0d80af3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:47.816400 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7686b5-8bd8-4a86-92a1-6344f0d80af3 service cinder] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:47.820973 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc570baa-9aab-4aa3-a832-26b8b77cc57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:47.821600 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc570baa-9aab-4aa3-a832-26b8b77cc57a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:47.821880 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc570baa-9aab-4aa3-a832-26b8b77cc57a admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:47.822155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc570baa-9aab-4aa3-a832-26b8b77cc57a admin admin] PATH_INFO: `/v3/users/47b13f23d57f4b368b82f3e77137feb5` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:47.823288 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc570baa-9aab-4aa3-a832-26b8b77cc57a admin admin] RBAC: Authorizing `identity:delete_user(user_id=47b13f23d57f4b368b82f3e77137feb5)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:47.825245 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc570baa-9aab-4aa3-a832-26b8b77cc57a admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:47.962379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16f5f3-34f1-4d8b-ad12-bb4bde3739da service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:47.963879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-bb16f5f3-34f1-4d8b-ad12-bb4bde3739da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:48.020322 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16f5f3-34f1-4d8b-ad12-bb4bde3739da service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:48.035588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d795ebd-4e21-4b5a-8e73-1310d30833b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:48.035588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d795ebd-4e21-4b5a-8e73-1310d30833b1 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:48.035588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d795ebd-4e21-4b5a-8e73-1310d30833b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:48.035588 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d795ebd-4e21-4b5a-8e73-1310d30833b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:48.036398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-5d795ebd-4e21-4b5a-8e73-1310d30833b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:48.043063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d795ebd-4e21-4b5a-8e73-1310d30833b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:48.048123 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d795ebd-4e21-4b5a-8e73-1310d30833b1 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:48.056089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1369/2728] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:02:48.102011 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-cc570baa-9aab-4aa3-a832-26b8b77cc57a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47b13f23d57f4b368b82f3e77137feb5'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:48.221572 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-cc570baa-9aab-4aa3-a832-26b8b77cc57a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47b13f23d57f4b368b82f3e77137feb5'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:48.222174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-cc570baa-9aab-4aa3-a832-26b8b77cc57a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47b13f23d57f4b368b82f3e77137feb5'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:48.230247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-cc570baa-9aab-4aa3-a832-26b8b77cc57a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47b13f23d57f4b368b82f3e77137feb5'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:48.243182 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-cc570baa-9aab-4aa3-a832-26b8b77cc57a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47b13f23d57f4b368b82f3e77137feb5'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:48.249450 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1360/2729] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:02:47 2022] DELETE /identity/v3/users/47b13f23d57f4b368b82f3e77137feb5 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:48.253704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe8039-35a9-4aa5-9ad4-50c43b474a3c None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:48.253991 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe8039-35a9-4aa5-9ad4-50c43b474a3c None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:48.254470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe8039-35a9-4aa5-9ad4-50c43b474a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:48.276466 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-90fe8039-35a9-4aa5-9ad4-50c43b474a3c None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:48.277955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-90fe8039-35a9-4aa5-9ad4-50c43b474a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:48.291027 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:48.346854 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1370/2730] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:48.365111 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc570baa-9aab-4aa3-a832-26b8b77cc57a admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:48.366817 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-cc570baa-9aab-4aa3-a832-26b8b77cc57a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:48.429839 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc570baa-9aab-4aa3-a832-26b8b77cc57a admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:48.433868 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53f8a9-ce10-482d-ac73-759e1a1b8599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:48.434579 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53f8a9-ce10-482d-ac73-759e1a1b8599 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:48.434863 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53f8a9-ce10-482d-ac73-759e1a1b8599 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:48.435159 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53f8a9-ce10-482d-ac73-759e1a1b8599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:48.445445 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53f8a9-ce10-482d-ac73-759e1a1b8599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:48.446999 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53f8a9-ce10-482d-ac73-759e1a1b8599 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:48.457084 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1361/2731] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:02:49.086555 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe8039-35a9-4aa5-9ad4-50c43b474a3c None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:49.088523 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-90fe8039-35a9-4aa5-9ad4-50c43b474a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:49.100508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe8039-35a9-4aa5-9ad4-50c43b474a3c None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:49.106282 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4573ee-8907-424a-8a77-94a951cb34ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:49.106931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4573ee-8907-424a-8a77-94a951cb34ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:49.107211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4573ee-8907-424a-8a77-94a951cb34ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:49.107486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4573ee-8907-424a-8a77-94a951cb34ad admin admin] PATH_INFO: `/v3/projects/d60663c8c63a4a8cb68dd16c4cfb707f` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:49.108904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4573ee-8907-424a-8a77-94a951cb34ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60663c8c63a4a8cb68dd16c4cfb707f)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:49.110822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4573ee-8907-424a-8a77-94a951cb34ad admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:49.262141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-be4573ee-8907-424a-8a77-94a951cb34ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60663c8c63a4a8cb68dd16c4cfb707f', 'request_id': 'req-be4573ee-8907-424a-8a77-94a951cb34ad'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:49.364332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-be4573ee-8907-424a-8a77-94a951cb34ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60663c8c63a4a8cb68dd16c4cfb707f', 'request_id': 'req-be4573ee-8907-424a-8a77-94a951cb34ad'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:49.374735 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-be4573ee-8907-424a-8a77-94a951cb34ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60663c8c63a4a8cb68dd16c4cfb707f', 'request_id': 'req-be4573ee-8907-424a-8a77-94a951cb34ad'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:49.389432 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-be4573ee-8907-424a-8a77-94a951cb34ad admin admin] The token cache is being invalidate because project d60663c8c63a4a8cb68dd16c4cfb707f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:49.389723 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-be4573ee-8907-424a-8a77-94a951cb34ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:49.390420 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-be4573ee-8907-424a-8a77-94a951cb34ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:49.392193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1371/2732] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:49 2022] DELETE /identity/v3/projects/d60663c8c63a4a8cb68dd16c4cfb707f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:49.396809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53f8a9-ce10-482d-ac73-759e1a1b8599 service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:49.397297 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4573ee-8907-424a-8a77-94a951cb34ad admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:49.399287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-be4573ee-8907-424a-8a77-94a951cb34ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:49.410431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53f8a9-ce10-482d-ac73-759e1a1b8599 service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:49.439455 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:49.472151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4573ee-8907-424a-8a77-94a951cb34ad admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:49.478196 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658932f-4852-4a8b-ad9a-21fad916cb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:49.478987 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658932f-4852-4a8b-ad9a-21fad916cb28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:49.479327 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658932f-4852-4a8b-ad9a-21fad916cb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:49.479643 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658932f-4852-4a8b-ad9a-21fad916cb28 admin admin] PATH_INFO: `/v3/users/45ba7bbea97140c084cef031f2645d9c` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:49.481025 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658932f-4852-4a8b-ad9a-21fad916cb28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ba7bbea97140c084cef031f2645d9c)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:49.483150 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658932f-4852-4a8b-ad9a-21fad916cb28 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:49.485577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee78594-0cb0-451d-9dba-1d4248602418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:49.486673 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee78594-0cb0-451d-9dba-1d4248602418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:49.486959 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee78594-0cb0-451d-9dba-1d4248602418 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:49.487525 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee78594-0cb0-451d-9dba-1d4248602418 admin admin] PATH_INFO: `/v3/users/3939e37ce7a24eb29aa6d0ab2364cca4` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:49.488777 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee78594-0cb0-451d-9dba-1d4248602418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3939e37ce7a24eb29aa6d0ab2364cca4)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:49.490744 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee78594-0cb0-451d-9dba-1d4248602418 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:49.773230 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:49.775047 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3658932f-4852-4a8b-ad9a-21fad916cb28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ba7bbea97140c084cef031f2645d9c'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:49.824793 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-3ee78594-0cb0-451d-9dba-1d4248602418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3939e37ce7a24eb29aa6d0ab2364cca4'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:49.895650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3658932f-4852-4a8b-ad9a-21fad916cb28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ba7bbea97140c084cef031f2645d9c'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:49.896289 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3658932f-4852-4a8b-ad9a-21fad916cb28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ba7bbea97140c084cef031f2645d9c'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:49.922968 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3658932f-4852-4a8b-ad9a-21fad916cb28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ba7bbea97140c084cef031f2645d9c'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:49.931269 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3658932f-4852-4a8b-ad9a-21fad916cb28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ba7bbea97140c084cef031f2645d9c'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:49.938314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1372/2733] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:02:49 2022] DELETE /identity/v3/users/45ba7bbea97140c084cef031f2645d9c => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:49.943149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f38435-81c0-4360-94a7-6fa1befbf674 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:49.943596 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f38435-81c0-4360-94a7-6fa1befbf674 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:49.943980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f38435-81c0-4360-94a7-6fa1befbf674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:49.965712 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-a1f38435-81c0-4360-94a7-6fa1befbf674 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:49.966643 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a1f38435-81c0-4360-94a7-6fa1befbf674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:49.981874 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-3ee78594-0cb0-451d-9dba-1d4248602418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3939e37ce7a24eb29aa6d0ab2364cca4'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:49.985664 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-3ee78594-0cb0-451d-9dba-1d4248602418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3939e37ce7a24eb29aa6d0ab2364cca4'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:49.990658 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-3ee78594-0cb0-451d-9dba-1d4248602418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3939e37ce7a24eb29aa6d0ab2364cca4'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:50.005536 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-3ee78594-0cb0-451d-9dba-1d4248602418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3939e37ce7a24eb29aa6d0ab2364cca4'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:50.015578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1362/2734] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:02:49 2022] DELETE /identity/v3/users/3939e37ce7a24eb29aa6d0ab2364cca4 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:50.050859 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1373/2735] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:02:50.061860 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee78594-0cb0-451d-9dba-1d4248602418 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:50.063580 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3ee78594-0cb0-451d-9dba-1d4248602418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:50.150061 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee78594-0cb0-451d-9dba-1d4248602418 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:50.154736 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc8d3f-eca8-4afc-9a73-cd9f64326664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:50.157876 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc8d3f-eca8-4afc-9a73-cd9f64326664 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:50.157876 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc8d3f-eca8-4afc-9a73-cd9f64326664 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:50.157876 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc8d3f-eca8-4afc-9a73-cd9f64326664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:50.213923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:50.223857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc8d3f-eca8-4afc-9a73-cd9f64326664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:50.225298 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc8d3f-eca8-4afc-9a73-cd9f64326664 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:50.235747 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1363/2736] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:02:50.604595 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f38435-81c0-4360-94a7-6fa1befbf674 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:50.606117 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a1f38435-81c0-4360-94a7-6fa1befbf674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:50.619314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f38435-81c0-4360-94a7-6fa1befbf674 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:50.625034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749f9a0-a077-4156-b7eb-c4546c3b0ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:50.626376 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749f9a0-a077-4156-b7eb-c4546c3b0ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:50.626827 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749f9a0-a077-4156-b7eb-c4546c3b0ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:50.627110 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749f9a0-a077-4156-b7eb-c4546c3b0ec4 admin admin] PATH_INFO: `/v3/projects/b42aa86248d1433996466db4651ed033` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:50.628459 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749f9a0-a077-4156-b7eb-c4546c3b0ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b42aa86248d1433996466db4651ed033)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:50.630380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749f9a0-a077-4156-b7eb-c4546c3b0ec4 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:50.738663 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-7749f9a0-a077-4156-b7eb-c4546c3b0ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b42aa86248d1433996466db4651ed033', 'request_id': 'req-7749f9a0-a077-4156-b7eb-c4546c3b0ec4'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:50.803095 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc8d3f-eca8-4afc-9a73-cd9f64326664 service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:50.803646 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-08bc8d3f-eca8-4afc-9a73-cd9f64326664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:50.830368 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc8d3f-eca8-4afc-9a73-cd9f64326664 service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:50.833702 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-7749f9a0-a077-4156-b7eb-c4546c3b0ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b42aa86248d1433996466db4651ed033', 'request_id': 'req-7749f9a0-a077-4156-b7eb-c4546c3b0ec4'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:50.841557 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-7749f9a0-a077-4156-b7eb-c4546c3b0ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b42aa86248d1433996466db4651ed033', 'request_id': 'req-7749f9a0-a077-4156-b7eb-c4546c3b0ec4'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:50.860182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-7749f9a0-a077-4156-b7eb-c4546c3b0ec4 admin admin] The token cache is being invalidate because project b42aa86248d1433996466db4651ed033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:50.860484 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-7749f9a0-a077-4156-b7eb-c4546c3b0ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:50.861147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-7749f9a0-a077-4156-b7eb-c4546c3b0ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:50.867490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1374/2737] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:50 2022] DELETE /identity/v3/projects/b42aa86248d1433996466db4651ed033 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:50.868986 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0fcb5-f8ba-4c96-a813-c0c9147ab8f6 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:50.869286 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0fcb5-f8ba-4c96-a813-c0c9147ab8f6 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:50.869550 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0fcb5-f8ba-4c96-a813-c0c9147ab8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:50.900141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-29a0fcb5-f8ba-4c96-a813-c0c9147ab8f6 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:50.901810 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-29a0fcb5-f8ba-4c96-a813-c0c9147ab8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:50.921480 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc5489-12ff-4d45-b7af-397932f16a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:50.922396 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc5489-12ff-4d45-b7af-397932f16a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:50.922770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc5489-12ff-4d45-b7af-397932f16a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:50.923333 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc5489-12ff-4d45-b7af-397932f16a3c admin admin] PATH_INFO: `/v3/projects/6a80c200333a478cb37a40c3b4ce638b` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:50.924805 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc5489-12ff-4d45-b7af-397932f16a3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a80c200333a478cb37a40c3b4ce638b)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:50.926839 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc5489-12ff-4d45-b7af-397932f16a3c admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:50.953335 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:50.971413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1375/2738] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:50.980638 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4480b-7c26-443e-9da3-0903a0097381 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:50.980922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4480b-7c26-443e-9da3-0903a0097381 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:50.981221 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4480b-7c26-443e-9da3-0903a0097381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:51.000873 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-69c4480b-7c26-443e-9da3-0903a0097381 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:51.009354 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-69c4480b-7c26-443e-9da3-0903a0097381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:51.010260 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1376/2739] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:02:51.014382 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4480b-7c26-443e-9da3-0903a0097381 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:51.023747 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4480b-7c26-443e-9da3-0903a0097381 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:51.028211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343486d-2d77-433a-b510-8d7700a7555a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:51.028772 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343486d-2d77-433a-b510-8d7700a7555a admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:51.029045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343486d-2d77-433a-b510-8d7700a7555a admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:51.029312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343486d-2d77-433a-b510-8d7700a7555a admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:51.029934 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343486d-2d77-433a-b510-8d7700a7555a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:02:51.030233 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343486d-2d77-433a-b510-8d7700a7555a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:51.031833 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343486d-2d77-433a-b510-8d7700a7555a admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:51.044096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1377/2740] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 20:02:51.048412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343486d-2d77-433a-b510-8d7700a7555a admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:51.058458 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343486d-2d77-433a-b510-8d7700a7555a admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:51.063694 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5faf2-2d6f-41a7-81bc-655c7674c003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:51.064313 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5faf2-2d6f-41a7-81bc-655c7674c003 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:51.064592 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5faf2-2d6f-41a7-81bc-655c7674c003 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:51.064895 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5faf2-2d6f-41a7-81bc-655c7674c003 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:51.065549 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5faf2-2d6f-41a7-81bc-655c7674c003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:51.067634 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5faf2-2d6f-41a7-81bc-655c7674c003 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:51.102164 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-2bcc5489-12ff-4d45-b7af-397932f16a3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a80c200333a478cb37a40c3b4ce638b', 'request_id': 'req-2bcc5489-12ff-4d45-b7af-397932f16a3c'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:51.211394 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-2bcc5489-12ff-4d45-b7af-397932f16a3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a80c200333a478cb37a40c3b4ce638b', 'request_id': 'req-2bcc5489-12ff-4d45-b7af-397932f16a3c'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:51.220679 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-2bcc5489-12ff-4d45-b7af-397932f16a3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a80c200333a478cb37a40c3b4ce638b', 'request_id': 'req-2bcc5489-12ff-4d45-b7af-397932f16a3c'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:51.221021 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1378/2741] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:02:51 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 20:02:51.225720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5faf2-2d6f-41a7-81bc-655c7674c003 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:51.238029 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-2bcc5489-12ff-4d45-b7af-397932f16a3c admin admin] The token cache is being invalidate because project 6a80c200333a478cb37a40c3b4ce638b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:51.239035 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-2bcc5489-12ff-4d45-b7af-397932f16a3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:51.239763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-2bcc5489-12ff-4d45-b7af-397932f16a3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:51.260428 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1364/2742] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:50 2022] DELETE /identity/v3/projects/6a80c200333a478cb37a40c3b4ce638b => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:51.364083 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5faf2-2d6f-41a7-81bc-655c7674c003 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:51.370935 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0839023-c4ec-443c-896e-14629f01e578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:51.371916 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0839023-c4ec-443c-896e-14629f01e578 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:51.373072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0839023-c4ec-443c-896e-14629f01e578 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:51.373903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0839023-c4ec-443c-896e-14629f01e578 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:51.374671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0839023-c4ec-443c-896e-14629f01e578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:51.381033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0839023-c4ec-443c-896e-14629f01e578 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:51.511623 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc5489-12ff-4d45-b7af-397932f16a3c admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:51.512760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-2bcc5489-12ff-4d45-b7af-397932f16a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:51.515517 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1379/2743] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:02:51 2022] POST /identity/v3/users => generated 287 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 20:02:51.628042 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc5489-12ff-4d45-b7af-397932f16a3c admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:51.645117 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468de3b-6919-4c8f-be88-b0eda91be3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:51.645958 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468de3b-6919-4c8f-be88-b0eda91be3cc admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:51.646256 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468de3b-6919-4c8f-be88-b0eda91be3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:51.647139 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468de3b-6919-4c8f-be88-b0eda91be3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:51.648378 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468de3b-6919-4c8f-be88-b0eda91be3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:51.650244 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468de3b-6919-4c8f-be88-b0eda91be3cc admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:51.672473 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1365/2744] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 20:02:51.672591 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0839023-c4ec-443c-896e-14629f01e578 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:51.680420 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0839023-c4ec-443c-896e-14629f01e578 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:51.685525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd791bec-7e2c-43c1-8343-21f42faf8ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:51.686141 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd791bec-7e2c-43c1-8343-21f42faf8ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:51.686420 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd791bec-7e2c-43c1-8343-21f42faf8ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:51.686713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd791bec-7e2c-43c1-8343-21f42faf8ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:51.687398 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd791bec-7e2c-43c1-8343-21f42faf8ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:51.689443 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd791bec-7e2c-43c1-8343-21f42faf8ed1 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:51.710431 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1380/2745] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:51.711969 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468de3b-6919-4c8f-be88-b0eda91be3cc admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:51.722996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468de3b-6919-4c8f-be88-b0eda91be3cc admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:51.727947 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215b131-34dc-43af-8022-a1a9ac52c56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:51.728615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215b131-34dc-43af-8022-a1a9ac52c56f admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:51.728926 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215b131-34dc-43af-8022-a1a9ac52c56f admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:51.729167 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215b131-34dc-43af-8022-a1a9ac52c56f admin admin] PATH_INFO: `/v3/projects/274c86f307be4dfea0e929ebf8860090/users/8ebc666c640a47b4a7ab9dd89ab1224e/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:51.746699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215b131-34dc-43af-8022-a1a9ac52c56f admin admin] RBAC: Authorizing `identity:create_grant(project_id=274c86f307be4dfea0e929ebf8860090, user_id=8ebc666c640a47b4a7ab9dd89ab1224e, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:51.750151 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215b131-34dc-43af-8022-a1a9ac52c56f admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:51.752461 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:51.857172 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1366/2746] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:51 2022] PUT /identity/v3/projects/274c86f307be4dfea0e929ebf8860090/users/8ebc666c640a47b4a7ab9dd89ab1224e/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:51.872700 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85871b89-2e00-4794-b5fa-e9c5501ce817 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:51.872989 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85871b89-2e00-4794-b5fa-e9c5501ce817 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:51.873266 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85871b89-2e00-4794-b5fa-e9c5501ce817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:51.905520 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-85871b89-2e00-4794-b5fa-e9c5501ce817 None None] MFA Rules not processed for user `8ebc666c640a47b4a7ab9dd89ab1224e`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:51.906808 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-85871b89-2e00-4794-b5fa-e9c5501ce817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:51.980922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1381/2747] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:51.987091 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215b131-34dc-43af-8022-a1a9ac52c56f admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:52.061965 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215b131-34dc-43af-8022-a1a9ac52c56f admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:52.067106 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f319712-2a7a-479b-b738-95184d3178e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:52.067741 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f319712-2a7a-479b-b738-95184d3178e1 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:52.068040 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f319712-2a7a-479b-b738-95184d3178e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:52.068290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f319712-2a7a-479b-b738-95184d3178e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:52.068924 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f319712-2a7a-479b-b738-95184d3178e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:52.071931 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f319712-2a7a-479b-b738-95184d3178e1 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:52.153061 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85871b89-2e00-4794-b5fa-e9c5501ce817 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:52.158771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-85871b89-2e00-4794-b5fa-e9c5501ce817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:52.161699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1367/2748] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:02:51 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:52.165841 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f319712-2a7a-479b-b738-95184d3178e1 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:52.170989 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:52.244833 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85871b89-2e00-4794-b5fa-e9c5501ce817 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:52.245109 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f319712-2a7a-479b-b738-95184d3178e1 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:52.249508 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9afb5b-135c-45e3-80d6-d4b39afbfb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:52.250135 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9afb5b-135c-45e3-80d6-d4b39afbfb8c admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:52.250402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9afb5b-135c-45e3-80d6-d4b39afbfb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:52.250675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9afb5b-135c-45e3-80d6-d4b39afbfb8c admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:52.251305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9afb5b-135c-45e3-80d6-d4b39afbfb8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:52.253329 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9afb5b-135c-45e3-80d6-d4b39afbfb8c admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:52.306990 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c97d79-ebda-4d82-9328-2d48a4244154 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6942a851a69b446e90a2b138f4482465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:52.307667 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97d79-ebda-4d82-9328-2d48a4244154 service placement] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:52.307955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97d79-ebda-4d82-9328-2d48a4244154 service placement] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:52.308233 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97d79-ebda-4d82-9328-2d48a4244154 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:52.309989 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c8c97d79-ebda-4d82-9328-2d48a4244154 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:52.321905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c97d79-ebda-4d82-9328-2d48a4244154 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:52.323694 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c97d79-ebda-4d82-9328-2d48a4244154 service placement] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:52.333984 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1382/2749] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:02:52.339567 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c97d79-ebda-4d82-9328-2d48a4244154 service placement] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:52.340925 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c8c97d79-ebda-4d82-9328-2d48a4244154 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:52.360838 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1368/2750] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:02:52 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:52.361939 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c97d79-ebda-4d82-9328-2d48a4244154 service placement] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:52.362693 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9afb5b-135c-45e3-80d6-d4b39afbfb8c admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:52.370522 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531d0f7-0aa6-4d2c-961e-1f006cd28665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:52.371797 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531d0f7-0aa6-4d2c-961e-1f006cd28665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:52.372228 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531d0f7-0aa6-4d2c-961e-1f006cd28665 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:52.372513 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531d0f7-0aa6-4d2c-961e-1f006cd28665 admin admin] PATH_INFO: `/v3/users/e95c629061564a93acaf944fd3ea3f72` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:52.373972 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531d0f7-0aa6-4d2c-961e-1f006cd28665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e95c629061564a93acaf944fd3ea3f72)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:52.375604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9afb5b-135c-45e3-80d6-d4b39afbfb8c admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:52.376009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531d0f7-0aa6-4d2c-961e-1f006cd28665 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:52.380470 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3b3c0-3db0-42a3-bef2-ee049cb7746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:52.380941 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3b3c0-3db0-42a3-bef2-ee049cb7746a admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:52.381242 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3b3c0-3db0-42a3-bef2-ee049cb7746a admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:52.381481 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3b3c0-3db0-42a3-bef2-ee049cb7746a admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:52.382753 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3b3c0-3db0-42a3-bef2-ee049cb7746a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:52.384547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3b3c0-3db0-42a3-bef2-ee049cb7746a admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:52.395899 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1369/2751] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:52.399832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3b3c0-3db0-42a3-bef2-ee049cb7746a admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:52.409334 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3b3c0-3db0-42a3-bef2-ee049cb7746a admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:52.414119 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d20e22-a694-4595-a4ab-91debefb0dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:52.414784 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d20e22-a694-4595-a4ab-91debefb0dec admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:52.415061 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d20e22-a694-4595-a4ab-91debefb0dec admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:52.415332 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d20e22-a694-4595-a4ab-91debefb0dec admin admin] PATH_INFO: `/v3/projects/b5591eabd8584c90a33ef13683964d48/users/d7da026354ca49f285ee66688ef23c5b/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:52.429994 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d20e22-a694-4595-a4ab-91debefb0dec admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5591eabd8584c90a33ef13683964d48, user_id=d7da026354ca49f285ee66688ef23c5b, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:52.432632 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d20e22-a694-4595-a4ab-91debefb0dec admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:52.496780 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1370/2752] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:52 2022] PUT /identity/v3/projects/b5591eabd8584c90a33ef13683964d48/users/d7da026354ca49f285ee66688ef23c5b/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:52.500602 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d20e22-a694-4595-a4ab-91debefb0dec admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:52.561089 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d20e22-a694-4595-a4ab-91debefb0dec admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:52.566017 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f68325-c84e-48b1-8b7a-1194fb3b8360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:52.566628 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f68325-c84e-48b1-8b7a-1194fb3b8360 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:52.566937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f68325-c84e-48b1-8b7a-1194fb3b8360 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:52.567212 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f68325-c84e-48b1-8b7a-1194fb3b8360 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:52.567938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f68325-c84e-48b1-8b7a-1194fb3b8360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:52.570168 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f68325-c84e-48b1-8b7a-1194fb3b8360 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:52.580468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1371/2753] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 20:02:52.584525 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f68325-c84e-48b1-8b7a-1194fb3b8360 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:52.585676 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3531d0f7-0aa6-4d2c-961e-1f006cd28665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e95c629061564a93acaf944fd3ea3f72'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:52.595111 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f68325-c84e-48b1-8b7a-1194fb3b8360 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:52.599820 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ead41-9292-4779-84f7-b40dee3473df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:52.600454 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ead41-9292-4779-84f7-b40dee3473df admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:52.600733 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ead41-9292-4779-84f7-b40dee3473df admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:52.601155 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ead41-9292-4779-84f7-b40dee3473df admin admin] PATH_INFO: `/v3/projects/b5591eabd8584c90a33ef13683964d48/users/d7da026354ca49f285ee66688ef23c5b/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:52.603308 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ead41-9292-4779-84f7-b40dee3473df admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5591eabd8584c90a33ef13683964d48, user_id=d7da026354ca49f285ee66688ef23c5b, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:52.606008 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ead41-9292-4779-84f7-b40dee3473df admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:52.616932 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1372/2754] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:52 2022] PUT /identity/v3/projects/b5591eabd8584c90a33ef13683964d48/users/d7da026354ca49f285ee66688ef23c5b/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:52.628748 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424ce14-760f-4dce-906c-be526ce24eeb None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:52.629061 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424ce14-760f-4dce-906c-be526ce24eeb None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:52.629365 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424ce14-760f-4dce-906c-be526ce24eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:52.657081 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-1424ce14-760f-4dce-906c-be526ce24eeb None None] MFA Rules not processed for user `d7da026354ca49f285ee66688ef23c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:52.658311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1424ce14-760f-4dce-906c-be526ce24eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:52.664205 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:52.684602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3531d0f7-0aa6-4d2c-961e-1f006cd28665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e95c629061564a93acaf944fd3ea3f72'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:52.689777 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3531d0f7-0aa6-4d2c-961e-1f006cd28665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e95c629061564a93acaf944fd3ea3f72'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:52.698413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3531d0f7-0aa6-4d2c-961e-1f006cd28665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e95c629061564a93acaf944fd3ea3f72'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:52.705508 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-3531d0f7-0aa6-4d2c-961e-1f006cd28665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e95c629061564a93acaf944fd3ea3f72'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:52.711625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1383/2755] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:02:52 2022] DELETE /identity/v3/users/e95c629061564a93acaf944fd3ea3f72 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:52.730166 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1373/2756] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:02:52.742105 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531d0f7-0aa6-4d2c-961e-1f006cd28665 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:52.743677 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-3531d0f7-0aa6-4d2c-961e-1f006cd28665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:52.781694 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:52.810572 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531d0f7-0aa6-4d2c-961e-1f006cd28665 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:52.814807 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e228ca-d360-4578-a34a-4decbce0d11a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:52.815422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e228ca-d360-4578-a34a-4decbce0d11a service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:52.815734 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e228ca-d360-4578-a34a-4decbce0d11a service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:52.816112 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e228ca-d360-4578-a34a-4decbce0d11a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:52.817872 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-50e228ca-d360-4578-a34a-4decbce0d11a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:52.881681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e228ca-d360-4578-a34a-4decbce0d11a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:52.883359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e228ca-d360-4578-a34a-4decbce0d11a service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:52.892495 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1384/2757] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:02:52.969823 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424ce14-760f-4dce-906c-be526ce24eeb None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:52.969823 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1424ce14-760f-4dce-906c-be526ce24eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:53.046013 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424ce14-760f-4dce-906c-be526ce24eeb None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:53.091923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:53.104466 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11cc26-aaba-4508-9952-5635d2436fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:53.105099 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11cc26-aaba-4508-9952-5635d2436fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:53.105382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11cc26-aaba-4508-9952-5635d2436fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:53.105693 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11cc26-aaba-4508-9952-5635d2436fb6 admin admin] PATH_INFO: `/v3/projects/a10145cac8ec4c7fa689e373b45e4f6f` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:53.106934 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11cc26-aaba-4508-9952-5635d2436fb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a10145cac8ec4c7fa689e373b45e4f6f)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:53.109148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11cc26-aaba-4508-9952-5635d2436fb6 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:53.204369 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-2b11cc26-aaba-4508-9952-5635d2436fb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a10145cac8ec4c7fa689e373b45e4f6f', 'request_id': 'req-2b11cc26-aaba-4508-9952-5635d2436fb6'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:53.296360 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-2b11cc26-aaba-4508-9952-5635d2436fb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a10145cac8ec4c7fa689e373b45e4f6f', 'request_id': 'req-2b11cc26-aaba-4508-9952-5635d2436fb6'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:53.304223 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-2b11cc26-aaba-4508-9952-5635d2436fb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a10145cac8ec4c7fa689e373b45e4f6f', 'request_id': 'req-2b11cc26-aaba-4508-9952-5635d2436fb6'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:53.315643 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-2b11cc26-aaba-4508-9952-5635d2436fb6 admin admin] The token cache is being invalidate because project a10145cac8ec4c7fa689e373b45e4f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:53.315933 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-2b11cc26-aaba-4508-9952-5635d2436fb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:53.316578 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-2b11cc26-aaba-4508-9952-5635d2436fb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:53.318149 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1374/2758] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:52 2022] DELETE /identity/v3/projects/a10145cac8ec4c7fa689e373b45e4f6f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:53.323228 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f2862-4da2-46c8-b5a9-257ac1442e5e None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:53.323509 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f2862-4da2-46c8-b5a9-257ac1442e5e None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:53.323822 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f2862-4da2-46c8-b5a9-257ac1442e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:53.345194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-064f2862-4da2-46c8-b5a9-257ac1442e5e None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:53.346405 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-064f2862-4da2-46c8-b5a9-257ac1442e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:53.415211 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1385/2759] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:53.423338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14883649-6032-4da6-b61e-4a5c2cbbdcd0 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:53.423669 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14883649-6032-4da6-b61e-4a5c2cbbdcd0 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:53.423953 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14883649-6032-4da6-b61e-4a5c2cbbdcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:53.443835 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-14883649-6032-4da6-b61e-4a5c2cbbdcd0 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:53.445508 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-14883649-6032-4da6-b61e-4a5c2cbbdcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:53.453407 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1375/2760] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:53.457520 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f2862-4da2-46c8-b5a9-257ac1442e5e None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:53.468353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f2862-4da2-46c8-b5a9-257ac1442e5e None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:53.473134 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a83d8-d7c9-4366-9254-3684e668bb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:53.473741 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a83d8-d7c9-4366-9254-3684e668bb07 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:53.474017 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a83d8-d7c9-4366-9254-3684e668bb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:53.474354 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a83d8-d7c9-4366-9254-3684e668bb07 admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:53.475001 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a83d8-d7c9-4366-9254-3684e668bb07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:02:53.475301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a83d8-d7c9-4366-9254-3684e668bb07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:53.485153 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a83d8-d7c9-4366-9254-3684e668bb07 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:53.495685 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1386/2761] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 20:02:53.505234 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14883649-6032-4da6-b61e-4a5c2cbbdcd0 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:53.515789 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14883649-6032-4da6-b61e-4a5c2cbbdcd0 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:53.520825 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764a58c-315a-4534-8ca0-3875238370fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:53.521431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764a58c-315a-4534-8ca0-3875238370fc admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:53.521716 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764a58c-315a-4534-8ca0-3875238370fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:53.521991 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764a58c-315a-4534-8ca0-3875238370fc admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:53.523375 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764a58c-315a-4534-8ca0-3875238370fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:53.525348 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764a58c-315a-4534-8ca0-3875238370fc admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:53.652088 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1376/2762] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:02:53 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:53.656377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a83d8-d7c9-4366-9254-3684e668bb07 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:53.667166 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a83d8-d7c9-4366-9254-3684e668bb07 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:53.724154 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b99da1-2c62-4d85-b61b-306f7061e050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:53.724812 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b99da1-2c62-4d85-b61b-306f7061e050 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:53.724955 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b99da1-2c62-4d85-b61b-306f7061e050 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:53.725227 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b99da1-2c62-4d85-b61b-306f7061e050 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:53.726418 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b99da1-2c62-4d85-b61b-306f7061e050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:53.728385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b99da1-2c62-4d85-b61b-306f7061e050 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:53.736552 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=100 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:53.839119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1387/2763] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:02:53 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:53.843384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764a58c-315a-4534-8ca0-3875238370fc admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:53.853890 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764a58c-315a-4534-8ca0-3875238370fc admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:53.858994 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697af3f-85eb-45b0-939c-aaf88f92b481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:53.859951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697af3f-85eb-45b0-939c-aaf88f92b481 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:53.859951 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697af3f-85eb-45b0-939c-aaf88f92b481 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:53.860218 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697af3f-85eb-45b0-939c-aaf88f92b481 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:53.860860 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697af3f-85eb-45b0-939c-aaf88f92b481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:53.862456 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697af3f-85eb-45b0-939c-aaf88f92b481 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:53.873154 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1377/2764] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:53.877194 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b99da1-2c62-4d85-b61b-306f7061e050 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:53.888540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b99da1-2c62-4d85-b61b-306f7061e050 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:53.893234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5da87c-1679-410b-8d25-2909ae745d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:53.893837 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5da87c-1679-410b-8d25-2909ae745d35 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:53.894160 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5da87c-1679-410b-8d25-2909ae745d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:53.894432 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5da87c-1679-410b-8d25-2909ae745d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:53.895074 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5da87c-1679-410b-8d25-2909ae745d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:53.896700 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5da87c-1679-410b-8d25-2909ae745d35 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:53.907784 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1388/2765] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:53.912269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697af3f-85eb-45b0-939c-aaf88f92b481 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:53.924127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697af3f-85eb-45b0-939c-aaf88f92b481 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:53.932162 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0466a-1caf-46c8-bc19-72445cfb447d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:53.932830 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0466a-1caf-46c8-bc19-72445cfb447d admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:53.933111 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0466a-1caf-46c8-bc19-72445cfb447d admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:53.933387 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0466a-1caf-46c8-bc19-72445cfb447d admin admin] PATH_INFO: `/v3/projects/9db897df602c40dfb5e75ae3ee6aa848/users/ed4a2a0b7f7543f98bb32fda1713fb5a/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:53.951974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0466a-1caf-46c8-bc19-72445cfb447d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db897df602c40dfb5e75ae3ee6aa848, user_id=ed4a2a0b7f7543f98bb32fda1713fb5a, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:53.954607 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0466a-1caf-46c8-bc19-72445cfb447d admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:54.044691 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1378/2766] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:53 2022] PUT /identity/v3/projects/9db897df602c40dfb5e75ae3ee6aa848/users/ed4a2a0b7f7543f98bb32fda1713fb5a/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:54.050024 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30338ca5-bdd9-449e-b31c-071b50396f06 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:54.050309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30338ca5-bdd9-449e-b31c-071b50396f06 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:54.050585 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30338ca5-bdd9-449e-b31c-071b50396f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:54.071054 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-30338ca5-bdd9-449e-b31c-071b50396f06 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:54.072351 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-30338ca5-bdd9-449e-b31c-071b50396f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:54.130683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1389/2767] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:54.141263 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0466a-1caf-46c8-bc19-72445cfb447d admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:54.143087 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e0b0466a-1caf-46c8-bc19-72445cfb447d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:54.202764 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0466a-1caf-46c8-bc19-72445cfb447d admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:54.206476 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e416d8b-aed5-4243-8bc5-b577c0152259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:54.207080 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e416d8b-aed5-4243-8bc5-b577c0152259 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:54.207355 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e416d8b-aed5-4243-8bc5-b577c0152259 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:54.207653 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e416d8b-aed5-4243-8bc5-b577c0152259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:54.217248 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e416d8b-aed5-4243-8bc5-b577c0152259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:54.219342 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e416d8b-aed5-4243-8bc5-b577c0152259 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:54.229606 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1379/2768] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:02:56.008425 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30338ca5-bdd9-449e-b31c-071b50396f06 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:56.009956 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-30338ca5-bdd9-449e-b31c-071b50396f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:56.023509 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30338ca5-bdd9-449e-b31c-071b50396f06 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:56.028368 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b5eba-dac0-4598-a7b3-5f371eb2e017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:56.031739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b5eba-dac0-4598-a7b3-5f371eb2e017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:56.031739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b5eba-dac0-4598-a7b3-5f371eb2e017 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:56.031739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b5eba-dac0-4598-a7b3-5f371eb2e017 admin admin] PATH_INFO: `/v3/users/8ebc666c640a47b4a7ab9dd89ab1224e` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:56.031739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b5eba-dac0-4598-a7b3-5f371eb2e017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ebc666c640a47b4a7ab9dd89ab1224e)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:56.032648 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b5eba-dac0-4598-a7b3-5f371eb2e017 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:56.247938 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-381b5eba-dac0-4598-a7b3-5f371eb2e017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ebc666c640a47b4a7ab9dd89ab1224e'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:56.410461 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-381b5eba-dac0-4598-a7b3-5f371eb2e017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ebc666c640a47b4a7ab9dd89ab1224e'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:56.411629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-381b5eba-dac0-4598-a7b3-5f371eb2e017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ebc666c640a47b4a7ab9dd89ab1224e'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:56.426776 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-381b5eba-dac0-4598-a7b3-5f371eb2e017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ebc666c640a47b4a7ab9dd89ab1224e'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:56.437265 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-381b5eba-dac0-4598-a7b3-5f371eb2e017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ebc666c640a47b4a7ab9dd89ab1224e'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:56.444499 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1390/2769] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:02:56 2022] DELETE /identity/v3/users/8ebc666c640a47b4a7ab9dd89ab1224e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:02:56.449469 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f17df-1cd2-4295-8ec1-dac49e7986db None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:56.449960 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f17df-1cd2-4295-8ec1-dac49e7986db None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:56.450229 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f17df-1cd2-4295-8ec1-dac49e7986db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:56.470324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-1a8f17df-1cd2-4295-8ec1-dac49e7986db None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:56.471704 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1a8f17df-1cd2-4295-8ec1-dac49e7986db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:56.486754 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:56.542290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1380/2770] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:02:56.548055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b5eba-dac0-4598-a7b3-5f371eb2e017 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:56.549632 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-381b5eba-dac0-4598-a7b3-5f371eb2e017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:56.617718 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b5eba-dac0-4598-a7b3-5f371eb2e017 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:56.625347 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38da01d-053b-44d8-b2fb-89f9fcaae432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:56.626044 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38da01d-053b-44d8-b2fb-89f9fcaae432 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:56.626396 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38da01d-053b-44d8-b2fb-89f9fcaae432 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:56.626689 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38da01d-053b-44d8-b2fb-89f9fcaae432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:56.634788 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:56.666988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38da01d-053b-44d8-b2fb-89f9fcaae432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:56.666988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38da01d-053b-44d8-b2fb-89f9fcaae432 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:56.666988 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1391/2771] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:02:57.160774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f17df-1cd2-4295-8ec1-dac49e7986db None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:57.162326 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-1a8f17df-1cd2-4295-8ec1-dac49e7986db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:57.175866 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f17df-1cd2-4295-8ec1-dac49e7986db None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:57.180879 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf12f5c-fd88-44ea-86e3-e4dc5096abeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:57.181602 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf12f5c-fd88-44ea-86e3-e4dc5096abeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:57.181804 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf12f5c-fd88-44ea-86e3-e4dc5096abeb admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:57.182073 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf12f5c-fd88-44ea-86e3-e4dc5096abeb admin admin] PATH_INFO: `/v3/projects/274c86f307be4dfea0e929ebf8860090` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:57.183217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf12f5c-fd88-44ea-86e3-e4dc5096abeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=274c86f307be4dfea0e929ebf8860090)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:57.185187 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf12f5c-fd88-44ea-86e3-e4dc5096abeb admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:57.331908 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-fdf12f5c-fd88-44ea-86e3-e4dc5096abeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '274c86f307be4dfea0e929ebf8860090', 'request_id': 'req-fdf12f5c-fd88-44ea-86e3-e4dc5096abeb'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:57.438204 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-fdf12f5c-fd88-44ea-86e3-e4dc5096abeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '274c86f307be4dfea0e929ebf8860090', 'request_id': 'req-fdf12f5c-fd88-44ea-86e3-e4dc5096abeb'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:57.448325 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-fdf12f5c-fd88-44ea-86e3-e4dc5096abeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '274c86f307be4dfea0e929ebf8860090', 'request_id': 'req-fdf12f5c-fd88-44ea-86e3-e4dc5096abeb'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:57.468360 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-fdf12f5c-fd88-44ea-86e3-e4dc5096abeb admin admin] The token cache is being invalidate because project 274c86f307be4dfea0e929ebf8860090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:57.470179 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-fdf12f5c-fd88-44ea-86e3-e4dc5096abeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:57.470834 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-fdf12f5c-fd88-44ea-86e3-e4dc5096abeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:57.472694 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1381/2772] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:57 2022] DELETE /identity/v3/projects/274c86f307be4dfea0e929ebf8860090 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:57.477794 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38da01d-053b-44d8-b2fb-89f9fcaae432 service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:57.489507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38da01d-053b-44d8-b2fb-89f9fcaae432 service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:57.555587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905076f9-db9b-49f1-8fdf-465164ac3244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:57.556400 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905076f9-db9b-49f1-8fdf-465164ac3244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:57.556596 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905076f9-db9b-49f1-8fdf-465164ac3244 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:57.556869 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905076f9-db9b-49f1-8fdf-465164ac3244 admin admin] PATH_INFO: `/v3/users/d7da026354ca49f285ee66688ef23c5b` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:57.558410 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905076f9-db9b-49f1-8fdf-465164ac3244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7da026354ca49f285ee66688ef23c5b)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:57.560527 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905076f9-db9b-49f1-8fdf-465164ac3244 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:57.757272 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-905076f9-db9b-49f1-8fdf-465164ac3244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7da026354ca49f285ee66688ef23c5b'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:57.827360 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-905076f9-db9b-49f1-8fdf-465164ac3244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7da026354ca49f285ee66688ef23c5b'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:57.828151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-905076f9-db9b-49f1-8fdf-465164ac3244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7da026354ca49f285ee66688ef23c5b'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:57.844021 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-905076f9-db9b-49f1-8fdf-465164ac3244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7da026354ca49f285ee66688ef23c5b'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:57.852736 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-905076f9-db9b-49f1-8fdf-465164ac3244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7da026354ca49f285ee66688ef23c5b'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:57.865562 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1392/2773] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:02:57 2022] DELETE /identity/v3/users/d7da026354ca49f285ee66688ef23c5b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:58.505864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf12f5c-fd88-44ea-86e3-e4dc5096abeb admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:58.508078 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-fdf12f5c-fd88-44ea-86e3-e4dc5096abeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:58.522030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf12f5c-fd88-44ea-86e3-e4dc5096abeb admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:58.591240 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258e85c-c5f8-40d7-88b0-013955adaf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:58.592094 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258e85c-c5f8-40d7-88b0-013955adaf26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:58.592446 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258e85c-c5f8-40d7-88b0-013955adaf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:58.592808 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258e85c-c5f8-40d7-88b0-013955adaf26 admin admin] PATH_INFO: `/v3/projects/b5591eabd8584c90a33ef13683964d48` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:58.594197 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258e85c-c5f8-40d7-88b0-013955adaf26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5591eabd8584c90a33ef13683964d48)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:58.596241 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258e85c-c5f8-40d7-88b0-013955adaf26 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:58.756278 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:58.760360 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c258e85c-c5f8-40d7-88b0-013955adaf26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5591eabd8584c90a33ef13683964d48', 'request_id': 'req-c258e85c-c5f8-40d7-88b0-013955adaf26'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:58.822109 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c258e85c-c5f8-40d7-88b0-013955adaf26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5591eabd8584c90a33ef13683964d48', 'request_id': 'req-c258e85c-c5f8-40d7-88b0-013955adaf26'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:58.830543 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c258e85c-c5f8-40d7-88b0-013955adaf26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5591eabd8584c90a33ef13683964d48', 'request_id': 'req-c258e85c-c5f8-40d7-88b0-013955adaf26'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:58.844853 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c258e85c-c5f8-40d7-88b0-013955adaf26 admin admin] The token cache is being invalidate because project b5591eabd8584c90a33ef13683964d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:02:58.845640 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c258e85c-c5f8-40d7-88b0-013955adaf26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:58.846720 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c258e85c-c5f8-40d7-88b0-013955adaf26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:02:58.847496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1382/2774] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:02:58 2022] DELETE /identity/v3/projects/b5591eabd8584c90a33ef13683964d48 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:58.852928 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae78f9-c8a3-46ae-a2fe-bb6021ab9b03 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:58.853905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae78f9-c8a3-46ae-a2fe-bb6021ab9b03 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:58.854353 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae78f9-c8a3-46ae-a2fe-bb6021ab9b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:58.877449 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-7cae78f9-c8a3-46ae-a2fe-bb6021ab9b03 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:58.878721 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-7cae78f9-c8a3-46ae-a2fe-bb6021ab9b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:58.943298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1393/2775] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:58.951217 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2e646-cc3f-4ee1-a167-71bcc1affdea None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:58.953384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2e646-cc3f-4ee1-a167-71bcc1affdea None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:58.953384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2e646-cc3f-4ee1-a167-71bcc1affdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:58.973381 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-b7a2e646-cc3f-4ee1-a167-71bcc1affdea None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:58.974604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b7a2e646-cc3f-4ee1-a167-71bcc1affdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:58.986892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1383/2776] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:58.991037 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae78f9-c8a3-46ae-a2fe-bb6021ab9b03 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:59.007447 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae78f9-c8a3-46ae-a2fe-bb6021ab9b03 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:59.016755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d86dbb-98c8-4a2a-a5ad-e185369ce766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:59.017771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86dbb-98c8-4a2a-a5ad-e185369ce766 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:59.018712 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86dbb-98c8-4a2a-a5ad-e185369ce766 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:59.019111 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86dbb-98c8-4a2a-a5ad-e185369ce766 admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:59.020857 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d86dbb-98c8-4a2a-a5ad-e185369ce766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:02:59.021283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d86dbb-98c8-4a2a-a5ad-e185369ce766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:59.023758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d86dbb-98c8-4a2a-a5ad-e185369ce766 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:59.037787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:59.043379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1394/2777] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 20:02:59.047520 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2e646-cc3f-4ee1-a167-71bcc1affdea None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:59.059586 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2e646-cc3f-4ee1-a167-71bcc1affdea None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:59.065569 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58f894-57e3-486a-bdc8-e39955be5cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:59.066634 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58f894-57e3-486a-bdc8-e39955be5cfd admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:59.067306 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58f894-57e3-486a-bdc8-e39955be5cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:59.067848 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58f894-57e3-486a-bdc8-e39955be5cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:59.068727 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58f894-57e3-486a-bdc8-e39955be5cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:59.071388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58f894-57e3-486a-bdc8-e39955be5cfd admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:59.193788 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1384/2778] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:02:59 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:02:59.198704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d86dbb-98c8-4a2a-a5ad-e185369ce766 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:59.208780 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d86dbb-98c8-4a2a-a5ad-e185369ce766 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:59.283514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d83525-5027-46c2-becf-a641dd4dee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:59.284302 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d83525-5027-46c2-becf-a641dd4dee2c admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:59.284693 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d83525-5027-46c2-becf-a641dd4dee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:59.285209 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d83525-5027-46c2-becf-a641dd4dee2c admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:59.286026 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d83525-5027-46c2-becf-a641dd4dee2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:59.288215 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d83525-5027-46c2-becf-a641dd4dee2c admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:59.390057 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1395/2779] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:02:59 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 20:02:59.394160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58f894-57e3-486a-bdc8-e39955be5cfd admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:59.404500 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58f894-57e3-486a-bdc8-e39955be5cfd admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:59.409518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8999db1-4f9f-47f3-a229-9276b88845fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:59.410416 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8999db1-4f9f-47f3-a229-9276b88845fb admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:59.411007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8999db1-4f9f-47f3-a229-9276b88845fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:59.411376 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8999db1-4f9f-47f3-a229-9276b88845fb admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:59.412160 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8999db1-4f9f-47f3-a229-9276b88845fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:59.414515 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8999db1-4f9f-47f3-a229-9276b88845fb admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:59.430573 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1385/2780] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:59.435929 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d83525-5027-46c2-becf-a641dd4dee2c admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:59.444933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d83525-5027-46c2-becf-a641dd4dee2c admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:59.450005 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b7c8a-19c9-4286-a4f3-eaf97c0bba5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:59.450715 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b7c8a-19c9-4286-a4f3-eaf97c0bba5d admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:59.451060 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b7c8a-19c9-4286-a4f3-eaf97c0bba5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:59.451456 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b7c8a-19c9-4286-a4f3-eaf97c0bba5d admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:59.452209 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b7c8a-19c9-4286-a4f3-eaf97c0bba5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:59.453879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b7c8a-19c9-4286-a4f3-eaf97c0bba5d admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:59.467466 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1396/2781] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:02:59.476503 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8999db1-4f9f-47f3-a229-9276b88845fb admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:59.483346 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8999db1-4f9f-47f3-a229-9276b88845fb admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:59.488288 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc494b02-c941-449d-8ccf-d54b62e954eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:59.489232 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc494b02-c941-449d-8ccf-d54b62e954eb admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:59.489905 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc494b02-c941-449d-8ccf-d54b62e954eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:59.490175 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc494b02-c941-449d-8ccf-d54b62e954eb admin admin] PATH_INFO: `/v3/projects/00cf76678e44493dbc0777effc5e2d2e/users/3dd3405153744f15b404a7e57ccfb588/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:59.510585 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc494b02-c941-449d-8ccf-d54b62e954eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=00cf76678e44493dbc0777effc5e2d2e, user_id=3dd3405153744f15b404a7e57ccfb588, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:59.513973 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc494b02-c941-449d-8ccf-d54b62e954eb admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:59.594141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1386/2782] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:02:59 2022] PUT /identity/v3/projects/00cf76678e44493dbc0777effc5e2d2e/users/3dd3405153744f15b404a7e57ccfb588/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:02:59.604730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d2e0c-cf3c-4ed3-83a0-7ba60d4fb532 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:59.605018 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d2e0c-cf3c-4ed3-83a0-7ba60d4fb532 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:59.605286 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d2e0c-cf3c-4ed3-83a0-7ba60d4fb532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:59.636303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-067d2e0c-cf3c-4ed3-83a0-7ba60d4fb532 None None] MFA Rules not processed for user `3dd3405153744f15b404a7e57ccfb588`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:02:59.641690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-067d2e0c-cf3c-4ed3-83a0-7ba60d4fb532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:59.710720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1397/2783] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:02:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:02:59.721523 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc494b02-c941-449d-8ccf-d54b62e954eb admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:02:59.723353 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-dc494b02-c941-449d-8ccf-d54b62e954eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:02:59.846381 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc494b02-c941-449d-8ccf-d54b62e954eb admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:02:59.852843 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f0493-1436-4ea2-aa9a-c920dea76605 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:02:59.853944 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f0493-1436-4ea2-aa9a-c920dea76605 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:02:59.854363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f0493-1436-4ea2-aa9a-c920dea76605 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:02:59.854786 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f0493-1436-4ea2-aa9a-c920dea76605 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:02:59.869386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f0493-1436-4ea2-aa9a-c920dea76605 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:02:59.872144 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f0493-1436-4ea2-aa9a-c920dea76605 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:02:59.887829 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1387/2784] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:02:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:03:00.423367 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ed7eb-9e51-4d0c-a544-8127c510c173 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:03:00.425317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ed7eb-9e51-4d0c-a544-8127c510c173 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:03:00.425625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ed7eb-9e51-4d0c-a544-8127c510c173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:03:00.463514 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-768ed7eb-9e51-4d0c-a544-8127c510c173 None None] MFA Rules not processed for user `ed4a2a0b7f7543f98bb32fda1713fb5a`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:03:00.464978 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-768ed7eb-9e51-4d0c-a544-8127c510c173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:03:00.544573 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:03:00.549830 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1398/2785] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:03:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:03:00.569260 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f0493-1436-4ea2-aa9a-c920dea76605 service cinder] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:03:00.570802 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-400f0493-1436-4ea2-aa9a-c920dea76605 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:03:00.654482 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f0493-1436-4ea2-aa9a-c920dea76605 service cinder] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:03:00.660150 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227282b-9530-4a23-9054-8d7867fd8a10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:03:00.660794 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227282b-9530-4a23-9054-8d7867fd8a10 service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:03:00.661084 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227282b-9530-4a23-9054-8d7867fd8a10 service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:03:00.661362 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227282b-9530-4a23-9054-8d7867fd8a10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:03:00.668565 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:03:00.670732 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227282b-9530-4a23-9054-8d7867fd8a10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:03:00.672468 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227282b-9530-4a23-9054-8d7867fd8a10 service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:03:00.682677 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1388/2786] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:03:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:03:03.287355 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd375dbe-9713-4bf7-8753-727694ac21d4 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:03:03.287904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd375dbe-9713-4bf7-8753-727694ac21d4 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:03:03.291354 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd375dbe-9713-4bf7-8753-727694ac21d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:03:03.310829 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-dd375dbe-9713-4bf7-8753-727694ac21d4 None None] MFA Rules not processed for user `ed4a2a0b7f7543f98bb32fda1713fb5a`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:03:03.312332 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-dd375dbe-9713-4bf7-8753-727694ac21d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:03:03.321129 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1399/2787] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:03:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:03:11.387810 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:03:11.810611 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227282b-9530-4a23-9054-8d7867fd8a10 service nova] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:03:11.874690 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227282b-9530-4a23-9054-8d7867fd8a10 service nova] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:03:11.879239 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbc9ec-43a1-4185-b727-95d075e2ac95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:03:11.879905 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbc9ec-43a1-4185-b727-95d075e2ac95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:03:11.880223 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbc9ec-43a1-4185-b727-95d075e2ac95 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:03:11.880500 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbc9ec-43a1-4185-b727-95d075e2ac95 admin admin] PATH_INFO: `/v3/users/3dd3405153744f15b404a7e57ccfb588` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:03:11.881624 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbc9ec-43a1-4185-b727-95d075e2ac95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd3405153744f15b404a7e57ccfb588)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:03:11.883595 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbc9ec-43a1-4185-b727-95d075e2ac95 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:03:12.081382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f9cbc9ec-43a1-4185-b727-95d075e2ac95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd3405153744f15b404a7e57ccfb588'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:12.346864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f9cbc9ec-43a1-4185-b727-95d075e2ac95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd3405153744f15b404a7e57ccfb588'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:12.347482 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f9cbc9ec-43a1-4185-b727-95d075e2ac95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd3405153744f15b404a7e57ccfb588'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:12.355535 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f9cbc9ec-43a1-4185-b727-95d075e2ac95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd3405153744f15b404a7e57ccfb588'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:12.369890 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f9cbc9ec-43a1-4185-b727-95d075e2ac95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd3405153744f15b404a7e57ccfb588'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:12.380616 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1389/2788] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:03:11 2022] DELETE /identity/v3/users/3dd3405153744f15b404a7e57ccfb588 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:03:12.382352 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480037d8-4828-410b-9ad8-71086367b4b8 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:03:12.382853 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480037d8-4828-410b-9ad8-71086367b4b8 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:03:12.382960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480037d8-4828-410b-9ad8-71086367b4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:03:12.402562 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-480037d8-4828-410b-9ad8-71086367b4b8 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:03:12.409551 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-480037d8-4828-410b-9ad8-71086367b4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:03:12.468397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1400/2789] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:03:12.479328 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbc9ec-43a1-4185-b727-95d075e2ac95 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:03:12.480805 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f9cbc9ec-43a1-4185-b727-95d075e2ac95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:03:12.540483 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbc9ec-43a1-4185-b727-95d075e2ac95 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:03:12.544252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b0284-8c87-47e9-a54d-2f8d54882ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:03:12.544851 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b0284-8c87-47e9-a54d-2f8d54882ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:03:12.545125 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b0284-8c87-47e9-a54d-2f8d54882ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:03:12.545392 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b0284-8c87-47e9-a54d-2f8d54882ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:03:12.554065 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b0284-8c87-47e9-a54d-2f8d54882ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:03:12.555698 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b0284-8c87-47e9-a54d-2f8d54882ee7 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:03:12.564886 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1390/2790] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:03:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 20:03:13.040337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480037d8-4828-410b-9ad8-71086367b4b8 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:03:13.041825 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-480037d8-4828-410b-9ad8-71086367b4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:03:13.054713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480037d8-4828-410b-9ad8-71086367b4b8 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:03:13.060364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11d47b-41c8-4c61-a143-f3514477bc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:03:13.061036 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11d47b-41c8-4c61-a143-f3514477bc96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:03:13.061318 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11d47b-41c8-4c61-a143-f3514477bc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:03:13.061591 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11d47b-41c8-4c61-a143-f3514477bc96 admin admin] PATH_INFO: `/v3/projects/00cf76678e44493dbc0777effc5e2d2e` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:03:13.062821 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11d47b-41c8-4c61-a143-f3514477bc96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00cf76678e44493dbc0777effc5e2d2e)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:03:13.064767 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11d47b-41c8-4c61-a143-f3514477bc96 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:03:13.181746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bc11d47b-41c8-4c61-a143-f3514477bc96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00cf76678e44493dbc0777effc5e2d2e', 'request_id': 'req-bc11d47b-41c8-4c61-a143-f3514477bc96'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:13.257009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bc11d47b-41c8-4c61-a143-f3514477bc96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00cf76678e44493dbc0777effc5e2d2e', 'request_id': 'req-bc11d47b-41c8-4c61-a143-f3514477bc96'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:13.257009 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bc11d47b-41c8-4c61-a143-f3514477bc96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00cf76678e44493dbc0777effc5e2d2e', 'request_id': 'req-bc11d47b-41c8-4c61-a143-f3514477bc96'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:13.264814 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bc11d47b-41c8-4c61-a143-f3514477bc96 admin admin] The token cache is being invalidate because project 00cf76678e44493dbc0777effc5e2d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:03:13.265112 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bc11d47b-41c8-4c61-a143-f3514477bc96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:13.265781 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-bc11d47b-41c8-4c61-a143-f3514477bc96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:13.267283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1401/2791] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:03:13 2022] DELETE /identity/v3/projects/00cf76678e44493dbc0777effc5e2d2e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:03:22.560827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:03:23.260886 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:03:26.482136 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b0284-8c87-47e9-a54d-2f8d54882ee7 service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:03:26.491101 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b0284-8c87-47e9-a54d-2f8d54882ee7 service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:03:26.539131 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8464096-bf31-4efd-aad1-47f237de469f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:03:26.539756 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8464096-bf31-4efd-aad1-47f237de469f service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:03:26.540040 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8464096-bf31-4efd-aad1-47f237de469f service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:03:26.540313 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8464096-bf31-4efd-aad1-47f237de469f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:03:26.542133 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e8464096-bf31-4efd-aad1-47f237de469f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:03:26.606402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8464096-bf31-4efd-aad1-47f237de469f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:03:26.607870 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8464096-bf31-4efd-aad1-47f237de469f service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:03:26.617051 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1391/2792] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:03:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:03:33.129343 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11d47b-41c8-4c61-a143-f3514477bc96 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:03:33.130790 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-bc11d47b-41c8-4c61-a143-f3514477bc96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:03:33.143124 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11d47b-41c8-4c61-a143-f3514477bc96 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:03:33.146792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5518f-34b1-4070-af4a-4a4466f65651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:03:33.147390 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5518f-34b1-4070-af4a-4a4466f65651 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:03:33.147706 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5518f-34b1-4070-af4a-4a4466f65651 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:03:33.147981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5518f-34b1-4070-af4a-4a4466f65651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:03:33.149635 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f5e5518f-34b1-4070-af4a-4a4466f65651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:03:33.213151 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5518f-34b1-4070-af4a-4a4466f65651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:03:33.214577 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5518f-34b1-4070-af4a-4a4466f65651 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:03:33.224624 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1402/2793] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:03:36.612927 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=48 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:03:40.765076 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8464096-bf31-4efd-aad1-47f237de469f service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:03:40.766588 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e8464096-bf31-4efd-aad1-47f237de469f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:03:40.781869 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8464096-bf31-4efd-aad1-47f237de469f service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:03:40.792656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fb79e-4aef-4548-8469-b47baf86d449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:03:40.793238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fb79e-4aef-4548-8469-b47baf86d449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:03:40.793514 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fb79e-4aef-4548-8469-b47baf86d449 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:03:40.793784 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fb79e-4aef-4548-8469-b47baf86d449 admin admin] PATH_INFO: `/v3/users/4c11ae4c2cff47698b701398ba17295a` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:03:40.794901 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fb79e-4aef-4548-8469-b47baf86d449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c11ae4c2cff47698b701398ba17295a)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:03:40.797008 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fb79e-4aef-4548-8469-b47baf86d449 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:03:41.000866 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-515fb79e-4aef-4548-8469-b47baf86d449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c11ae4c2cff47698b701398ba17295a'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:41.129470 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-515fb79e-4aef-4548-8469-b47baf86d449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c11ae4c2cff47698b701398ba17295a'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:41.130108 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-515fb79e-4aef-4548-8469-b47baf86d449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c11ae4c2cff47698b701398ba17295a'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:41.137980 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-515fb79e-4aef-4548-8469-b47baf86d449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c11ae4c2cff47698b701398ba17295a'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:41.156567 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-515fb79e-4aef-4548-8469-b47baf86d449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c11ae4c2cff47698b701398ba17295a'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:41.160913 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1392/2794] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:03:40 2022] DELETE /identity/v3/users/4c11ae4c2cff47698b701398ba17295a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:03:41.405747 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5518f-34b1-4070-af4a-4a4466f65651 service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:03:41.416820 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5518f-34b1-4070-af4a-4a4466f65651 service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:03:41.489200 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66dded-dea9-4bfa-87a4-bcff4d7af112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:03:41.489845 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66dded-dea9-4bfa-87a4-bcff4d7af112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:03:41.490130 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66dded-dea9-4bfa-87a4-bcff4d7af112 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:03:41.490413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66dded-dea9-4bfa-87a4-bcff4d7af112 admin admin] PATH_INFO: `/v3/projects/b6d7978f092d4b0a814f1072ee5bcc62` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:03:41.491536 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66dded-dea9-4bfa-87a4-bcff4d7af112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6d7978f092d4b0a814f1072ee5bcc62)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:03:41.493461 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66dded-dea9-4bfa-87a4-bcff4d7af112 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:03:41.627080 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-df66dded-dea9-4bfa-87a4-bcff4d7af112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6d7978f092d4b0a814f1072ee5bcc62', 'request_id': 'req-df66dded-dea9-4bfa-87a4-bcff4d7af112'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:41.701350 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-df66dded-dea9-4bfa-87a4-bcff4d7af112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6d7978f092d4b0a814f1072ee5bcc62', 'request_id': 'req-df66dded-dea9-4bfa-87a4-bcff4d7af112'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:41.707746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-df66dded-dea9-4bfa-87a4-bcff4d7af112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6d7978f092d4b0a814f1072ee5bcc62', 'request_id': 'req-df66dded-dea9-4bfa-87a4-bcff4d7af112'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:41.719364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-df66dded-dea9-4bfa-87a4-bcff4d7af112 admin admin] The token cache is being invalidate because project b6d7978f092d4b0a814f1072ee5bcc62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:03:41.719683 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-df66dded-dea9-4bfa-87a4-bcff4d7af112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:41.720335 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-df66dded-dea9-4bfa-87a4-bcff4d7af112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:41.721843 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1403/2795] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:03:41 2022] DELETE /identity/v3/projects/b6d7978f092d4b0a814f1072ee5bcc62 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:03:41.726112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fb79e-4aef-4548-8469-b47baf86d449 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:03:41.727494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-515fb79e-4aef-4548-8469-b47baf86d449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:03:41.749545 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fb79e-4aef-4548-8469-b47baf86d449 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:03:41.821916 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8a1d3-39c9-456a-bfd5-6789d9fc3fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:03:41.822553 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8a1d3-39c9-456a-bfd5-6789d9fc3fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:03:41.822831 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8a1d3-39c9-456a-bfd5-6789d9fc3fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:03:41.823103 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8a1d3-39c9-456a-bfd5-6789d9fc3fb9 admin admin] PATH_INFO: `/v3/users/46ced918566e41cf84b0e767b933a66f` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:03:41.828690 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8a1d3-39c9-456a-bfd5-6789d9fc3fb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ced918566e41cf84b0e767b933a66f)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:03:41.828690 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8a1d3-39c9-456a-bfd5-6789d9fc3fb9 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:03:42.040423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-6da8a1d3-39c9-456a-bfd5-6789d9fc3fb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ced918566e41cf84b0e767b933a66f'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:42.112915 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-6da8a1d3-39c9-456a-bfd5-6789d9fc3fb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ced918566e41cf84b0e767b933a66f'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:42.113536 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-6da8a1d3-39c9-456a-bfd5-6789d9fc3fb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ced918566e41cf84b0e767b933a66f'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:42.121033 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-6da8a1d3-39c9-456a-bfd5-6789d9fc3fb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ced918566e41cf84b0e767b933a66f'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:42.128927 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:03:42.133354 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-6da8a1d3-39c9-456a-bfd5-6789d9fc3fb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ced918566e41cf84b0e767b933a66f'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:42.140190 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1393/2796] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:03:41 2022] DELETE /identity/v3/users/46ced918566e41cf84b0e767b933a66f => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:03:42.405978 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66dded-dea9-4bfa-87a4-bcff4d7af112 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:03:42.408838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-df66dded-dea9-4bfa-87a4-bcff4d7af112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:03:42.421675 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66dded-dea9-4bfa-87a4-bcff4d7af112 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:03:42.443960 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:03:42.480946 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5cde7-a409-4d11-a8cb-83022f201048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:03:42.481769 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5cde7-a409-4d11-a8cb-83022f201048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:03:42.482208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5cde7-a409-4d11-a8cb-83022f201048 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:03:42.482492 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5cde7-a409-4d11-a8cb-83022f201048 admin admin] PATH_INFO: `/v3/projects/e765e05fe9164fe9bf87cfdbe42c3783` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:03:42.484561 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5cde7-a409-4d11-a8cb-83022f201048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e765e05fe9164fe9bf87cfdbe42c3783)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:03:42.486667 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5cde7-a409-4d11-a8cb-83022f201048 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:03:42.610404 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-c5d5cde7-a409-4d11-a8cb-83022f201048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e765e05fe9164fe9bf87cfdbe42c3783', 'request_id': 'req-c5d5cde7-a409-4d11-a8cb-83022f201048'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:42.706478 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-c5d5cde7-a409-4d11-a8cb-83022f201048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e765e05fe9164fe9bf87cfdbe42c3783', 'request_id': 'req-c5d5cde7-a409-4d11-a8cb-83022f201048'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:42.712277 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-c5d5cde7-a409-4d11-a8cb-83022f201048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e765e05fe9164fe9bf87cfdbe42c3783', 'request_id': 'req-c5d5cde7-a409-4d11-a8cb-83022f201048'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:42.723417 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-c5d5cde7-a409-4d11-a8cb-83022f201048 admin admin] The token cache is being invalidate because project e765e05fe9164fe9bf87cfdbe42c3783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:03:42.728671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-c5d5cde7-a409-4d11-a8cb-83022f201048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:42.728671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-c5d5cde7-a409-4d11-a8cb-83022f201048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:03:42.728671 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1404/2797] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:03:42 2022] DELETE /identity/v3/projects/e765e05fe9164fe9bf87cfdbe42c3783 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:03:52.090347 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8a1d3-39c9-456a-bfd5-6789d9fc3fb9 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:03:52.091762 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-6da8a1d3-39c9-456a-bfd5-6789d9fc3fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:03:52.180917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8a1d3-39c9-456a-bfd5-6789d9fc3fb9 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:03:52.238785 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac171e-63c6-4936-8831-242fff24ee17 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6942a851a69b446e90a2b138f4482465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:03:52.239386 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac171e-63c6-4936-8831-242fff24ee17 service placement] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:03:52.239690 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac171e-63c6-4936-8831-242fff24ee17 service placement] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:03:52.239964 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac171e-63c6-4936-8831-242fff24ee17 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:03:52.241661 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-aaac171e-63c6-4936-8831-242fff24ee17 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:03:52.253009 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac171e-63c6-4936-8831-242fff24ee17 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:03:52.254615 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac171e-63c6-4936-8831-242fff24ee17 service placement] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:03:52.264278 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1394/2798] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:03:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:03:52.720472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:04:01.817339 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18dec7-3fdc-42e9-a39b-8a32466425a7 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:04:01.817959 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18dec7-3fdc-42e9-a39b-8a32466425a7 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:04:01.817959 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18dec7-3fdc-42e9-a39b-8a32466425a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:04:01.837478 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-4d18dec7-3fdc-42e9-a39b-8a32466425a7 None None] MFA Rules not processed for user `ed4a2a0b7f7543f98bb32fda1713fb5a`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:04:01.838676 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4d18dec7-3fdc-42e9-a39b-8a32466425a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:04:01.897540 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1405/2799] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:04:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:04:02.210348 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac171e-63c6-4936-8831-242fff24ee17 service placement] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:04:02.211937 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-aaac171e-63c6-4936-8831-242fff24ee17 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:04:02.267670 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac171e-63c6-4936-8831-242fff24ee17 service placement] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:04:02.271204 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0292b2-4d3a-4507-addd-99ca904d9ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:04:02.271838 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0292b2-4d3a-4507-addd-99ca904d9ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:04:02.272117 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0292b2-4d3a-4507-addd-99ca904d9ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:04:02.272388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0292b2-4d3a-4507-addd-99ca904d9ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:04:02.274072 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ed0292b2-4d3a-4507-addd-99ca904d9ab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:04:02.283738 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0292b2-4d3a-4507-addd-99ca904d9ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:04:02.285148 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0292b2-4d3a-4507-addd-99ca904d9ab1 service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:04:02.293186 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1395/2800] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:04:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:04:11.890061 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=25 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:04:12.289488 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=96,keystone:DELETE=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:05:07.279774 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c14aa7-58a5-4907-9121-537d49a1a703 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:05:07.280268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c14aa7-58a5-4907-9121-537d49a1a703 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:05:07.280375 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c14aa7-58a5-4907-9121-537d49a1a703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:05:07.300035 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-02c14aa7-58a5-4907-9121-537d49a1a703 None None] MFA Rules not processed for user `ed4a2a0b7f7543f98bb32fda1713fb5a`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:05:07.301465 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-02c14aa7-58a5-4907-9121-537d49a1a703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:05:07.308373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1406/2801] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:05:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:05:17.294472 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:06:00.791474 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0292b2-4d3a-4507-addd-99ca904d9ab1 service neutron] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:06:00.793227 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-ed0292b2-4d3a-4507-addd-99ca904d9ab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:06:00.850873 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0292b2-4d3a-4507-addd-99ca904d9ab1 service neutron] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:06:00.854785 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094aee36-8bbb-49e0-847b-0f6e2d62967d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:06:00.855389 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aee36-8bbb-49e0-847b-0f6e2d62967d service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:06:00.855714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aee36-8bbb-49e0-847b-0f6e2d62967d service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:06:00.855989 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aee36-8bbb-49e0-847b-0f6e2d62967d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:06:00.857729 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-094aee36-8bbb-49e0-847b-0f6e2d62967d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:06:00.948186 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094aee36-8bbb-49e0-847b-0f6e2d62967d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:06:00.949817 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094aee36-8bbb-49e0-847b-0f6e2d62967d service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:06:00.970577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1396/2802] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:06:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:06:04.163494 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c14aa7-58a5-4907-9121-537d49a1a703 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:06:04.164934 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-02c14aa7-58a5-4907-9121-537d49a1a703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:06:04.176720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c14aa7-58a5-4907-9121-537d49a1a703 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:06:04.180376 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e85b42-9f70-44e8-96d0-40fb79fbebd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:06:04.180976 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e85b42-9f70-44e8-96d0-40fb79fbebd0 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:06:04.181250 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e85b42-9f70-44e8-96d0-40fb79fbebd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:06:04.181520 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e85b42-9f70-44e8-96d0-40fb79fbebd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:06:04.183713 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-47e85b42-9f70-44e8-96d0-40fb79fbebd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:06:04.196749 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e85b42-9f70-44e8-96d0-40fb79fbebd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:06:04.198150 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e85b42-9f70-44e8-96d0-40fb79fbebd0 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:06:04.209677 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1407/2803] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:06:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:06:10.968054 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=66 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:06:14.133390 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62726f1-0c5e-4957-b60c-81f2415ced9f None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:06:14.134005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62726f1-0c5e-4957-b60c-81f2415ced9f None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:06:14.134005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62726f1-0c5e-4957-b60c-81f2415ced9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:06:14.153822 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-f62726f1-0c5e-4957-b60c-81f2415ced9f None None] MFA Rules not processed for user `ed4a2a0b7f7543f98bb32fda1713fb5a`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:06:14.155093 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f62726f1-0c5e-4957-b60c-81f2415ced9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:06:14.162044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1397/2804] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:06:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:06:14.204792 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=6 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:06:24.147746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:06:25.509563 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e85b42-9f70-44e8-96d0-40fb79fbebd0 service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:06:25.510952 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-47e85b42-9f70-44e8-96d0-40fb79fbebd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:06:25.523119 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e85b42-9f70-44e8-96d0-40fb79fbebd0 service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:06:25.526777 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28d13b-b0b2-44be-9f80-c4e047707941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:06:25.527387 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28d13b-b0b2-44be-9f80-c4e047707941 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:06:25.527699 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28d13b-b0b2-44be-9f80-c4e047707941 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:06:25.527975 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28d13b-b0b2-44be-9f80-c4e047707941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:06:25.530317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-eb28d13b-b0b2-44be-9f80-c4e047707941 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:06:25.539751 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28d13b-b0b2-44be-9f80-c4e047707941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:06:25.541173 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28d13b-b0b2-44be-9f80-c4e047707941 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:06:25.549440 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1408/2805] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:06:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:06:28.984779 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62726f1-0c5e-4957-b60c-81f2415ced9f None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:06:28.986238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-f62726f1-0c5e-4957-b60c-81f2415ced9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:06:29.006777 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62726f1-0c5e-4957-b60c-81f2415ced9f None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:06:29.022649 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e1d7c-c09e-4d0c-b5d3-78fbe74ddbc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:06:29.023281 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e1d7c-c09e-4d0c-b5d3-78fbe74ddbc7 service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:06:29.023570 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e1d7c-c09e-4d0c-b5d3-78fbe74ddbc7 service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:06:29.023986 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e1d7c-c09e-4d0c-b5d3-78fbe74ddbc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:06:29.025759 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e84e1d7c-c09e-4d0c-b5d3-78fbe74ddbc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:06:29.042405 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e1d7c-c09e-4d0c-b5d3-78fbe74ddbc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:06:29.044181 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e1d7c-c09e-4d0c-b5d3-78fbe74ddbc7 service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:06:29.056136 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1398/2806] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:06:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:06:35.545603 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=6 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:06:39.051955 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=6 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:07:25.289024 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28d13b-b0b2-44be-9f80-c4e047707941 service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:25.290501 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-eb28d13b-b0b2-44be-9f80-c4e047707941 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:25.357972 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28d13b-b0b2-44be-9f80-c4e047707941 service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:25.362482 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f1653-0266-41a7-8cc3-3de64262ad79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:25.363177 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f1653-0266-41a7-8cc3-3de64262ad79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:25.363730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f1653-0266-41a7-8cc3-3de64262ad79 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:25.364004 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f1653-0266-41a7-8cc3-3de64262ad79 admin admin] PATH_INFO: `/v3/users/ed4a2a0b7f7543f98bb32fda1713fb5a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:25.365136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f1653-0266-41a7-8cc3-3de64262ad79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed4a2a0b7f7543f98bb32fda1713fb5a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:25.367626 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f1653-0266-41a7-8cc3-3de64262ad79 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:25.562764 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2d4f1653-0266-41a7-8cc3-3de64262ad79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed4a2a0b7f7543f98bb32fda1713fb5a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:25.608401 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2d4f1653-0266-41a7-8cc3-3de64262ad79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed4a2a0b7f7543f98bb32fda1713fb5a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:25.609073 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2d4f1653-0266-41a7-8cc3-3de64262ad79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed4a2a0b7f7543f98bb32fda1713fb5a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:25.622489 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2d4f1653-0266-41a7-8cc3-3de64262ad79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed4a2a0b7f7543f98bb32fda1713fb5a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:25.629340 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-2d4f1653-0266-41a7-8cc3-3de64262ad79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed4a2a0b7f7543f98bb32fda1713fb5a'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:25.635413 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1409/2807] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:07:25 2022] DELETE /identity/v3/users/ed4a2a0b7f7543f98bb32fda1713fb5a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:07:25.891870 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e1d7c-c09e-4d0c-b5d3-78fbe74ddbc7 service nova] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:25.903299 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e1d7c-c09e-4d0c-b5d3-78fbe74ddbc7 service nova] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:25.960800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c4e9e-23fb-41c0-91eb-1b2136529a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:25.961430 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c4e9e-23fb-41c0-91eb-1b2136529a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:25.961706 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c4e9e-23fb-41c0-91eb-1b2136529a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:25.961976 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c4e9e-23fb-41c0-91eb-1b2136529a16 admin admin] PATH_INFO: `/v3/projects/9db897df602c40dfb5e75ae3ee6aa848` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:25.963144 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c4e9e-23fb-41c0-91eb-1b2136529a16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9db897df602c40dfb5e75ae3ee6aa848)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:25.965057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c4e9e-23fb-41c0-91eb-1b2136529a16 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:26.104286 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f87c4e9e-23fb-41c0-91eb-1b2136529a16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9db897df602c40dfb5e75ae3ee6aa848', 'request_id': 'req-f87c4e9e-23fb-41c0-91eb-1b2136529a16'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:26.176496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f87c4e9e-23fb-41c0-91eb-1b2136529a16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9db897df602c40dfb5e75ae3ee6aa848', 'request_id': 'req-f87c4e9e-23fb-41c0-91eb-1b2136529a16'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:26.182563 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f87c4e9e-23fb-41c0-91eb-1b2136529a16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9db897df602c40dfb5e75ae3ee6aa848', 'request_id': 'req-f87c4e9e-23fb-41c0-91eb-1b2136529a16'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:26.193688 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f87c4e9e-23fb-41c0-91eb-1b2136529a16 admin admin] The token cache is being invalidate because project 9db897df602c40dfb5e75ae3ee6aa848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:07:26.193977 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f87c4e9e-23fb-41c0-91eb-1b2136529a16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:26.194690 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-f87c4e9e-23fb-41c0-91eb-1b2136529a16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:26.196228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1399/2808] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:07:25 2022] DELETE /identity/v3/projects/9db897df602c40dfb5e75ae3ee6aa848 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:07:26.201017 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bc0fc-32fd-4534-8368-83767ba83e90 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:26.201300 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bc0fc-32fd-4534-8368-83767ba83e90 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:26.201577 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bc0fc-32fd-4534-8368-83767ba83e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:26.222022 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-653bc0fc-32fd-4534-8368-83767ba83e90 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:07:26.226619 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-653bc0fc-32fd-4534-8368-83767ba83e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:26.281826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1410/2809] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:07:26.289737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f956e-c88d-48f3-bfe8-c6447477e63c None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:26.290026 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f956e-c88d-48f3-bfe8-c6447477e63c None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:26.290322 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f956e-c88d-48f3-bfe8-c6447477e63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:26.310017 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-268f956e-c88d-48f3-bfe8-c6447477e63c None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:07:26.311214 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-268f956e-c88d-48f3-bfe8-c6447477e63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:26.319843 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1400/2810] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:07:26.324033 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bc0fc-32fd-4534-8368-83767ba83e90 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:26.334059 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bc0fc-32fd-4534-8368-83767ba83e90 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:26.338755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf2d97-251c-4a41-b57f-026f3a406321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:26.339359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf2d97-251c-4a41-b57f-026f3a406321 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:26.339673 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf2d97-251c-4a41-b57f-026f3a406321 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:26.340152 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf2d97-251c-4a41-b57f-026f3a406321 admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:26.340839 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf2d97-251c-4a41-b57f-026f3a406321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:07:26.341147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf2d97-251c-4a41-b57f-026f3a406321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:26.342735 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf2d97-251c-4a41-b57f-026f3a406321 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:26.354760 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1411/2811] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 20:07:26.358958 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f956e-c88d-48f3-bfe8-c6447477e63c None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:26.369166 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f956e-c88d-48f3-bfe8-c6447477e63c None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:26.373857 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1081a-1a7f-4822-8bad-31cf5fedaac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:26.374463 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1081a-1a7f-4822-8bad-31cf5fedaac6 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:26.374737 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1081a-1a7f-4822-8bad-31cf5fedaac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:26.375007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1081a-1a7f-4822-8bad-31cf5fedaac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:26.375684 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1081a-1a7f-4822-8bad-31cf5fedaac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:26.377598 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1081a-1a7f-4822-8bad-31cf5fedaac6 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:26.542961 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1401/2812] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:07:26 2022] POST /identity/v3/projects => generated 357 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:07:26.547149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf2d97-251c-4a41-b57f-026f3a406321 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:26.559380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf2d97-251c-4a41-b57f-026f3a406321 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:26.563065 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:07:26.616440 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca71d3f-4007-45bd-89c9-24fb0186d7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:26.616855 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca71d3f-4007-45bd-89c9-24fb0186d7ea admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:26.617132 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca71d3f-4007-45bd-89c9-24fb0186d7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:26.617403 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca71d3f-4007-45bd-89c9-24fb0186d7ea admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:26.618024 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca71d3f-4007-45bd-89c9-24fb0186d7ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:26.620011 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca71d3f-4007-45bd-89c9-24fb0186d7ea admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:26.712100 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1412/2813] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:07:26 2022] POST /identity/v3/users => generated 279 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 20:07:26.725614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1081a-1a7f-4822-8bad-31cf5fedaac6 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:26.736099 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1081a-1a7f-4822-8bad-31cf5fedaac6 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:26.741238 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce579ee-3cfd-4fbe-8375-a9aed4513fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:26.741827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce579ee-3cfd-4fbe-8375-a9aed4513fda admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:26.742100 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce579ee-3cfd-4fbe-8375-a9aed4513fda admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:26.742367 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce579ee-3cfd-4fbe-8375-a9aed4513fda admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:26.743006 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce579ee-3cfd-4fbe-8375-a9aed4513fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:26.744626 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce579ee-3cfd-4fbe-8375-a9aed4513fda admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:26.754396 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1402/2814] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:07:26.758636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca71d3f-4007-45bd-89c9-24fb0186d7ea admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:26.768574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca71d3f-4007-45bd-89c9-24fb0186d7ea admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:26.773687 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553f957-c841-47da-aa65-0e4aea6af622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:26.774293 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553f957-c841-47da-aa65-0e4aea6af622 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:26.774572 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553f957-c841-47da-aa65-0e4aea6af622 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:26.774840 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553f957-c841-47da-aa65-0e4aea6af622 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:26.775470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553f957-c841-47da-aa65-0e4aea6af622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:26.777182 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553f957-c841-47da-aa65-0e4aea6af622 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:26.788432 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1413/2815] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:07:26.792550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce579ee-3cfd-4fbe-8375-a9aed4513fda admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:26.803055 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce579ee-3cfd-4fbe-8375-a9aed4513fda admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:26.808441 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254af9d-beba-4518-b046-612690dcfd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:26.809105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254af9d-beba-4518-b046-612690dcfd65 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:26.809380 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254af9d-beba-4518-b046-612690dcfd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:26.809652 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254af9d-beba-4518-b046-612690dcfd65 admin admin] PATH_INFO: `/v3/projects/d5afbf0d89564780bcb37dab7baf64ff/users/a5117e5423fe4c43b89d93b331a60818/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:26.825874 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254af9d-beba-4518-b046-612690dcfd65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5afbf0d89564780bcb37dab7baf64ff, user_id=a5117e5423fe4c43b89d93b331a60818, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:26.828551 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254af9d-beba-4518-b046-612690dcfd65 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:26.924565 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1403/2816] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:07:26 2022] PUT /identity/v3/projects/d5afbf0d89564780bcb37dab7baf64ff/users/a5117e5423fe4c43b89d93b331a60818/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:07:26.936374 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f9fb9-a281-4831-b388-9e83e90393a7 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:26.936658 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f9fb9-a281-4831-b388-9e83e90393a7 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:26.936931 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f9fb9-a281-4831-b388-9e83e90393a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:26.966814 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-344f9fb9-a281-4831-b388-9e83e90393a7 None None] MFA Rules not processed for user `a5117e5423fe4c43b89d93b331a60818`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:07:26.968096 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-344f9fb9-a281-4831-b388-9e83e90393a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:27.033028 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1414/2817] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:07:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:07:27.037546 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254af9d-beba-4518-b046-612690dcfd65 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:27.067644 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:07:27.100524 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254af9d-beba-4518-b046-612690dcfd65 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:27.105494 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274273d0-0826-41c2-bd44-d7331782bbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:27.106094 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274273d0-0826-41c2-bd44-d7331782bbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:27.106371 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274273d0-0826-41c2-bd44-d7331782bbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:27.106641 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274273d0-0826-41c2-bd44-d7331782bbe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:27.107259 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274273d0-0826-41c2-bd44-d7331782bbe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:27.109187 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274273d0-0826-41c2-bd44-d7331782bbe4 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:27.177363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1404/2818] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:07:27 2022] POST /identity/v3/projects => generated 355 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:07:27.181626 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f9fb9-a281-4831-b388-9e83e90393a7 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:27.192371 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f9fb9-a281-4831-b388-9e83e90393a7 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:27.250884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21861006-1e23-4494-8096-4ef9fb1503c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:27.251501 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21861006-1e23-4494-8096-4ef9fb1503c9 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:27.251809 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21861006-1e23-4494-8096-4ef9fb1503c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:27.252082 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21861006-1e23-4494-8096-4ef9fb1503c9 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:27.252863 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21861006-1e23-4494-8096-4ef9fb1503c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:27.254761 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21861006-1e23-4494-8096-4ef9fb1503c9 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:27.341013 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1415/2819] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:07:27 2022] POST /identity/v3/users => generated 284 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:07:27.345250 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274273d0-0826-41c2-bd44-d7331782bbe4 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:27.355518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274273d0-0826-41c2-bd44-d7331782bbe4 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:27.360024 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f965ec5-7bad-4f32-a73e-3fd0090ce85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:27.360619 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f965ec5-7bad-4f32-a73e-3fd0090ce85d admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:27.360892 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f965ec5-7bad-4f32-a73e-3fd0090ce85d admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:27.361196 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f965ec5-7bad-4f32-a73e-3fd0090ce85d admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:27.361838 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f965ec5-7bad-4f32-a73e-3fd0090ce85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:27.363700 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f965ec5-7bad-4f32-a73e-3fd0090ce85d admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:27.373745 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1405/2820] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:07:27.379509 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21861006-1e23-4494-8096-4ef9fb1503c9 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:27.386528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:07:27.390219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21861006-1e23-4494-8096-4ef9fb1503c9 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:27.394828 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731626fc-1156-458f-90d1-c13294d207b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:27.395507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731626fc-1156-458f-90d1-c13294d207b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:27.395788 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731626fc-1156-458f-90d1-c13294d207b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:27.396049 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731626fc-1156-458f-90d1-c13294d207b5 admin admin] PATH_INFO: `/v3/projects/d495b54d669a4ed295187de72f263795/users/9819cb239f6346fe8122496b0814bb0f/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:27.410981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731626fc-1156-458f-90d1-c13294d207b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d495b54d669a4ed295187de72f263795, user_id=9819cb239f6346fe8122496b0814bb0f, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:27.413759 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731626fc-1156-458f-90d1-c13294d207b5 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:27.477629 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1416/2821] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:07:27 2022] PUT /identity/v3/projects/d495b54d669a4ed295187de72f263795/users/9819cb239f6346fe8122496b0814bb0f/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:07:27.481679 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f965ec5-7bad-4f32-a73e-3fd0090ce85d admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:27.492983 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f965ec5-7bad-4f32-a73e-3fd0090ce85d admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:27.548430 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5564e8d-cea4-41b6-a650-912ea2a80846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:27.549031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5564e8d-cea4-41b6-a650-912ea2a80846 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:27.549307 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5564e8d-cea4-41b6-a650-912ea2a80846 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:27.549575 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5564e8d-cea4-41b6-a650-912ea2a80846 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:27.550206 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5564e8d-cea4-41b6-a650-912ea2a80846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:27.551825 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5564e8d-cea4-41b6-a650-912ea2a80846 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:27.562004 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1406/2822] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:07:27.566283 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731626fc-1156-458f-90d1-c13294d207b5 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:27.578094 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731626fc-1156-458f-90d1-c13294d207b5 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:27.582839 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2850f-0b23-4dff-b192-c4a49111cf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:27.583501 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2850f-0b23-4dff-b192-c4a49111cf1e admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:27.583808 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2850f-0b23-4dff-b192-c4a49111cf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:27.584081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2850f-0b23-4dff-b192-c4a49111cf1e admin admin] PATH_INFO: `/v3/projects/d495b54d669a4ed295187de72f263795/users/9819cb239f6346fe8122496b0814bb0f/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:27.586220 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2850f-0b23-4dff-b192-c4a49111cf1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d495b54d669a4ed295187de72f263795, user_id=9819cb239f6346fe8122496b0814bb0f, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:27.589149 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2850f-0b23-4dff-b192-c4a49111cf1e admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:27.599609 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1417/2823] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:07:27 2022] PUT /identity/v3/projects/d495b54d669a4ed295187de72f263795/users/9819cb239f6346fe8122496b0814bb0f/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:07:27.610092 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3ae65-8d67-4cb9-bd7b-690e20b48f1a None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:27.610378 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3ae65-8d67-4cb9-bd7b-690e20b48f1a None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:27.610655 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3ae65-8d67-4cb9-bd7b-690e20b48f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:27.640121 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-44b3ae65-8d67-4cb9-bd7b-690e20b48f1a None None] MFA Rules not processed for user `9819cb239f6346fe8122496b0814bb0f`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:07:27.647945 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-44b3ae65-8d67-4cb9-bd7b-690e20b48f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:27.708071 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1407/2824] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:07:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:07:27.719521 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2850f-0b23-4dff-b192-c4a49111cf1e admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:27.721256 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-5aa2850f-0b23-4dff-b192-c4a49111cf1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:27.779928 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2850f-0b23-4dff-b192-c4a49111cf1e admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:27.783608 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd2b91-41e3-4dda-bf35-81172406d610 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:27.784216 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd2b91-41e3-4dda-bf35-81172406d610 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:27.784494 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd2b91-41e3-4dda-bf35-81172406d610 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:27.784767 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd2b91-41e3-4dda-bf35-81172406d610 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:27.794587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd2b91-41e3-4dda-bf35-81172406d610 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:27.796036 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd2b91-41e3-4dda-bf35-81172406d610 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:27.806301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1418/2825] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:07:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:07:28.028555 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3ae65-8d67-4cb9-bd7b-690e20b48f1a None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:28.038287 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3ae65-8d67-4cb9-bd7b-690e20b48f1a None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:28.042631 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823cb67-070a-4a6e-b3dc-51bf538d4e52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:28.043231 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823cb67-070a-4a6e-b3dc-51bf538d4e52 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:28.043503 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823cb67-070a-4a6e-b3dc-51bf538d4e52 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:28.043796 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823cb67-070a-4a6e-b3dc-51bf538d4e52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:28.063256 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:07:28.100413 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823cb67-070a-4a6e-b3dc-51bf538d4e52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:28.102372 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823cb67-070a-4a6e-b3dc-51bf538d4e52 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:28.111260 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1408/2826] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:07:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:07:37.801162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=39,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:07:38.118876 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=18 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:07:46.664619 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd2b91-41e3-4dda-bf35-81172406d610 service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:46.725574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd2b91-41e3-4dda-bf35-81172406d610 service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:46.730068 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ede3f1-d9bf-4df1-81f6-a2cb5f684ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:46.731291 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ede3f1-d9bf-4df1-81f6-a2cb5f684ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:46.731667 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ede3f1-d9bf-4df1-81f6-a2cb5f684ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:46.731947 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ede3f1-d9bf-4df1-81f6-a2cb5f684ca8 admin admin] PATH_INFO: `/v3/users/a5117e5423fe4c43b89d93b331a60818` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:46.733127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ede3f1-d9bf-4df1-81f6-a2cb5f684ca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5117e5423fe4c43b89d93b331a60818)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:46.734973 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ede3f1-d9bf-4df1-81f6-a2cb5f684ca8 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:46.915478 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-25ede3f1-d9bf-4df1-81f6-a2cb5f684ca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5117e5423fe4c43b89d93b331a60818'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:46.970000 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-25ede3f1-d9bf-4df1-81f6-a2cb5f684ca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5117e5423fe4c43b89d93b331a60818'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:46.970622 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-25ede3f1-d9bf-4df1-81f6-a2cb5f684ca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5117e5423fe4c43b89d93b331a60818'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:46.983982 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-25ede3f1-d9bf-4df1-81f6-a2cb5f684ca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5117e5423fe4c43b89d93b331a60818'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:46.991231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-25ede3f1-d9bf-4df1-81f6-a2cb5f684ca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5117e5423fe4c43b89d93b331a60818'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:46.997216 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1419/2827] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:07:46 2022] DELETE /identity/v3/users/a5117e5423fe4c43b89d93b331a60818 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:07:47.001780 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8c827-1a5b-47b5-8379-025532cb3558 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:47.002280 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8c827-1a5b-47b5-8379-025532cb3558 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:47.002387 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8c827-1a5b-47b5-8379-025532cb3558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:47.021344 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-d5a8c827-1a5b-47b5-8379-025532cb3558 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:07:47.022552 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d5a8c827-1a5b-47b5-8379-025532cb3558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:47.081127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1409/2828] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:07:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:07:47.095664 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ede3f1-d9bf-4df1-81f6-a2cb5f684ca8 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:47.095664 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-25ede3f1-d9bf-4df1-81f6-a2cb5f684ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:47.165512 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ede3f1-d9bf-4df1-81f6-a2cb5f684ca8 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:47.170320 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9fcd75-94d4-4079-9e2d-f438efb2a070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:47.170944 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fcd75-94d4-4079-9e2d-f438efb2a070 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:47.171214 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fcd75-94d4-4079-9e2d-f438efb2a070 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:47.171487 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fcd75-94d4-4079-9e2d-f438efb2a070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:47.180459 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9fcd75-94d4-4079-9e2d-f438efb2a070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:47.181879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9fcd75-94d4-4079-9e2d-f438efb2a070 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:47.192309 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1420/2829] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:07:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:07:47.561022 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8c827-1a5b-47b5-8379-025532cb3558 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:47.563753 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d5a8c827-1a5b-47b5-8379-025532cb3558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:47.575246 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8c827-1a5b-47b5-8379-025532cb3558 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:47.580179 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a58987-25d0-45ec-bc20-aae581fa20a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:47.580834 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a58987-25d0-45ec-bc20-aae581fa20a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:47.581117 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a58987-25d0-45ec-bc20-aae581fa20a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:47.581395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a58987-25d0-45ec-bc20-aae581fa20a5 admin admin] PATH_INFO: `/v3/projects/d5afbf0d89564780bcb37dab7baf64ff` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:47.582552 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a58987-25d0-45ec-bc20-aae581fa20a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5afbf0d89564780bcb37dab7baf64ff)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:47.584604 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a58987-25d0-45ec-bc20-aae581fa20a5 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:47.696303 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-e6a58987-25d0-45ec-bc20-aae581fa20a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5afbf0d89564780bcb37dab7baf64ff', 'request_id': 'req-e6a58987-25d0-45ec-bc20-aae581fa20a5'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:47.770237 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-e6a58987-25d0-45ec-bc20-aae581fa20a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5afbf0d89564780bcb37dab7baf64ff', 'request_id': 'req-e6a58987-25d0-45ec-bc20-aae581fa20a5'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:47.776613 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-e6a58987-25d0-45ec-bc20-aae581fa20a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5afbf0d89564780bcb37dab7baf64ff', 'request_id': 'req-e6a58987-25d0-45ec-bc20-aae581fa20a5'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:47.788760 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-e6a58987-25d0-45ec-bc20-aae581fa20a5 admin admin] The token cache is being invalidate because project d5afbf0d89564780bcb37dab7baf64ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:07:47.789326 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-e6a58987-25d0-45ec-bc20-aae581fa20a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:47.790076 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-e6a58987-25d0-45ec-bc20-aae581fa20a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:47.791637 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1410/2830] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:07:47 2022] DELETE /identity/v3/projects/d5afbf0d89564780bcb37dab7baf64ff => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:07:47.796136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9fcd75-94d4-4079-9e2d-f438efb2a070 service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:47.806114 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9fcd75-94d4-4079-9e2d-f438efb2a070 service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:47.825836 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:07:47.863964 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7cd28-eb69-420e-ac3b-324e525370a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:47.864599 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7cd28-eb69-420e-ac3b-324e525370a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:47.864878 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7cd28-eb69-420e-ac3b-324e525370a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:47.865152 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7cd28-eb69-420e-ac3b-324e525370a3 admin admin] PATH_INFO: `/v3/users/9819cb239f6346fe8122496b0814bb0f` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:47.866271 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7cd28-eb69-420e-ac3b-324e525370a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9819cb239f6346fe8122496b0814bb0f)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:47.868226 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7cd28-eb69-420e-ac3b-324e525370a3 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:48.068509 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-56b7cd28-eb69-420e-ac3b-324e525370a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9819cb239f6346fe8122496b0814bb0f'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:48.181763 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-56b7cd28-eb69-420e-ac3b-324e525370a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9819cb239f6346fe8122496b0814bb0f'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:48.182395 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-56b7cd28-eb69-420e-ac3b-324e525370a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9819cb239f6346fe8122496b0814bb0f'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:48.196554 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-56b7cd28-eb69-420e-ac3b-324e525370a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9819cb239f6346fe8122496b0814bb0f'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:48.204106 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-56b7cd28-eb69-420e-ac3b-324e525370a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9819cb239f6346fe8122496b0814bb0f'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:48.209938 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1421/2831] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:07:47 2022] DELETE /identity/v3/users/9819cb239f6346fe8122496b0814bb0f => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:07:48.697269 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a58987-25d0-45ec-bc20-aae581fa20a5 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:48.698754 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e6a58987-25d0-45ec-bc20-aae581fa20a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:48.712753 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a58987-25d0-45ec-bc20-aae581fa20a5 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:48.774653 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9bbfb-99cb-4e3d-8048-7750e3eb1640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:48.775285 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9bbfb-99cb-4e3d-8048-7750e3eb1640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:48.775581 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9bbfb-99cb-4e3d-8048-7750e3eb1640 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:48.775858 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9bbfb-99cb-4e3d-8048-7750e3eb1640 admin admin] PATH_INFO: `/v3/projects/d495b54d669a4ed295187de72f263795` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:48.776974 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9bbfb-99cb-4e3d-8048-7750e3eb1640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d495b54d669a4ed295187de72f263795)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:48.779914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9bbfb-99cb-4e3d-8048-7750e3eb1640 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:48.868361 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:07:48.885746 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-47e9bbfb-99cb-4e3d-8048-7750e3eb1640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd495b54d669a4ed295187de72f263795', 'request_id': 'req-47e9bbfb-99cb-4e3d-8048-7750e3eb1640'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:48.986129 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-47e9bbfb-99cb-4e3d-8048-7750e3eb1640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd495b54d669a4ed295187de72f263795', 'request_id': 'req-47e9bbfb-99cb-4e3d-8048-7750e3eb1640'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:48.991712 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-47e9bbfb-99cb-4e3d-8048-7750e3eb1640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd495b54d669a4ed295187de72f263795', 'request_id': 'req-47e9bbfb-99cb-4e3d-8048-7750e3eb1640'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:49.003051 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-47e9bbfb-99cb-4e3d-8048-7750e3eb1640 admin admin] The token cache is being invalidate because project d495b54d669a4ed295187de72f263795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:07:49.003338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-47e9bbfb-99cb-4e3d-8048-7750e3eb1640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:49.004002 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-47e9bbfb-99cb-4e3d-8048-7750e3eb1640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:49.005488 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1411/2832] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:07:48 2022] DELETE /identity/v3/projects/d495b54d669a4ed295187de72f263795 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:07:49.010475 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c1a11-523a-441b-8cb6-1d062e793518 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:49.010921 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c1a11-523a-441b-8cb6-1d062e793518 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:49.011029 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c1a11-523a-441b-8cb6-1d062e793518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:49.032498 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-ca0c1a11-523a-441b-8cb6-1d062e793518 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:07:49.033708 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ca0c1a11-523a-441b-8cb6-1d062e793518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:49.096290 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1422/2833] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:07:49.104037 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00954cea-a7db-4fe9-a7b5-b1e1abcc918a None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:49.104326 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00954cea-a7db-4fe9-a7b5-b1e1abcc918a None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:49.104603 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00954cea-a7db-4fe9-a7b5-b1e1abcc918a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:49.126126 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-00954cea-a7db-4fe9-a7b5-b1e1abcc918a None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:07:49.127340 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-00954cea-a7db-4fe9-a7b5-b1e1abcc918a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:49.135266 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1412/2834] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:07:49.140381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c1a11-523a-441b-8cb6-1d062e793518 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:49.150079 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c1a11-523a-441b-8cb6-1d062e793518 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:49.154620 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ab535-d3c9-44c1-8807-4851b1f25ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:49.155216 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ab535-d3c9-44c1-8807-4851b1f25ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:49.155490 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ab535-d3c9-44c1-8807-4851b1f25ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:49.155787 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ab535-d3c9-44c1-8807-4851b1f25ec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:49.156423 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ab535-d3c9-44c1-8807-4851b1f25ec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:07:49.156725 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ab535-d3c9-44c1-8807-4851b1f25ec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:49.158311 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ab535-d3c9-44c1-8807-4851b1f25ec7 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:49.170103 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1423/2835] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 20:07:49.174307 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00954cea-a7db-4fe9-a7b5-b1e1abcc918a None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:49.184014 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00954cea-a7db-4fe9-a7b5-b1e1abcc918a None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:49.188832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d027b-a234-494c-94e5-fec3fc971675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:49.189431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d027b-a234-494c-94e5-fec3fc971675 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:49.189711 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d027b-a234-494c-94e5-fec3fc971675 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:49.189983 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d027b-a234-494c-94e5-fec3fc971675 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:49.190624 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d027b-a234-494c-94e5-fec3fc971675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:49.192602 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d027b-a234-494c-94e5-fec3fc971675 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:49.278241 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1413/2836] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:07:49 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:07:49.282316 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ab535-d3c9-44c1-8807-4851b1f25ec7 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:49.292397 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ab535-d3c9-44c1-8807-4851b1f25ec7 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:49.319191 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:07:49.350307 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113eb428-abf6-4006-9a7c-4cc976958af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:49.350928 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113eb428-abf6-4006-9a7c-4cc976958af0 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:49.351208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113eb428-abf6-4006-9a7c-4cc976958af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:49.351483 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113eb428-abf6-4006-9a7c-4cc976958af0 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:49.352157 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113eb428-abf6-4006-9a7c-4cc976958af0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:49.354143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113eb428-abf6-4006-9a7c-4cc976958af0 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:49.438403 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1424/2837] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:07:49 2022] POST /identity/v3/users => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:07:49.442511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d027b-a234-494c-94e5-fec3fc971675 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:49.453976 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d027b-a234-494c-94e5-fec3fc971675 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:49.458694 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe085ef-6a0c-4689-906a-b265426a5a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:49.459298 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe085ef-6a0c-4689-906a-b265426a5a17 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:49.459631 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe085ef-6a0c-4689-906a-b265426a5a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:49.459905 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe085ef-6a0c-4689-906a-b265426a5a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:49.460557 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe085ef-6a0c-4689-906a-b265426a5a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:49.462175 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe085ef-6a0c-4689-906a-b265426a5a17 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:49.473004 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1414/2838] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:07:49.477062 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113eb428-abf6-4006-9a7c-4cc976958af0 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:49.487665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113eb428-abf6-4006-9a7c-4cc976958af0 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:49.492473 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c9ce6-da7b-4f14-855a-ab6d97c545ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:49.493063 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c9ce6-da7b-4f14-855a-ab6d97c545ad admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:49.493338 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c9ce6-da7b-4f14-855a-ab6d97c545ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:49.493607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c9ce6-da7b-4f14-855a-ab6d97c545ad admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:49.494237 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c9ce6-da7b-4f14-855a-ab6d97c545ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:49.495855 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c9ce6-da7b-4f14-855a-ab6d97c545ad admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:49.508741 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1425/2839] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:07:49.513019 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe085ef-6a0c-4689-906a-b265426a5a17 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:49.523161 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe085ef-6a0c-4689-906a-b265426a5a17 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:49.527840 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca4338-d070-4e6a-be67-218e93544dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:49.528529 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca4338-d070-4e6a-be67-218e93544dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:49.528756 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca4338-d070-4e6a-be67-218e93544dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:49.529031 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca4338-d070-4e6a-be67-218e93544dbb admin admin] PATH_INFO: `/v3/projects/c35e99b5908d4eafa58a404e1b564346/users/2b3f7eb9a4c34475941e6cf1cb05b0d5/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:49.543747 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca4338-d070-4e6a-be67-218e93544dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c35e99b5908d4eafa58a404e1b564346, user_id=2b3f7eb9a4c34475941e6cf1cb05b0d5, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:49.546421 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca4338-d070-4e6a-be67-218e93544dbb admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:49.667232 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1415/2840] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:07:49 2022] PUT /identity/v3/projects/c35e99b5908d4eafa58a404e1b564346/users/2b3f7eb9a4c34475941e6cf1cb05b0d5/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:07:49.679393 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e6e87-8b08-47bc-938c-a5a43fd8f23c None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:49.679725 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e6e87-8b08-47bc-938c-a5a43fd8f23c None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:49.680030 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e6e87-8b08-47bc-938c-a5a43fd8f23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:49.708233 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-5c7e6e87-8b08-47bc-938c-a5a43fd8f23c None None] MFA Rules not processed for user `2b3f7eb9a4c34475941e6cf1cb05b0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:07:49.709459 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-5c7e6e87-8b08-47bc-938c-a5a43fd8f23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:49.774347 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1426/2841] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:07:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:07:49.779315 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca4338-d070-4e6a-be67-218e93544dbb admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:49.840780 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca4338-d070-4e6a-be67-218e93544dbb admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:49.845382 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e967bd-1a58-48cd-9dcb-bc78ebc614a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:49.845975 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e967bd-1a58-48cd-9dcb-bc78ebc614a5 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:49.846248 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e967bd-1a58-48cd-9dcb-bc78ebc614a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:49.846511 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e967bd-1a58-48cd-9dcb-bc78ebc614a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:49.847124 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e967bd-1a58-48cd-9dcb-bc78ebc614a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:49.849033 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e967bd-1a58-48cd-9dcb-bc78ebc614a5 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:49.929464 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1416/2842] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:07:49 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:07:49.933596 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e6e87-8b08-47bc-938c-a5a43fd8f23c None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:49.950320 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e6e87-8b08-47bc-938c-a5a43fd8f23c None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:50.007690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2f33d-723f-4778-a730-8db0a199c1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:50.008305 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2f33d-723f-4778-a730-8db0a199c1ce admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:50.008616 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2f33d-723f-4778-a730-8db0a199c1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:50.008892 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2f33d-723f-4778-a730-8db0a199c1ce admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:50.009518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2f33d-723f-4778-a730-8db0a199c1ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:50.011432 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2f33d-723f-4778-a730-8db0a199c1ce admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:50.079156 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1427/2843] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:07:49 2022] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:07:50.083044 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e967bd-1a58-48cd-9dcb-bc78ebc614a5 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:50.094276 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e967bd-1a58-48cd-9dcb-bc78ebc614a5 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:50.098907 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f9ebb-b9c2-49b2-a39b-c0ddf0e6790b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:50.099504 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f9ebb-b9c2-49b2-a39b-c0ddf0e6790b admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:50.099847 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f9ebb-b9c2-49b2-a39b-c0ddf0e6790b admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:50.100128 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f9ebb-b9c2-49b2-a39b-c0ddf0e6790b admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:50.100769 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f9ebb-b9c2-49b2-a39b-c0ddf0e6790b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:50.102368 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f9ebb-b9c2-49b2-a39b-c0ddf0e6790b admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:50.113946 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1417/2844] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:07:50.117929 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2f33d-723f-4778-a730-8db0a199c1ce admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:50.128038 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2f33d-723f-4778-a730-8db0a199c1ce admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:50.132614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b8f09-6f40-4338-9c3d-367d85167368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:50.133267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b8f09-6f40-4338-9c3d-367d85167368 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:50.133545 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b8f09-6f40-4338-9c3d-367d85167368 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:50.133813 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b8f09-6f40-4338-9c3d-367d85167368 admin admin] PATH_INFO: `/v3/projects/564c224a64034f068ebd0320cfc6970c/users/040ceb9c7dd444adad4b406bd8f2aa99/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:50.148270 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b8f09-6f40-4338-9c3d-367d85167368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=564c224a64034f068ebd0320cfc6970c, user_id=040ceb9c7dd444adad4b406bd8f2aa99, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:50.150946 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b8f09-6f40-4338-9c3d-367d85167368 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:50.204359 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1428/2845] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:07:50 2022] PUT /identity/v3/projects/564c224a64034f068ebd0320cfc6970c/users/040ceb9c7dd444adad4b406bd8f2aa99/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:07:50.212981 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f9ebb-b9c2-49b2-a39b-c0ddf0e6790b admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:50.223800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f9ebb-b9c2-49b2-a39b-c0ddf0e6790b admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:50.243738 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:07:50.281518 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ccc3b-e6f4-4ece-b815-1bb20109f54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:50.282122 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ccc3b-e6f4-4ece-b815-1bb20109f54b admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:50.282399 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ccc3b-e6f4-4ece-b815-1bb20109f54b admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:50.282673 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ccc3b-e6f4-4ece-b815-1bb20109f54b admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:50.283363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ccc3b-e6f4-4ece-b815-1bb20109f54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:50.284992 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ccc3b-e6f4-4ece-b815-1bb20109f54b admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:50.294763 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1418/2846] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:07:50.298943 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b8f09-6f40-4338-9c3d-367d85167368 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:50.304578 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:07:50.310156 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b8f09-6f40-4338-9c3d-367d85167368 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:50.314838 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6de8a-f12d-49cb-b71b-7fcf002310e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:50.315495 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6de8a-f12d-49cb-b71b-7fcf002310e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:50.315817 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6de8a-f12d-49cb-b71b-7fcf002310e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:50.316095 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6de8a-f12d-49cb-b71b-7fcf002310e4 admin admin] PATH_INFO: `/v3/projects/564c224a64034f068ebd0320cfc6970c/users/040ceb9c7dd444adad4b406bd8f2aa99/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:50.318085 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6de8a-f12d-49cb-b71b-7fcf002310e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=564c224a64034f068ebd0320cfc6970c, user_id=040ceb9c7dd444adad4b406bd8f2aa99, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:50.320875 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6de8a-f12d-49cb-b71b-7fcf002310e4 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:50.334297 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1429/2847] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:07:50 2022] PUT /identity/v3/projects/564c224a64034f068ebd0320cfc6970c/users/040ceb9c7dd444adad4b406bd8f2aa99/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:07:50.346028 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916ca62-b34c-4802-a14c-0123718e7b87 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:50.346310 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916ca62-b34c-4802-a14c-0123718e7b87 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:50.346583 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916ca62-b34c-4802-a14c-0123718e7b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:50.374714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-4916ca62-b34c-4802-a14c-0123718e7b87 None None] MFA Rules not processed for user `040ceb9c7dd444adad4b406bd8f2aa99`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:07:50.375989 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-4916ca62-b34c-4802-a14c-0123718e7b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:50.444064 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1419/2848] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:07:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:07:50.455755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6de8a-f12d-49cb-b71b-7fcf002310e4 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:50.457525 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-cbb6de8a-f12d-49cb-b71b-7fcf002310e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:50.514858 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6de8a-f12d-49cb-b71b-7fcf002310e4 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:50.518554 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceff058-9516-4a7a-9aae-fe98120f983d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:50.519161 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceff058-9516-4a7a-9aae-fe98120f983d service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:50.519445 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceff058-9516-4a7a-9aae-fe98120f983d service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:50.519748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceff058-9516-4a7a-9aae-fe98120f983d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:50.575728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceff058-9516-4a7a-9aae-fe98120f983d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:50.577181 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceff058-9516-4a7a-9aae-fe98120f983d service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:50.586249 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1430/2849] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:07:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:07:52.244196 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916ca62-b34c-4802-a14c-0123718e7b87 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:52.245599 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-4916ca62-b34c-4802-a14c-0123718e7b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:52.257496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916ca62-b34c-4802-a14c-0123718e7b87 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:52.261062 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb27d86-de66-4830-9f97-211138fc0fdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:52.261656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb27d86-de66-4830-9f97-211138fc0fdf service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:52.262014 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb27d86-de66-4830-9f97-211138fc0fdf service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:52.262356 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb27d86-de66-4830-9f97-211138fc0fdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:52.270970 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb27d86-de66-4830-9f97-211138fc0fdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:52.272431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb27d86-de66-4830-9f97-211138fc0fdf service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:52.282352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1420/2850] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:07:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:07:56.860035 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceff058-9516-4a7a-9aae-fe98120f983d service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:56.922596 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceff058-9516-4a7a-9aae-fe98120f983d service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:56.927077 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848c512-3689-4a9b-ab7f-b9c7718e6f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:56.927707 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848c512-3689-4a9b-ab7f-b9c7718e6f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:56.927985 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848c512-3689-4a9b-ab7f-b9c7718e6f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:56.928254 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848c512-3689-4a9b-ab7f-b9c7718e6f64 admin admin] PATH_INFO: `/v3/users/2b3f7eb9a4c34475941e6cf1cb05b0d5` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:56.929367 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848c512-3689-4a9b-ab7f-b9c7718e6f64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3f7eb9a4c34475941e6cf1cb05b0d5)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:56.931271 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848c512-3689-4a9b-ab7f-b9c7718e6f64 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:57.157252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:07:57.159287 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a848c512-3689-4a9b-ab7f-b9c7718e6f64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3f7eb9a4c34475941e6cf1cb05b0d5'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:57.227998 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a848c512-3689-4a9b-ab7f-b9c7718e6f64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3f7eb9a4c34475941e6cf1cb05b0d5'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:57.228718 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a848c512-3689-4a9b-ab7f-b9c7718e6f64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3f7eb9a4c34475941e6cf1cb05b0d5'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:57.242325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a848c512-3689-4a9b-ab7f-b9c7718e6f64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3f7eb9a4c34475941e6cf1cb05b0d5'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:57.250017 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-a848c512-3689-4a9b-ab7f-b9c7718e6f64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3f7eb9a4c34475941e6cf1cb05b0d5'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:57.256075 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1431/2851] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:07:56 2022] DELETE /identity/v3/users/2b3f7eb9a4c34475941e6cf1cb05b0d5 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:07:57.260647 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084deca7-ce2b-4d76-ae83-e72989a22654 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:57.261140 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084deca7-ce2b-4d76-ae83-e72989a22654 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:57.261243 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084deca7-ce2b-4d76-ae83-e72989a22654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:57.280668 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-084deca7-ce2b-4d76-ae83-e72989a22654 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:07:57.281859 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-084deca7-ce2b-4d76-ae83-e72989a22654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:57.340475 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1421/2852] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:07:57.350199 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848c512-3689-4a9b-ab7f-b9c7718e6f64 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:57.351666 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a848c512-3689-4a9b-ab7f-b9c7718e6f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:57.411598 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848c512-3689-4a9b-ab7f-b9c7718e6f64 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:57.415047 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82940649-c6b4-41f9-a39a-8217e4ecfc80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:57.415684 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82940649-c6b4-41f9-a39a-8217e4ecfc80 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:57.415962 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82940649-c6b4-41f9-a39a-8217e4ecfc80 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:57.416233 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82940649-c6b4-41f9-a39a-8217e4ecfc80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:57.425565 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82940649-c6b4-41f9-a39a-8217e4ecfc80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:57.426972 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82940649-c6b4-41f9-a39a-8217e4ecfc80 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:57.436410 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1432/2853] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:07:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:07:57.857294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084deca7-ce2b-4d76-ae83-e72989a22654 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:57.860175 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-084deca7-ce2b-4d76-ae83-e72989a22654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:57.879195 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084deca7-ce2b-4d76-ae83-e72989a22654 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:57.884333 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f2a5d-5cd8-4db6-a6e0-786fa5f7cc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:57.889051 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f2a5d-5cd8-4db6-a6e0-786fa5f7cc84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:57.889051 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f2a5d-5cd8-4db6-a6e0-786fa5f7cc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:57.889051 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f2a5d-5cd8-4db6-a6e0-786fa5f7cc84 admin admin] PATH_INFO: `/v3/projects/c35e99b5908d4eafa58a404e1b564346` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:57.889051 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f2a5d-5cd8-4db6-a6e0-786fa5f7cc84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c35e99b5908d4eafa58a404e1b564346)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:57.889051 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f2a5d-5cd8-4db6-a6e0-786fa5f7cc84 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:57.973214 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:07:57.988007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-456f2a5d-5cd8-4db6-a6e0-786fa5f7cc84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c35e99b5908d4eafa58a404e1b564346', 'request_id': 'req-456f2a5d-5cd8-4db6-a6e0-786fa5f7cc84'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:58.084072 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-456f2a5d-5cd8-4db6-a6e0-786fa5f7cc84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c35e99b5908d4eafa58a404e1b564346', 'request_id': 'req-456f2a5d-5cd8-4db6-a6e0-786fa5f7cc84'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:58.090321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-456f2a5d-5cd8-4db6-a6e0-786fa5f7cc84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c35e99b5908d4eafa58a404e1b564346', 'request_id': 'req-456f2a5d-5cd8-4db6-a6e0-786fa5f7cc84'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:58.102312 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-456f2a5d-5cd8-4db6-a6e0-786fa5f7cc84 admin admin] The token cache is being invalidate because project c35e99b5908d4eafa58a404e1b564346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:07:58.102605 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-456f2a5d-5cd8-4db6-a6e0-786fa5f7cc84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:58.103247 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-456f2a5d-5cd8-4db6-a6e0-786fa5f7cc84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:58.104821 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1422/2854] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:07:57 2022] DELETE /identity/v3/projects/c35e99b5908d4eafa58a404e1b564346 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:07:58.108739 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82940649-c6b4-41f9-a39a-8217e4ecfc80 service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:58.119049 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82940649-c6b4-41f9-a39a-8217e4ecfc80 service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:58.177401 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd55aba-daf7-4c16-a85d-2c0e8a20fa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:58.178208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd55aba-daf7-4c16-a85d-2c0e8a20fa3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:58.178457 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd55aba-daf7-4c16-a85d-2c0e8a20fa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:58.178715 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd55aba-daf7-4c16-a85d-2c0e8a20fa3d admin admin] PATH_INFO: `/v3/users/040ceb9c7dd444adad4b406bd8f2aa99` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:58.179885 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd55aba-daf7-4c16-a85d-2c0e8a20fa3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=040ceb9c7dd444adad4b406bd8f2aa99)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:58.181800 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd55aba-daf7-4c16-a85d-2c0e8a20fa3d admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:58.336614 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-0cd55aba-daf7-4c16-a85d-2c0e8a20fa3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '040ceb9c7dd444adad4b406bd8f2aa99'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:58.402758 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-0cd55aba-daf7-4c16-a85d-2c0e8a20fa3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '040ceb9c7dd444adad4b406bd8f2aa99'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:58.403387 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-0cd55aba-daf7-4c16-a85d-2c0e8a20fa3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '040ceb9c7dd444adad4b406bd8f2aa99'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:58.415868 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:07:58.418234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-0cd55aba-daf7-4c16-a85d-2c0e8a20fa3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '040ceb9c7dd444adad4b406bd8f2aa99'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:58.425073 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-0cd55aba-daf7-4c16-a85d-2c0e8a20fa3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '040ceb9c7dd444adad4b406bd8f2aa99'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:58.430981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1433/2855] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:07:58 2022] DELETE /identity/v3/users/040ceb9c7dd444adad4b406bd8f2aa99 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:07:58.893512 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f2a5d-5cd8-4db6-a6e0-786fa5f7cc84 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:58.894370 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-456f2a5d-5cd8-4db6-a6e0-786fa5f7cc84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:58.908443 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f2a5d-5cd8-4db6-a6e0-786fa5f7cc84 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:58.966799 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84b73a-3a45-491c-aa8f-b89a0b4f716a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:58.967362 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84b73a-3a45-491c-aa8f-b89a0b4f716a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:58.967674 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84b73a-3a45-491c-aa8f-b89a0b4f716a admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:58.967992 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84b73a-3a45-491c-aa8f-b89a0b4f716a admin admin] PATH_INFO: `/v3/projects/564c224a64034f068ebd0320cfc6970c` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:58.969302 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84b73a-3a45-491c-aa8f-b89a0b4f716a admin admin] RBAC: Authorizing `identity:delete_project(project_id=564c224a64034f068ebd0320cfc6970c)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:58.971337 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84b73a-3a45-491c-aa8f-b89a0b4f716a admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:59.084661 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8d84b73a-3a45-491c-aa8f-b89a0b4f716a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '564c224a64034f068ebd0320cfc6970c', 'request_id': 'req-8d84b73a-3a45-491c-aa8f-b89a0b4f716a'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:59.163825 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8d84b73a-3a45-491c-aa8f-b89a0b4f716a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '564c224a64034f068ebd0320cfc6970c', 'request_id': 'req-8d84b73a-3a45-491c-aa8f-b89a0b4f716a'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:59.169601 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8d84b73a-3a45-491c-aa8f-b89a0b4f716a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '564c224a64034f068ebd0320cfc6970c', 'request_id': 'req-8d84b73a-3a45-491c-aa8f-b89a0b4f716a'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:59.183165 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8d84b73a-3a45-491c-aa8f-b89a0b4f716a admin admin] The token cache is being invalidate because project 564c224a64034f068ebd0320cfc6970c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:07:59.183453 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8d84b73a-3a45-491c-aa8f-b89a0b4f716a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:59.184116 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-8d84b73a-3a45-491c-aa8f-b89a0b4f716a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:07:59.185570 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1423/2856] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:07:58 2022] DELETE /identity/v3/projects/564c224a64034f068ebd0320cfc6970c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:07:59.191193 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3f3c1-a5d2-457a-a4a6-5751548fc1c4 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:59.191705 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3f3c1-a5d2-457a-a4a6-5751548fc1c4 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:59.191815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3f3c1-a5d2-457a-a4a6-5751548fc1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:59.210870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-c5f3f3c1-a5d2-457a-a4a6-5751548fc1c4 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:07:59.212088 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c5f3f3c1-a5d2-457a-a4a6-5751548fc1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:59.273234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1434/2857] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:07:59.337265 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390e3b3-b3ae-4986-aa79-89e0af08d997 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:59.337546 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390e3b3-b3ae-4986-aa79-89e0af08d997 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:59.337819 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390e3b3-b3ae-4986-aa79-89e0af08d997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:59.358056 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-e390e3b3-b3ae-4986-aa79-89e0af08d997 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:07:59.360300 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e390e3b3-b3ae-4986-aa79-89e0af08d997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:59.368715 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1424/2858] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:07:59.373183 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3f3c1-a5d2-457a-a4a6-5751548fc1c4 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:59.383395 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3f3c1-a5d2-457a-a4a6-5751548fc1c4 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:59.387978 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876e6c4-7ddc-4401-8e4c-4402729c5f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:59.388577 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876e6c4-7ddc-4401-8e4c-4402729c5f6e admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:59.388855 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876e6c4-7ddc-4401-8e4c-4402729c5f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:59.389121 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876e6c4-7ddc-4401-8e4c-4402729c5f6e admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:59.389755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876e6c4-7ddc-4401-8e4c-4402729c5f6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:07:59.390078 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876e6c4-7ddc-4401-8e4c-4402729c5f6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:59.391728 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876e6c4-7ddc-4401-8e4c-4402729c5f6e admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:59.403072 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1435/2859] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 20:07:59.407453 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390e3b3-b3ae-4986-aa79-89e0af08d997 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:59.416368 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390e3b3-b3ae-4986-aa79-89e0af08d997 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:59.420919 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414add14-ba8c-4e00-a182-87c1615a9769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:59.422009 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414add14-ba8c-4e00-a182-87c1615a9769 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:59.422283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414add14-ba8c-4e00-a182-87c1615a9769 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:59.422542 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414add14-ba8c-4e00-a182-87c1615a9769 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:59.423169 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414add14-ba8c-4e00-a182-87c1615a9769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:59.425097 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414add14-ba8c-4e00-a182-87c1615a9769 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:59.512707 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1425/2860] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:07:59 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:07:59.517142 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876e6c4-7ddc-4401-8e4c-4402729c5f6e admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:59.536294 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876e6c4-7ddc-4401-8e4c-4402729c5f6e admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:59.590940 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7d055-7895-4b90-9842-5f0ca719680a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:59.591572 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7d055-7895-4b90-9842-5f0ca719680a admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:59.592000 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7d055-7895-4b90-9842-5f0ca719680a admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:59.592279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7d055-7895-4b90-9842-5f0ca719680a admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:59.592895 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7d055-7895-4b90-9842-5f0ca719680a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:59.595507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7d055-7895-4b90-9842-5f0ca719680a admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:59.673295 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1436/2861] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:07:59 2022] POST /identity/v3/users => generated 283 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 20:07:59.677506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414add14-ba8c-4e00-a182-87c1615a9769 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:59.687973 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414add14-ba8c-4e00-a182-87c1615a9769 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:59.692633 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a85e7c-c830-42c9-820b-ce8e26f2b7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:59.693227 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a85e7c-c830-42c9-820b-ce8e26f2b7fe admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:59.693506 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a85e7c-c830-42c9-820b-ce8e26f2b7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:59.693777 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a85e7c-c830-42c9-820b-ce8e26f2b7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:59.694413 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a85e7c-c830-42c9-820b-ce8e26f2b7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:59.696034 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a85e7c-c830-42c9-820b-ce8e26f2b7fe admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:59.705911 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1426/2862] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:07:59.709720 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7d055-7895-4b90-9842-5f0ca719680a admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:59.720314 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7d055-7895-4b90-9842-5f0ca719680a admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:59.725034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561ae65-6126-48f8-8889-ed9f63d4a6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:59.725631 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561ae65-6126-48f8-8889-ed9f63d4a6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:59.725912 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561ae65-6126-48f8-8889-ed9f63d4a6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:59.726187 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561ae65-6126-48f8-8889-ed9f63d4a6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:59.726824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561ae65-6126-48f8-8889-ed9f63d4a6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:59.728433 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561ae65-6126-48f8-8889-ed9f63d4a6a5 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:59.740010 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1437/2863] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 20:07:59.744109 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a85e7c-c830-42c9-820b-ce8e26f2b7fe admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:07:59.754063 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a85e7c-c830-42c9-820b-ce8e26f2b7fe admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:07:59.758739 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16b70f-dc59-49b1-a792-826bcda5e36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:07:59.759392 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16b70f-dc59-49b1-a792-826bcda5e36f admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:59.759711 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16b70f-dc59-49b1-a792-826bcda5e36f admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:59.759982 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16b70f-dc59-49b1-a792-826bcda5e36f admin admin] PATH_INFO: `/v3/projects/26b6f767551a495d9a2926df12846c9e/users/f1486ed1aa4641898e9bb7805241f85e/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:59.762352 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:07:59.775357 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16b70f-dc59-49b1-a792-826bcda5e36f admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b6f767551a495d9a2926df12846c9e, user_id=f1486ed1aa4641898e9bb7805241f85e, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:07:59.778052 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16b70f-dc59-49b1-a792-826bcda5e36f admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:07:59.861776 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1427/2864] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:07:59 2022] PUT /identity/v3/projects/26b6f767551a495d9a2926df12846c9e/users/f1486ed1aa4641898e9bb7805241f85e/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:07:59.872137 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1711f6-c603-4664-9cce-7252768eeff8 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:07:59.872422 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1711f6-c603-4664-9cce-7252768eeff8 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:07:59.872696 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1711f6-c603-4664-9cce-7252768eeff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:07:59.901139 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-de1711f6-c603-4664-9cce-7252768eeff8 None None] MFA Rules not processed for user `f1486ed1aa4641898e9bb7805241f85e`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:07:59.902363 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-de1711f6-c603-4664-9cce-7252768eeff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:07:59.943125 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:07:59.971979 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1438/2865] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:07:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:07:59.976689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16b70f-dc59-49b1-a792-826bcda5e36f admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:00.040417 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16b70f-dc59-49b1-a792-826bcda5e36f admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:00.045521 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff7da2-7f90-4945-9b85-69a69c5c71b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:00.046129 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff7da2-7f90-4945-9b85-69a69c5c71b4 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:00.046911 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff7da2-7f90-4945-9b85-69a69c5c71b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:00.047183 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff7da2-7f90-4945-9b85-69a69c5c71b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:00.047864 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff7da2-7f90-4945-9b85-69a69c5c71b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:00.049774 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff7da2-7f90-4945-9b85-69a69c5c71b4 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:00.126489 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1428/2866] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:07:59 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:08:00.130528 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1711f6-c603-4664-9cce-7252768eeff8 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:00.142055 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1711f6-c603-4664-9cce-7252768eeff8 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:00.211014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a25824-a470-4da3-8ff4-00d8fdddcafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:00.211714 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a25824-a470-4da3-8ff4-00d8fdddcafd admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:00.211966 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a25824-a470-4da3-8ff4-00d8fdddcafd admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:00.212238 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a25824-a470-4da3-8ff4-00d8fdddcafd admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:00.212870 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a25824-a470-4da3-8ff4-00d8fdddcafd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:00.214779 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a25824-a470-4da3-8ff4-00d8fdddcafd admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:00.290286 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1439/2867] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:08:00 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:08:00.294258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff7da2-7f90-4945-9b85-69a69c5c71b4 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:00.304622 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff7da2-7f90-4945-9b85-69a69c5c71b4 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:00.309194 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92ad39-28f2-467e-af3a-4bd014e9c2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:00.309791 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92ad39-28f2-467e-af3a-4bd014e9c2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:00.310067 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92ad39-28f2-467e-af3a-4bd014e9c2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:00.310334 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92ad39-28f2-467e-af3a-4bd014e9c2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:00.310972 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92ad39-28f2-467e-af3a-4bd014e9c2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:00.313137 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92ad39-28f2-467e-af3a-4bd014e9c2b2 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:00.323688 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1429/2868] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:08:00.328340 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a25824-a470-4da3-8ff4-00d8fdddcafd admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:00.338680 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a25824-a470-4da3-8ff4-00d8fdddcafd admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:00.344546 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30203963-c386-456d-8fee-cf7d5fdde828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:00.345675 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30203963-c386-456d-8fee-cf7d5fdde828 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:00.346120 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30203963-c386-456d-8fee-cf7d5fdde828 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:00.346554 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30203963-c386-456d-8fee-cf7d5fdde828 admin admin] PATH_INFO: `/v3/projects/64da07aa9f8a49a08ded24f0a4d826c5/users/f1635f1e21784ff8adf90907f861562d/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:00.362603 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30203963-c386-456d-8fee-cf7d5fdde828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64da07aa9f8a49a08ded24f0a4d826c5, user_id=f1635f1e21784ff8adf90907f861562d, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:00.367649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30203963-c386-456d-8fee-cf7d5fdde828 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:00.428079 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1440/2869] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:08:00 2022] PUT /identity/v3/projects/64da07aa9f8a49a08ded24f0a4d826c5/users/f1635f1e21784ff8adf90907f861562d/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:08:00.432073 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92ad39-28f2-467e-af3a-4bd014e9c2b2 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:00.442402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92ad39-28f2-467e-af3a-4bd014e9c2b2 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:00.498797 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f2563-5008-4bbc-abf2-fb1fd47bb6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:00.499407 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f2563-5008-4bbc-abf2-fb1fd47bb6fd admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:00.499750 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f2563-5008-4bbc-abf2-fb1fd47bb6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:00.500060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f2563-5008-4bbc-abf2-fb1fd47bb6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:00.500675 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f2563-5008-4bbc-abf2-fb1fd47bb6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:00.502263 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f2563-5008-4bbc-abf2-fb1fd47bb6fd admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:00.511844 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1430/2870] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:08:00.516107 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30203963-c386-456d-8fee-cf7d5fdde828 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:00.526380 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30203963-c386-456d-8fee-cf7d5fdde828 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:00.531626 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca9390-ace5-4043-b5e9-226b1f2d7ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:00.532401 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca9390-ace5-4043-b5e9-226b1f2d7ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:00.532681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca9390-ace5-4043-b5e9-226b1f2d7ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:00.532980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca9390-ace5-4043-b5e9-226b1f2d7ee9 admin admin] PATH_INFO: `/v3/projects/64da07aa9f8a49a08ded24f0a4d826c5/users/f1635f1e21784ff8adf90907f861562d/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:00.534946 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca9390-ace5-4043-b5e9-226b1f2d7ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64da07aa9f8a49a08ded24f0a4d826c5, user_id=f1635f1e21784ff8adf90907f861562d, role_id=9f53bdb97a1f4ab29cc541d9b2b90e1a)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:00.537644 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca9390-ace5-4043-b5e9-226b1f2d7ee9 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:00.550202 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1441/2871] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:08:00 2022] PUT /identity/v3/projects/64da07aa9f8a49a08ded24f0a4d826c5/users/f1635f1e21784ff8adf90907f861562d/roles/9f53bdb97a1f4ab29cc541d9b2b90e1a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:08:00.560594 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2528d-c1d6-4b53-bfc6-0fb12f1dd820 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:00.560881 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2528d-c1d6-4b53-bfc6-0fb12f1dd820 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:00.561157 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2528d-c1d6-4b53-bfc6-0fb12f1dd820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:00.588933 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-33f2528d-c1d6-4b53-bfc6-0fb12f1dd820 None None] MFA Rules not processed for user `f1635f1e21784ff8adf90907f861562d`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:08:00.590130 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-33f2528d-c1d6-4b53-bfc6-0fb12f1dd820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:00.632433 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:08:00.659696 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1431/2872] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:08:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:08:00.670641 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca9390-ace5-4043-b5e9-226b1f2d7ee9 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:00.673130 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-beca9390-ace5-4043-b5e9-226b1f2d7ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:00.730593 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca9390-ace5-4043-b5e9-226b1f2d7ee9 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:00.734679 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cadcb6-8b52-4244-95ac-976030b42269 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:00.735373 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cadcb6-8b52-4244-95ac-976030b42269 service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:00.735681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cadcb6-8b52-4244-95ac-976030b42269 service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:00.735952 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cadcb6-8b52-4244-95ac-976030b42269 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:00.745007 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cadcb6-8b52-4244-95ac-976030b42269 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:00.746416 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cadcb6-8b52-4244-95ac-976030b42269 service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:00.756325 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1442/2873] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:08:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:08:00.991260 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2528d-c1d6-4b53-bfc6-0fb12f1dd820 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:01.001465 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2528d-c1d6-4b53-bfc6-0fb12f1dd820 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:01.005055 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca9549-7571-4f05-80ba-a7d2b40cab21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:01.005658 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca9549-7571-4f05-80ba-a7d2b40cab21 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:01.005941 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca9549-7571-4f05-80ba-a7d2b40cab21 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:01.006214 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca9549-7571-4f05-80ba-a7d2b40cab21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:01.063860 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca9549-7571-4f05-80ba-a7d2b40cab21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:01.065402 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca9549-7571-4f05-80ba-a7d2b40cab21 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:01.074357 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1432/2874] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:08:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:08:07.407805 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cadcb6-8b52-4244-95ac-976030b42269 service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:07.445975 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:08:07.468805 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cadcb6-8b52-4244-95ac-976030b42269 service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:07.474140 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c88514-c0a7-4c95-a12a-1b9308a76678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:07.474759 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c88514-c0a7-4c95-a12a-1b9308a76678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:07.475036 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c88514-c0a7-4c95-a12a-1b9308a76678 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:07.475307 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c88514-c0a7-4c95-a12a-1b9308a76678 admin admin] PATH_INFO: `/v3/users/f1486ed1aa4641898e9bb7805241f85e` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:07.476462 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c88514-c0a7-4c95-a12a-1b9308a76678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1486ed1aa4641898e9bb7805241f85e)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:07.478381 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c88514-c0a7-4c95-a12a-1b9308a76678 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:07.670421 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-53c88514-c0a7-4c95-a12a-1b9308a76678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1486ed1aa4641898e9bb7805241f85e'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:07.745011 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-53c88514-c0a7-4c95-a12a-1b9308a76678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1486ed1aa4641898e9bb7805241f85e'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:07.745660 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-53c88514-c0a7-4c95-a12a-1b9308a76678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1486ed1aa4641898e9bb7805241f85e'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:07.758509 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-53c88514-c0a7-4c95-a12a-1b9308a76678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1486ed1aa4641898e9bb7805241f85e'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:07.765377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-53c88514-c0a7-4c95-a12a-1b9308a76678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1486ed1aa4641898e9bb7805241f85e'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:07.771821 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1443/2875] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:08:07 2022] DELETE /identity/v3/users/f1486ed1aa4641898e9bb7805241f85e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:08:07.776414 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c53ec-5fb7-40c4-90e3-6591186f1131 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:07.776932 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c53ec-5fb7-40c4-90e3-6591186f1131 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:07.777043 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c53ec-5fb7-40c4-90e3-6591186f1131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:07.795756 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-3b3c53ec-5fb7-40c4-90e3-6591186f1131 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:08:07.796954 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3b3c53ec-5fb7-40c4-90e3-6591186f1131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:07.855119 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1433/2876] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:08:07.865081 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c88514-c0a7-4c95-a12a-1b9308a76678 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:07.866507 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-53c88514-c0a7-4c95-a12a-1b9308a76678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:07.926004 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c88514-c0a7-4c95-a12a-1b9308a76678 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:07.929606 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a346dc-81e4-49a1-aea3-e9784f268c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:07.930214 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a346dc-81e4-49a1-aea3-e9784f268c29 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:07.930495 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a346dc-81e4-49a1-aea3-e9784f268c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:07.930768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a346dc-81e4-49a1-aea3-e9784f268c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:07.940267 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a346dc-81e4-49a1-aea3-e9784f268c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:07.941860 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a346dc-81e4-49a1-aea3-e9784f268c29 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:07.951511 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1444/2877] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:08:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:08:08.324902 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c53ec-5fb7-40c4-90e3-6591186f1131 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:08.326416 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-3b3c53ec-5fb7-40c4-90e3-6591186f1131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:08.339406 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c53ec-5fb7-40c4-90e3-6591186f1131 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:08.344145 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ae146-0c6d-4560-b013-9852ab74316e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:08.344785 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ae146-0c6d-4560-b013-9852ab74316e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:08.345179 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ae146-0c6d-4560-b013-9852ab74316e admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:08.345312 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ae146-0c6d-4560-b013-9852ab74316e admin admin] PATH_INFO: `/v3/projects/26b6f767551a495d9a2926df12846c9e` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:08.346553 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ae146-0c6d-4560-b013-9852ab74316e admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b6f767551a495d9a2926df12846c9e)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:08.348508 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ae146-0c6d-4560-b013-9852ab74316e admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:08.460321 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-691ae146-0c6d-4560-b013-9852ab74316e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b6f767551a495d9a2926df12846c9e', 'request_id': 'req-691ae146-0c6d-4560-b013-9852ab74316e'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:08.539577 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-691ae146-0c6d-4560-b013-9852ab74316e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b6f767551a495d9a2926df12846c9e', 'request_id': 'req-691ae146-0c6d-4560-b013-9852ab74316e'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:08.545392 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-691ae146-0c6d-4560-b013-9852ab74316e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b6f767551a495d9a2926df12846c9e', 'request_id': 'req-691ae146-0c6d-4560-b013-9852ab74316e'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:08.554331 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:08:08.559305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-691ae146-0c6d-4560-b013-9852ab74316e admin admin] The token cache is being invalidate because project 26b6f767551a495d9a2926df12846c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:08:08.559305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-691ae146-0c6d-4560-b013-9852ab74316e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:08.559305 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-691ae146-0c6d-4560-b013-9852ab74316e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:08.560582 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1434/2878] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:08:08 2022] DELETE /identity/v3/projects/26b6f767551a495d9a2926df12846c9e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:08:08.564650 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a346dc-81e4-49a1-aea3-e9784f268c29 service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:08.574474 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a346dc-81e4-49a1-aea3-e9784f268c29 service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:08.625446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:08:08.631279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b7d22-642e-476f-a664-45148894aa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:08.631941 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b7d22-642e-476f-a664-45148894aa09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:08.632217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b7d22-642e-476f-a664-45148894aa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:08.632487 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b7d22-642e-476f-a664-45148894aa09 admin admin] PATH_INFO: `/v3/users/f1635f1e21784ff8adf90907f861562d` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:08.633611 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b7d22-642e-476f-a664-45148894aa09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1635f1e21784ff8adf90907f861562d)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:08.635523 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b7d22-642e-476f-a664-45148894aa09 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:08.805045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-828b7d22-642e-476f-a664-45148894aa09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1635f1e21784ff8adf90907f861562d'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:08.871079 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-828b7d22-642e-476f-a664-45148894aa09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1635f1e21784ff8adf90907f861562d'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:08.871729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-828b7d22-642e-476f-a664-45148894aa09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1635f1e21784ff8adf90907f861562d'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:08.884308 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-828b7d22-642e-476f-a664-45148894aa09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1635f1e21784ff8adf90907f861562d'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:08.891317 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-828b7d22-642e-476f-a664-45148894aa09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1635f1e21784ff8adf90907f861562d'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:08.898252 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1445/2879] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:08:08 2022] DELETE /identity/v3/users/f1635f1e21784ff8adf90907f861562d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:08:09.331913 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ae146-0c6d-4560-b013-9852ab74316e admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:09.333446 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-691ae146-0c6d-4560-b013-9852ab74316e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:09.347660 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ae146-0c6d-4560-b013-9852ab74316e admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:09.407702 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190c947-135d-4c9e-824b-68c9bf45eea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:09.408338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190c947-135d-4c9e-824b-68c9bf45eea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:09.408614 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190c947-135d-4c9e-824b-68c9bf45eea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:09.409387 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190c947-135d-4c9e-824b-68c9bf45eea2 admin admin] PATH_INFO: `/v3/projects/64da07aa9f8a49a08ded24f0a4d826c5` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:09.410542 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190c947-135d-4c9e-824b-68c9bf45eea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64da07aa9f8a49a08ded24f0a4d826c5)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:09.412479 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190c947-135d-4c9e-824b-68c9bf45eea2 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:09.530395 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d190c947-135d-4c9e-824b-68c9bf45eea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64da07aa9f8a49a08ded24f0a4d826c5', 'request_id': 'req-d190c947-135d-4c9e-824b-68c9bf45eea2'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:09.592955 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d190c947-135d-4c9e-824b-68c9bf45eea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64da07aa9f8a49a08ded24f0a4d826c5', 'request_id': 'req-d190c947-135d-4c9e-824b-68c9bf45eea2'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:09.599529 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d190c947-135d-4c9e-824b-68c9bf45eea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64da07aa9f8a49a08ded24f0a4d826c5', 'request_id': 'req-d190c947-135d-4c9e-824b-68c9bf45eea2'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:09.611301 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d190c947-135d-4c9e-824b-68c9bf45eea2 admin admin] The token cache is being invalidate because project 64da07aa9f8a49a08ded24f0a4d826c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:08:09.611616 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d190c947-135d-4c9e-824b-68c9bf45eea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:09.612244 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-d190c947-135d-4c9e-824b-68c9bf45eea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:09.613706 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1435/2880] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:08:09 2022] DELETE /identity/v3/projects/64da07aa9f8a49a08ded24f0a4d826c5 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:08:09.618963 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f44fe4-aba9-4660-ba84-3af42d4c2921 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:09.619453 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f44fe4-aba9-4660-ba84-3af42d4c2921 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:09.619590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f44fe4-aba9-4660-ba84-3af42d4c2921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:09.639047 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-c7f44fe4-aba9-4660-ba84-3af42d4c2921 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:08:09.640291 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-c7f44fe4-aba9-4660-ba84-3af42d4c2921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:09.698135 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1446/2881] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:08:09.706342 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e171ef-2f5c-4628-907a-ca212386bb65 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:09.707167 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e171ef-2f5c-4628-907a-ca212386bb65 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:09.707449 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e171ef-2f5c-4628-907a-ca212386bb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:09.728047 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-39e171ef-2f5c-4628-907a-ca212386bb65 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:08:09.729236 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-39e171ef-2f5c-4628-907a-ca212386bb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:09.737001 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1436/2882] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:08:09.741496 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f44fe4-aba9-4660-ba84-3af42d4c2921 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:09.751268 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f44fe4-aba9-4660-ba84-3af42d4c2921 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:09.755818 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b909a-bb6e-4eed-95e8-0c7562dbd2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:09.756412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b909a-bb6e-4eed-95e8-0c7562dbd2ed admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:09.756690 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b909a-bb6e-4eed-95e8-0c7562dbd2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:09.756962 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b909a-bb6e-4eed-95e8-0c7562dbd2ed admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:09.757599 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b909a-bb6e-4eed-95e8-0c7562dbd2ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:08:09.757903 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b909a-bb6e-4eed-95e8-0c7562dbd2ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:09.759495 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b909a-bb6e-4eed-95e8-0c7562dbd2ed admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:09.771365 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1447/2883] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 20:08:09.775891 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e171ef-2f5c-4628-907a-ca212386bb65 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:09.786092 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e171ef-2f5c-4628-907a-ca212386bb65 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:09.790822 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad995c3-1668-420b-b57b-e61f129d2156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:09.791423 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad995c3-1668-420b-b57b-e61f129d2156 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:09.791734 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad995c3-1668-420b-b57b-e61f129d2156 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:09.792009 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad995c3-1668-420b-b57b-e61f129d2156 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:09.792639 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad995c3-1668-420b-b57b-e61f129d2156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:09.794523 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad995c3-1668-420b-b57b-e61f129d2156 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:09.877683 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1437/2884] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:08:09 2022] POST /identity/v3/projects => generated 359 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:08:09.882240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b909a-bb6e-4eed-95e8-0c7562dbd2ed admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:09.892409 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b909a-bb6e-4eed-95e8-0c7562dbd2ed admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:09.951143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99704a-de8a-4a53-9105-fe9c274932e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:09.951791 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99704a-de8a-4a53-9105-fe9c274932e7 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:09.952077 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99704a-de8a-4a53-9105-fe9c274932e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:09.952354 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99704a-de8a-4a53-9105-fe9c274932e7 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:09.952996 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99704a-de8a-4a53-9105-fe9c274932e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:09.954919 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99704a-de8a-4a53-9105-fe9c274932e7 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:10.020162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:08:10.118953 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1448/2885] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:08:09 2022] POST /identity/v3/users => generated 280 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:08:10.123288 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad995c3-1668-420b-b57b-e61f129d2156 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:10.134826 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad995c3-1668-420b-b57b-e61f129d2156 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:10.139393 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cab138-f70d-4581-8150-b0f1110f28b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:10.140017 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cab138-f70d-4581-8150-b0f1110f28b4 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:10.140293 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cab138-f70d-4581-8150-b0f1110f28b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:10.140565 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cab138-f70d-4581-8150-b0f1110f28b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:10.141207 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cab138-f70d-4581-8150-b0f1110f28b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:10.142800 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cab138-f70d-4581-8150-b0f1110f28b4 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:10.153960 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1438/2886] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:08:10.158143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99704a-de8a-4a53-9105-fe9c274932e7 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:10.168977 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99704a-de8a-4a53-9105-fe9c274932e7 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:10.173637 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31659d-274a-403c-93b3-45290db7c930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:10.174234 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31659d-274a-403c-93b3-45290db7c930 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:10.174518 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31659d-274a-403c-93b3-45290db7c930 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:10.174783 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31659d-274a-403c-93b3-45290db7c930 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:10.175414 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31659d-274a-403c-93b3-45290db7c930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:10.177342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31659d-274a-403c-93b3-45290db7c930 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:10.188069 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1449/2887] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:08:10.192689 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cab138-f70d-4581-8150-b0f1110f28b4 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:10.202835 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cab138-f70d-4581-8150-b0f1110f28b4 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:10.208019 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16591ae-15bd-4f84-b050-06d3bdf094c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:10.208656 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16591ae-15bd-4f84-b050-06d3bdf094c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:10.208938 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16591ae-15bd-4f84-b050-06d3bdf094c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:10.209211 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16591ae-15bd-4f84-b050-06d3bdf094c9 admin admin] PATH_INFO: `/v3/projects/d54dcdda98e7439cbfad9403dce3ee0e/users/07c73278b095470683d205c90cdd49f0/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:10.223621 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16591ae-15bd-4f84-b050-06d3bdf094c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54dcdda98e7439cbfad9403dce3ee0e, user_id=07c73278b095470683d205c90cdd49f0, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:10.226259 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16591ae-15bd-4f84-b050-06d3bdf094c9 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:10.299547 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1439/2888] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:08:10 2022] PUT /identity/v3/projects/d54dcdda98e7439cbfad9403dce3ee0e/users/07c73278b095470683d205c90cdd49f0/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:08:10.310388 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6fe16-e0c8-42b6-8714-24e5dd3ee710 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:10.310673 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6fe16-e0c8-42b6-8714-24e5dd3ee710 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:10.310944 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6fe16-e0c8-42b6-8714-24e5dd3ee710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:10.339045 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-0da6fe16-e0c8-42b6-8714-24e5dd3ee710 None None] MFA Rules not processed for user `07c73278b095470683d205c90cdd49f0`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:08:10.340370 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-0da6fe16-e0c8-42b6-8714-24e5dd3ee710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:10.407815 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1450/2889] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:08:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:08:10.444591 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16591ae-15bd-4f84-b050-06d3bdf094c9 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:10.446398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-b16591ae-15bd-4f84-b050-06d3bdf094c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:10.477025 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:08:10.503626 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16591ae-15bd-4f84-b050-06d3bdf094c9 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:10.508089 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecb1f8-ed10-43bb-8b43-a26181fc4908 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:10.508703 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecb1f8-ed10-43bb-8b43-a26181fc4908 service cinder] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:10.508986 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecb1f8-ed10-43bb-8b43-a26181fc4908 service cinder] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:10.509260 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecb1f8-ed10-43bb-8b43-a26181fc4908 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:10.518082 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ecb1f8-ed10-43bb-8b43-a26181fc4908 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:10.526353 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ecb1f8-ed10-43bb-8b43-a26181fc4908 service cinder] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:10.528440 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1440/2890] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:08:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:08:10.544568 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6fe16-e0c8-42b6-8714-24e5dd3ee710 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:10.607718 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6fe16-e0c8-42b6-8714-24e5dd3ee710 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:10.612219 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d2900-9a62-4b36-92f7-3b4cac13ca48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:10.612842 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d2900-9a62-4b36-92f7-3b4cac13ca48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:10.613631 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d2900-9a62-4b36-92f7-3b4cac13ca48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:10.613908 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d2900-9a62-4b36-92f7-3b4cac13ca48 admin admin] PATH_INFO: `/v3/users/07c73278b095470683d205c90cdd49f0` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:10.615276 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d2900-9a62-4b36-92f7-3b4cac13ca48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07c73278b095470683d205c90cdd49f0)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:10.617215 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d2900-9a62-4b36-92f7-3b4cac13ca48 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:10.771651 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-514d2900-9a62-4b36-92f7-3b4cac13ca48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07c73278b095470683d205c90cdd49f0'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:10.821005 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-514d2900-9a62-4b36-92f7-3b4cac13ca48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07c73278b095470683d205c90cdd49f0'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:10.821659 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-514d2900-9a62-4b36-92f7-3b4cac13ca48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07c73278b095470683d205c90cdd49f0'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:10.833945 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-514d2900-9a62-4b36-92f7-3b4cac13ca48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07c73278b095470683d205c90cdd49f0'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:10.835950 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:08:10.841420 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-514d2900-9a62-4b36-92f7-3b4cac13ca48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07c73278b095470683d205c90cdd49f0'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:10.847331 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1451/2891] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:08:10 2022] DELETE /identity/v3/users/07c73278b095470683d205c90cdd49f0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:08:10.852534 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4ee65-bf8a-4b6f-b5b9-f60bd8523d25 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:10.852819 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4ee65-bf8a-4b6f-b5b9-f60bd8523d25 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:10.853093 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4ee65-bf8a-4b6f-b5b9-f60bd8523d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:10.872918 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-67d4ee65-bf8a-4b6f-b5b9-f60bd8523d25 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:08:10.874137 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-67d4ee65-bf8a-4b6f-b5b9-f60bd8523d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:10.932484 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1441/2892] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:08:10.942364 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d2900-9a62-4b36-92f7-3b4cac13ca48 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:10.943802 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-514d2900-9a62-4b36-92f7-3b4cac13ca48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:11.001772 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d2900-9a62-4b36-92f7-3b4cac13ca48 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:11.005866 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29729980-1b66-4643-b591-ed0a3d51af9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:11.006474 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29729980-1b66-4643-b591-ed0a3d51af9f service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:11.006771 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29729980-1b66-4643-b591-ed0a3d51af9f service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:11.007026 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29729980-1b66-4643-b591-ed0a3d51af9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:11.016015 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29729980-1b66-4643-b591-ed0a3d51af9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:11.017446 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29729980-1b66-4643-b591-ed0a3d51af9f service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:11.027752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1452/2893] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:08:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:08:11.526625 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4ee65-bf8a-4b6f-b5b9-f60bd8523d25 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:11.528105 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-67d4ee65-bf8a-4b6f-b5b9-f60bd8523d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:11.540159 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4ee65-bf8a-4b6f-b5b9-f60bd8523d25 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:11.544756 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbab614-7ec5-4555-b7fe-6135f20e94b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:11.548100 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbab614-7ec5-4555-b7fe-6135f20e94b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:11.548100 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbab614-7ec5-4555-b7fe-6135f20e94b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:11.548100 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbab614-7ec5-4555-b7fe-6135f20e94b2 admin admin] PATH_INFO: `/v3/projects/d54dcdda98e7439cbfad9403dce3ee0e` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:11.548100 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbab614-7ec5-4555-b7fe-6135f20e94b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d54dcdda98e7439cbfad9403dce3ee0e)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:11.549046 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbab614-7ec5-4555-b7fe-6135f20e94b2 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:11.684781 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-bfbab614-7ec5-4555-b7fe-6135f20e94b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd54dcdda98e7439cbfad9403dce3ee0e', 'request_id': 'req-bfbab614-7ec5-4555-b7fe-6135f20e94b2'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:11.815493 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-bfbab614-7ec5-4555-b7fe-6135f20e94b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd54dcdda98e7439cbfad9403dce3ee0e', 'request_id': 'req-bfbab614-7ec5-4555-b7fe-6135f20e94b2'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:11.822501 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-bfbab614-7ec5-4555-b7fe-6135f20e94b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd54dcdda98e7439cbfad9403dce3ee0e', 'request_id': 'req-bfbab614-7ec5-4555-b7fe-6135f20e94b2'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:11.833772 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-bfbab614-7ec5-4555-b7fe-6135f20e94b2 admin admin] The token cache is being invalidate because project d54dcdda98e7439cbfad9403dce3ee0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:08:11.834057 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-bfbab614-7ec5-4555-b7fe-6135f20e94b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:11.834729 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-bfbab614-7ec5-4555-b7fe-6135f20e94b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:11.836182 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1442/2894] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:08:11 2022] DELETE /identity/v3/projects/d54dcdda98e7439cbfad9403dce3ee0e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:08:11.841168 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377963d-bb6e-405e-8bde-7960d2a83c84 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:11.841673 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377963d-bb6e-405e-8bde-7960d2a83c84 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:11.841762 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377963d-bb6e-405e-8bde-7960d2a83c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:11.861167 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-a377963d-bb6e-405e-8bde-7960d2a83c84 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:08:11.862379 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-a377963d-bb6e-405e-8bde-7960d2a83c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:11.922279 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1453/2895] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:08:11.931967 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465b0ef-3a78-4fc4-95d9-a1bc32728654 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:11.932336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465b0ef-3a78-4fc4-95d9-a1bc32728654 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:11.932524 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465b0ef-3a78-4fc4-95d9-a1bc32728654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:11.952410 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-e465b0ef-3a78-4fc4-95d9-a1bc32728654 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:08:11.953601 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-e465b0ef-3a78-4fc4-95d9-a1bc32728654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:11.961668 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1443/2896] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:08:11.965848 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377963d-bb6e-405e-8bde-7960d2a83c84 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:11.975735 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377963d-bb6e-405e-8bde-7960d2a83c84 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:11.980415 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca3c98-ae97-43b5-81c3-7db53b0f72cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:11.981060 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca3c98-ae97-43b5-81c3-7db53b0f72cd admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:11.981335 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca3c98-ae97-43b5-81c3-7db53b0f72cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:11.981602 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca3c98-ae97-43b5-81c3-7db53b0f72cd admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:11.982237 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca3c98-ae97-43b5-81c3-7db53b0f72cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:08:11.982537 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca3c98-ae97-43b5-81c3-7db53b0f72cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:11.984163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca3c98-ae97-43b5-81c3-7db53b0f72cd admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:11.996884 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1454/2897] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 20:08:12.001258 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465b0ef-3a78-4fc4-95d9-a1bc32728654 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:12.011337 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465b0ef-3a78-4fc4-95d9-a1bc32728654 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:12.018424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecdac1b-7dec-4c93-9435-9ec018dbd4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:12.018424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdac1b-7dec-4c93-9435-9ec018dbd4b3 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:12.018424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdac1b-7dec-4c93-9435-9ec018dbd4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:12.018424 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdac1b-7dec-4c93-9435-9ec018dbd4b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:12.018932 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecdac1b-7dec-4c93-9435-9ec018dbd4b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:12.019855 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecdac1b-7dec-4c93-9435-9ec018dbd4b3 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:12.114072 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1444/2898] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:08:12 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:08:12.118687 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca3c98-ae97-43b5-81c3-7db53b0f72cd admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:12.128617 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca3c98-ae97-43b5-81c3-7db53b0f72cd admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:12.184972 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8a7c5-819e-44a0-bb85-4792df86012f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:12.185576 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8a7c5-819e-44a0-bb85-4792df86012f admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:12.185852 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8a7c5-819e-44a0-bb85-4792df86012f admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:12.186123 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8a7c5-819e-44a0-bb85-4792df86012f admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:12.186754 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8a7c5-819e-44a0-bb85-4792df86012f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:12.188684 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8a7c5-819e-44a0-bb85-4792df86012f admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:12.278130 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1455/2899] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:08:12 2022] POST /identity/v3/users => generated 283 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 20:08:12.282249 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecdac1b-7dec-4c93-9435-9ec018dbd4b3 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:12.293546 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecdac1b-7dec-4c93-9435-9ec018dbd4b3 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:12.298134 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0667cf-2475-463c-b8f0-dfc361de8a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:12.298726 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0667cf-2475-463c-b8f0-dfc361de8a8c admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:12.299007 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0667cf-2475-463c-b8f0-dfc361de8a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:12.299282 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0667cf-2475-463c-b8f0-dfc361de8a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:12.300005 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0667cf-2475-463c-b8f0-dfc361de8a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:12.302174 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0667cf-2475-463c-b8f0-dfc361de8a8c admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:12.312010 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1445/2900] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:08:12.315905 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8a7c5-819e-44a0-bb85-4792df86012f admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:12.326158 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8a7c5-819e-44a0-bb85-4792df86012f admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:12.330914 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af19d1-b284-414d-aedb-4ccfdcdba7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:12.331512 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af19d1-b284-414d-aedb-4ccfdcdba7ad admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:12.331857 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af19d1-b284-414d-aedb-4ccfdcdba7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:12.332412 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af19d1-b284-414d-aedb-4ccfdcdba7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:12.333150 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af19d1-b284-414d-aedb-4ccfdcdba7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:12.334738 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af19d1-b284-414d-aedb-4ccfdcdba7ad admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:12.340025 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:08:12.345581 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1456/2901] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 20:08:12.355442 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0667cf-2475-463c-b8f0-dfc361de8a8c admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:12.366662 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0667cf-2475-463c-b8f0-dfc361de8a8c admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:12.371397 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8e4c7-023a-443f-a270-e1be4f64f2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:12.372112 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8e4c7-023a-443f-a270-e1be4f64f2f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:12.372398 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8e4c7-023a-443f-a270-e1be4f64f2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:12.372677 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8e4c7-023a-443f-a270-e1be4f64f2f5 admin admin] PATH_INFO: `/v3/projects/2be8ceacb7264570b3ac6904c9b8b8ce/users/550b3d2f316b4dd3b2500d4a735f5538/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:12.386384 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:08:12.390606 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8e4c7-023a-443f-a270-e1be4f64f2f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2be8ceacb7264570b3ac6904c9b8b8ce, user_id=550b3d2f316b4dd3b2500d4a735f5538, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:12.393294 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8e4c7-023a-443f-a270-e1be4f64f2f5 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:12.443819 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1446/2902] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:08:12 2022] PUT /identity/v3/projects/2be8ceacb7264570b3ac6904c9b8b8ce/users/550b3d2f316b4dd3b2500d4a735f5538/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:08:12.458770 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7d1b6-705d-430e-99e2-30b044949ded None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:12.459054 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7d1b6-705d-430e-99e2-30b044949ded None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:12.459327 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7d1b6-705d-430e-99e2-30b044949ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:12.491392 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-8eb7d1b6-705d-430e-99e2-30b044949ded None None] MFA Rules not processed for user `550b3d2f316b4dd3b2500d4a735f5538`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:08:12.492885 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-8eb7d1b6-705d-430e-99e2-30b044949ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:12.558310 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1457/2903] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:08:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:08:12.570467 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8e4c7-023a-443f-a270-e1be4f64f2f5 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:12.572219 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-77f8e4c7-023a-443f-a270-e1be4f64f2f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:12.649927 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8e4c7-023a-443f-a270-e1be4f64f2f5 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:12.653556 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16361e4-2929-4d60-8302-b4718f33a389 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2faa7ffc99948478ec7b81842139078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:12.654159 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16361e4-2929-4d60-8302-b4718f33a389 service glance] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:12.654436 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16361e4-2929-4d60-8302-b4718f33a389 service glance] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:12.654709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16361e4-2929-4d60-8302-b4718f33a389 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:12.663390 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16361e4-2929-4d60-8302-b4718f33a389 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:12.664859 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16361e4-2929-4d60-8302-b4718f33a389 service glance] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:12.673539 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1447/2904] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:08:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:08:22.555957 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=32 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:08:22.669725 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:08:39.496264 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7d1b6-705d-430e-99e2-30b044949ded None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:39.558527 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7d1b6-705d-430e-99e2-30b044949ded None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:39.563186 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23103b39-4b03-49dc-ab5e-a691b272a70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:39.563852 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23103b39-4b03-49dc-ab5e-a691b272a70e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:39.564136 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23103b39-4b03-49dc-ab5e-a691b272a70e admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:39.564410 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23103b39-4b03-49dc-ab5e-a691b272a70e admin admin] PATH_INFO: `/v3/users/550b3d2f316b4dd3b2500d4a735f5538` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:39.565533 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23103b39-4b03-49dc-ab5e-a691b272a70e admin admin] RBAC: Authorizing `identity:delete_user(user_id=550b3d2f316b4dd3b2500d4a735f5538)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:39.567448 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23103b39-4b03-49dc-ab5e-a691b272a70e admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:39.771255 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-23103b39-4b03-49dc-ab5e-a691b272a70e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '550b3d2f316b4dd3b2500d4a735f5538'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:39.809636 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-23103b39-4b03-49dc-ab5e-a691b272a70e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '550b3d2f316b4dd3b2500d4a735f5538'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:39.810249 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-23103b39-4b03-49dc-ab5e-a691b272a70e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '550b3d2f316b4dd3b2500d4a735f5538'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:39.822584 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-23103b39-4b03-49dc-ab5e-a691b272a70e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '550b3d2f316b4dd3b2500d4a735f5538'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:39.830385 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-23103b39-4b03-49dc-ab5e-a691b272a70e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '550b3d2f316b4dd3b2500d4a735f5538'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:39.836377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1458/2905] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:08:39 2022] DELETE /identity/v3/users/550b3d2f316b4dd3b2500d4a735f5538 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:08:39.841026 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce33aa-a415-4b0b-b329-f12cc63b9907 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:39.841528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce33aa-a415-4b0b-b329-f12cc63b9907 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:39.841640 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce33aa-a415-4b0b-b329-f12cc63b9907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:39.861040 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-d0ce33aa-a415-4b0b-b329-f12cc63b9907 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:08:39.862230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d0ce33aa-a415-4b0b-b329-f12cc63b9907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:39.920324 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1448/2906] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:08:39.930217 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23103b39-4b03-49dc-ab5e-a691b272a70e admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:39.931772 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-23103b39-4b03-49dc-ab5e-a691b272a70e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:39.989434 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23103b39-4b03-49dc-ab5e-a691b272a70e admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:39.993390 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1393ad-b159-4e09-bb6c-bd36571ca66d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:39.994001 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1393ad-b159-4e09-bb6c-bd36571ca66d service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:39.994286 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1393ad-b159-4e09-bb6c-bd36571ca66d service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:39.994561 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1393ad-b159-4e09-bb6c-bd36571ca66d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:40.004377 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1393ad-b159-4e09-bb6c-bd36571ca66d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:40.005834 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1393ad-b159-4e09-bb6c-bd36571ca66d service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:40.015240 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1459/2907] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:08:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:08:40.392770 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce33aa-a415-4b0b-b329-f12cc63b9907 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:40.394299 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-d0ce33aa-a415-4b0b-b329-f12cc63b9907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:40.407914 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce33aa-a415-4b0b-b329-f12cc63b9907 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:40.412574 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d4567-2c08-4c68-b42f-5e1ed0353735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:40.413209 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d4567-2c08-4c68-b42f-5e1ed0353735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:40.413485 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d4567-2c08-4c68-b42f-5e1ed0353735 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:40.413758 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d4567-2c08-4c68-b42f-5e1ed0353735 admin admin] PATH_INFO: `/v3/projects/2be8ceacb7264570b3ac6904c9b8b8ce` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:40.414884 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d4567-2c08-4c68-b42f-5e1ed0353735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2be8ceacb7264570b3ac6904c9b8b8ce)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:40.416827 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d4567-2c08-4c68-b42f-5e1ed0353735 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:40.522699 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-7a2d4567-2c08-4c68-b42f-5e1ed0353735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2be8ceacb7264570b3ac6904c9b8b8ce', 'request_id': 'req-7a2d4567-2c08-4c68-b42f-5e1ed0353735'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:40.592190 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-7a2d4567-2c08-4c68-b42f-5e1ed0353735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2be8ceacb7264570b3ac6904c9b8b8ce', 'request_id': 'req-7a2d4567-2c08-4c68-b42f-5e1ed0353735'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:40.598453 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-7a2d4567-2c08-4c68-b42f-5e1ed0353735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2be8ceacb7264570b3ac6904c9b8b8ce', 'request_id': 'req-7a2d4567-2c08-4c68-b42f-5e1ed0353735'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:40.612598 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-7a2d4567-2c08-4c68-b42f-5e1ed0353735 admin admin] The token cache is being invalidate because project 2be8ceacb7264570b3ac6904c9b8b8ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:08:40.612875 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-7a2d4567-2c08-4c68-b42f-5e1ed0353735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:40.613516 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-7a2d4567-2c08-4c68-b42f-5e1ed0353735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:08:40.615343 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1449/2908] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:08:40 2022] DELETE /identity/v3/projects/2be8ceacb7264570b3ac6904c9b8b8ce => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:08:40.621608 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c259f7-c658-4d87-842e-6b8fedf66acd None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:40.622089 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c259f7-c658-4d87-842e-6b8fedf66acd None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:40.622215 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c259f7-c658-4d87-842e-6b8fedf66acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:40.648302 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-42c259f7-c658-4d87-842e-6b8fedf66acd None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:08:40.648302 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-42c259f7-c658-4d87-842e-6b8fedf66acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:40.660494 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:08:40.702456 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1460/2909] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 20:08:40.710290 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa3749-b053-48a8-b14b-d417bbfe5f1e None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:40.710575 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa3749-b053-48a8-b14b-d417bbfe5f1e None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:40.710948 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa3749-b053-48a8-b14b-d417bbfe5f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:40.731291 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-39aa3749-b053-48a8-b14b-d417bbfe5f1e None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:08:40.732526 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-39aa3749-b053-48a8-b14b-d417bbfe5f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:40.740796 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1450/2910] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:08:40.745005 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c259f7-c658-4d87-842e-6b8fedf66acd None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:40.755068 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c259f7-c658-4d87-842e-6b8fedf66acd None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:40.759657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c98c5-2b44-434d-8724-ed7b3fb0006d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:40.760257 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c98c5-2b44-434d-8724-ed7b3fb0006d admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:40.760536 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c98c5-2b44-434d-8724-ed7b3fb0006d admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:40.760826 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c98c5-2b44-434d-8724-ed7b3fb0006d admin admin] PATH_INFO: `/v3/domains` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:40.761437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c98c5-2b44-434d-8724-ed7b3fb0006d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:08:40.761740 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c98c5-2b44-434d-8724-ed7b3fb0006d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:40.763334 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c98c5-2b44-434d-8724-ed7b3fb0006d admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:40.774693 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1461/2911] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 20:08:40.779252 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa3749-b053-48a8-b14b-d417bbfe5f1e None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:40.788617 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa3749-b053-48a8-b14b-d417bbfe5f1e None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:40.794139 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d8773-6b5d-460f-b3bb-ccaae286bdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:40.794730 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d8773-6b5d-460f-b3bb-ccaae286bdd9 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:40.795001 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d8773-6b5d-460f-b3bb-ccaae286bdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:40.795267 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d8773-6b5d-460f-b3bb-ccaae286bdd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:40.795923 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d8773-6b5d-460f-b3bb-ccaae286bdd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:40.797803 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d8773-6b5d-460f-b3bb-ccaae286bdd9 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:40.862283 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1451/2912] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:08:40 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:08:40.866785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c98c5-2b44-434d-8724-ed7b3fb0006d admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:40.877395 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c98c5-2b44-434d-8724-ed7b3fb0006d admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:40.934220 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9aa35e-6fa6-400c-a080-c4d963612527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:40.934748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9aa35e-6fa6-400c-a080-c4d963612527 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:40.935027 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9aa35e-6fa6-400c-a080-c4d963612527 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:40.935298 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9aa35e-6fa6-400c-a080-c4d963612527 admin admin] PATH_INFO: `/v3/users` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:40.935967 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9aa35e-6fa6-400c-a080-c4d963612527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:40.937891 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9aa35e-6fa6-400c-a080-c4d963612527 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:41.003357 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1462/2913] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:08:40 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:08:41.007431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d8773-6b5d-460f-b3bb-ccaae286bdd9 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:41.017721 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d8773-6b5d-460f-b3bb-ccaae286bdd9 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:41.022362 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454aad4-13c0-46ab-8353-8cc14fdc61ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:41.022952 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454aad4-13c0-46ab-8353-8cc14fdc61ff admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:41.023227 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454aad4-13c0-46ab-8353-8cc14fdc61ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:41.023499 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454aad4-13c0-46ab-8353-8cc14fdc61ff admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:41.024197 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454aad4-13c0-46ab-8353-8cc14fdc61ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:41.025904 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454aad4-13c0-46ab-8353-8cc14fdc61ff admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:41.036403 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1452/2914] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:08:41.041187 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9aa35e-6fa6-400c-a080-c4d963612527 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:41.050846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9aa35e-6fa6-400c-a080-c4d963612527 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:41.055796 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1441c-c370-4447-a854-6439b2420692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:41.056403 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1441c-c370-4447-a854-6439b2420692 admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:41.056682 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1441c-c370-4447-a854-6439b2420692 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:41.056980 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1441c-c370-4447-a854-6439b2420692 admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:41.058153 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1441c-c370-4447-a854-6439b2420692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:41.059846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1441c-c370-4447-a854-6439b2420692 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:41.070551 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1463/2915] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:08:41.075413 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454aad4-13c0-46ab-8353-8cc14fdc61ff admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:41.085262 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454aad4-13c0-46ab-8353-8cc14fdc61ff admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:41.089994 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a9362-94b1-42b2-a517-8c8121bb003c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:41.090627 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a9362-94b1-42b2-a517-8c8121bb003c admin admin] REQUEST_METHOD: `PUT` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:41.090906 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a9362-94b1-42b2-a517-8c8121bb003c admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:41.091175 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a9362-94b1-42b2-a517-8c8121bb003c admin admin] PATH_INFO: `/v3/projects/48dc83001e6b40cea7ead2af13be6d5d/users/fcd64c3467154db0a02dd035126f85f1/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:41.105752 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a9362-94b1-42b2-a517-8c8121bb003c admin admin] RBAC: Authorizing `identity:create_grant(project_id=48dc83001e6b40cea7ead2af13be6d5d, user_id=fcd64c3467154db0a02dd035126f85f1, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:41.108454 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a9362-94b1-42b2-a517-8c8121bb003c admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:41.174544 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1453/2916] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:08:41 2022] PUT /identity/v3/projects/48dc83001e6b40cea7ead2af13be6d5d/users/fcd64c3467154db0a02dd035126f85f1/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:08:41.186342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09941d-ae43-4442-ac00-da747c8d385a None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:41.186574 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09941d-ae43-4442-ac00-da747c8d385a None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:41.186849 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09941d-ae43-4442-ac00-da747c8d385a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:41.215146 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-4d09941d-ae43-4442-ac00-da747c8d385a None None] MFA Rules not processed for user `fcd64c3467154db0a02dd035126f85f1`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:08:41.216386 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4d09941d-ae43-4442-ac00-da747c8d385a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:41.280994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1464/2917] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:08:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:08:41.293141 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a9362-94b1-42b2-a517-8c8121bb003c admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:41.294911 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-2d4a9362-94b1-42b2-a517-8c8121bb003c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:41.317668 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:08:41.352714 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a9362-94b1-42b2-a517-8c8121bb003c admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:41.357152 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f303cb-a0f2-43ac-8b26-90bf301f0745 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2faa7ffc99948478ec7b81842139078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:41.357785 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f303cb-a0f2-43ac-8b26-90bf301f0745 service glance] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:41.358060 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f303cb-a0f2-43ac-8b26-90bf301f0745 service glance] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:41.358330 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f303cb-a0f2-43ac-8b26-90bf301f0745 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:41.367017 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f303cb-a0f2-43ac-8b26-90bf301f0745 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:41.368670 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f303cb-a0f2-43ac-8b26-90bf301f0745 service glance] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:41.378334 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1454/2918] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:08:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:08:51.278163 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:08:51.449431 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=17 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:08:58.100781 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09941d-ae43-4442-ac00-da747c8d385a None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:08:58.102183 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-4d09941d-ae43-4442-ac00-da747c8d385a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:58.171942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09941d-ae43-4442-ac00-da747c8d385a None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:08:58.176864 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27babdd-e4fa-485c-88c5-869a10dd85d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6942a851a69b446e90a2b138f4482465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:08:58.177470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27babdd-e4fa-485c-88c5-869a10dd85d3 service placement] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:08:58.177746 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27babdd-e4fa-485c-88c5-869a10dd85d3 service placement] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:08:58.178018 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27babdd-e4fa-485c-88c5-869a10dd85d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:08:58.179764 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-b27babdd-e4fa-485c-88c5-869a10dd85d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:08:58.191607 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27babdd-e4fa-485c-88c5-869a10dd85d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:08:58.193162 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27babdd-e4fa-485c-88c5-869a10dd85d3 service placement] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:08:58.204342 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1465/2919] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:08:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:09:05.680528 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f303cb-a0f2-43ac-8b26-90bf301f0745 service glance] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:09:05.742030 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f303cb-a0f2-43ac-8b26-90bf301f0745 service glance] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:09:05.746877 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f49ccd-cdbc-47fc-aa6d-2afdbde17c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:09:05.747505 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f49ccd-cdbc-47fc-aa6d-2afdbde17c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:05.747806 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f49ccd-cdbc-47fc-aa6d-2afdbde17c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:05.748075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f49ccd-cdbc-47fc-aa6d-2afdbde17c00 admin admin] PATH_INFO: `/v3/users/fcd64c3467154db0a02dd035126f85f1` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:05.749304 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f49ccd-cdbc-47fc-aa6d-2afdbde17c00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcd64c3467154db0a02dd035126f85f1)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:09:05.751311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f49ccd-cdbc-47fc-aa6d-2afdbde17c00 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:09:06.087093 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-25f49ccd-cdbc-47fc-aa6d-2afdbde17c00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcd64c3467154db0a02dd035126f85f1'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:09:06.157313 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-25f49ccd-cdbc-47fc-aa6d-2afdbde17c00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcd64c3467154db0a02dd035126f85f1'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:09:06.157936 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-25f49ccd-cdbc-47fc-aa6d-2afdbde17c00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcd64c3467154db0a02dd035126f85f1'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:09:06.165235 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-25f49ccd-cdbc-47fc-aa6d-2afdbde17c00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcd64c3467154db0a02dd035126f85f1'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:09:06.177627 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-25f49ccd-cdbc-47fc-aa6d-2afdbde17c00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcd64c3467154db0a02dd035126f85f1'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:09:06.183532 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1455/2920] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:09:05 2022] DELETE /identity/v3/users/fcd64c3467154db0a02dd035126f85f1 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:09:06.188303 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73944ade-bbc8-4ba5-9d83-dc6b55fe985e None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:06.188811 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73944ade-bbc8-4ba5-9d83-dc6b55fe985e None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:06.188922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73944ade-bbc8-4ba5-9d83-dc6b55fe985e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:06.208981 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-73944ade-bbc8-4ba5-9d83-dc6b55fe985e None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:09:06.210187 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-73944ade-bbc8-4ba5-9d83-dc6b55fe985e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:09:06.274678 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1466/2921] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:09:06.284538 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f49ccd-cdbc-47fc-aa6d-2afdbde17c00 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:09:06.285931 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-25f49ccd-cdbc-47fc-aa6d-2afdbde17c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:09:06.342411 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f49ccd-cdbc-47fc-aa6d-2afdbde17c00 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:09:06.345933 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fe587-d5ea-4039-8807-1f0a5275371b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:09:06.346535 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fe587-d5ea-4039-8807-1f0a5275371b service neutron] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:06.346809 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fe587-d5ea-4039-8807-1f0a5275371b service neutron] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:06.347075 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fe587-d5ea-4039-8807-1f0a5275371b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:06.356832 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fe587-d5ea-4039-8807-1f0a5275371b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:09:06.358310 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fe587-d5ea-4039-8807-1f0a5275371b service neutron] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:09:06.368086 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1456/2922] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:09:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:09:06.736735 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73944ade-bbc8-4ba5-9d83-dc6b55fe985e None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:09:06.738312 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-73944ade-bbc8-4ba5-9d83-dc6b55fe985e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:09:06.754205 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73944ade-bbc8-4ba5-9d83-dc6b55fe985e None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:09:06.757937 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ada5e-da13-46f4-a194-3465c6193b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:09:06.759442 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ada5e-da13-46f4-a194-3465c6193b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:06.759763 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ada5e-da13-46f4-a194-3465c6193b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:06.760035 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ada5e-da13-46f4-a194-3465c6193b72 admin admin] PATH_INFO: `/v3/projects/48dc83001e6b40cea7ead2af13be6d5d` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:06.761376 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ada5e-da13-46f4-a194-3465c6193b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48dc83001e6b40cea7ead2af13be6d5d)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:09:06.763846 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ada5e-da13-46f4-a194-3465c6193b72 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:09:06.860165 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-244ada5e-da13-46f4-a194-3465c6193b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48dc83001e6b40cea7ead2af13be6d5d', 'request_id': 'req-244ada5e-da13-46f4-a194-3465c6193b72'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:09:06.917264 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-244ada5e-da13-46f4-a194-3465c6193b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48dc83001e6b40cea7ead2af13be6d5d', 'request_id': 'req-244ada5e-da13-46f4-a194-3465c6193b72'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:09:06.923785 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-244ada5e-da13-46f4-a194-3465c6193b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48dc83001e6b40cea7ead2af13be6d5d', 'request_id': 'req-244ada5e-da13-46f4-a194-3465c6193b72'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:09:06.935755 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-244ada5e-da13-46f4-a194-3465c6193b72 admin admin] The token cache is being invalidate because project 48dc83001e6b40cea7ead2af13be6d5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:09:06.936049 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-244ada5e-da13-46f4-a194-3465c6193b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:09:06.936695 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-244ada5e-da13-46f4-a194-3465c6193b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:09:06.938175 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1467/2923] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:09:06 2022] DELETE /identity/v3/projects/48dc83001e6b40cea7ead2af13be6d5d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:09:06.943099 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da2466-ba71-4344-9137-9d4192858a8f None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:06.943647 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da2466-ba71-4344-9137-9d4192858a8f None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:06.943756 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da2466-ba71-4344-9137-9d4192858a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:06.964758 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-39da2466-ba71-4344-9137-9d4192858a8f None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:09:06.966018 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-39da2466-ba71-4344-9137-9d4192858a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:09:06.984161 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:09:07.025478 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1457/2924] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:09:07.034058 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7028bff-66a2-47af-9280-30150bb71e57 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:07.034341 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7028bff-66a2-47af-9280-30150bb71e57 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:07.034625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7028bff-66a2-47af-9280-30150bb71e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:07.054717 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-f7028bff-66a2-47af-9280-30150bb71e57 None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:09:07.055947 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-f7028bff-66a2-47af-9280-30150bb71e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:09:07.064202 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1468/2925] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:09:07.068379 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da2466-ba71-4344-9137-9d4192858a8f None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:09:07.078207 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da2466-ba71-4344-9137-9d4192858a8f None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:09:07.082927 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58814453-631e-411f-a72f-0a9672ec0274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:09:07.083522 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58814453-631e-411f-a72f-0a9672ec0274 admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:07.083830 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58814453-631e-411f-a72f-0a9672ec0274 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:07.084098 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58814453-631e-411f-a72f-0a9672ec0274 admin admin] PATH_INFO: `/v3/domains` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:07.084734 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58814453-631e-411f-a72f-0a9672ec0274 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 20:09:07.085029 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58814453-631e-411f-a72f-0a9672ec0274 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:09:07.086596 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58814453-631e-411f-a72f-0a9672ec0274 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:09:07.099903 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1458/2926] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Sep 14 20:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 20:09:07.104074 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7028bff-66a2-47af-9280-30150bb71e57 None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:09:07.113892 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7028bff-66a2-47af-9280-30150bb71e57 None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:09:07.118772 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b6e6d-7af1-4050-aa50-e8ec5b72ce89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:09:07.119358 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b6e6d-7af1-4050-aa50-e8ec5b72ce89 admin admin] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:07.119658 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b6e6d-7af1-4050-aa50-e8ec5b72ce89 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:07.119927 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b6e6d-7af1-4050-aa50-e8ec5b72ce89 admin admin] PATH_INFO: `/v3/projects` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:07.120587 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b6e6d-7af1-4050-aa50-e8ec5b72ce89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:09:07.122485 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b6e6d-7af1-4050-aa50-e8ec5b72ce89 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:09:07.127238 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:09:07.227236 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1469/2927] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Sep 14 20:09:07 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:09:07.231316 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58814453-631e-411f-a72f-0a9672ec0274 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:09:07.242825 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58814453-631e-411f-a72f-0a9672ec0274 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:09:07.299277 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac03084-66c4-4868-9088-fa8267e10d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:09:07.299916 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac03084-66c4-4868-9088-fa8267e10d28 admin admin] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:07.300191 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac03084-66c4-4868-9088-fa8267e10d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:07.300570 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac03084-66c4-4868-9088-fa8267e10d28 admin admin] PATH_INFO: `/v3/users` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:07.301201 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac03084-66c4-4868-9088-fa8267e10d28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:09:07.303127 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac03084-66c4-4868-9088-fa8267e10d28 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:09:07.403388 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1459/2928] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Sep 14 20:09:07 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 20:09:07.408498 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b6e6d-7af1-4050-aa50-e8ec5b72ce89 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:09:07.418824 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b6e6d-7af1-4050-aa50-e8ec5b72ce89 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:09:07.424230 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09a326-b7bc-4ddd-96e8-4f74d76fda5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:09:07.424486 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09a326-b7bc-4ddd-96e8-4f74d76fda5f admin admin] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:07.424768 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09a326-b7bc-4ddd-96e8-4f74d76fda5f admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:07.425040 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09a326-b7bc-4ddd-96e8-4f74d76fda5f admin admin] PATH_INFO: `/v3/roles` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:07.425681 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09a326-b7bc-4ddd-96e8-4f74d76fda5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:09:07.427273 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09a326-b7bc-4ddd-96e8-4f74d76fda5f admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:09:07.437805 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1470/2929] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:09:07.441752 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac03084-66c4-4868-9088-fa8267e10d28 admin admin] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:09:07.452185 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac03084-66c4-4868-9088-fa8267e10d28 admin admin] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:09:07.456917 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024e65a-fb38-400b-b394-5b5b237c87fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:09:07.457524 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024e65a-fb38-400b-b394-5b5b237c87fd admin admin] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:07.457807 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024e65a-fb38-400b-b394-5b5b237c87fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:07.458079 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024e65a-fb38-400b-b394-5b5b237c87fd admin admin] PATH_INFO: `/v3/roles` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:07.458718 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024e65a-fb38-400b-b394-5b5b237c87fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:09:07.460338 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024e65a-fb38-400b-b394-5b5b237c87fd admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:09:07.471697 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1460/2930] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Sep 14 20:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 20:09:07.475665 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09a326-b7bc-4ddd-96e8-4f74d76fda5f admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:09:07.485777 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09a326-b7bc-4ddd-96e8-4f74d76fda5f admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:09:07.490657 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3b350-fd2d-4941-8500-8bc233c75850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:09:07.491304 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3b350-fd2d-4941-8500-8bc233c75850 admin admin] REQUEST_METHOD: `PUT` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:07.491625 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3b350-fd2d-4941-8500-8bc233c75850 admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:07.491908 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3b350-fd2d-4941-8500-8bc233c75850 admin admin] PATH_INFO: `/v3/projects/0fc07a8b764a448f878fbbebf1a5172d/users/81ec842e8a6949a7bfc0fee6c64c96b8/roles/f63dc07e563f4ffb9f88aa95c528da47` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:07.507510 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3b350-fd2d-4941-8500-8bc233c75850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc07a8b764a448f878fbbebf1a5172d, user_id=81ec842e8a6949a7bfc0fee6c64c96b8, role_id=f63dc07e563f4ffb9f88aa95c528da47)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:09:07.510175 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3b350-fd2d-4941-8500-8bc233c75850 admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:09:07.581082 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1471/2931] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Sep 14 20:09:07 2022] PUT /identity/v3/projects/0fc07a8b764a448f878fbbebf1a5172d/users/81ec842e8a6949a7bfc0fee6c64c96b8/roles/f63dc07e563f4ffb9f88aa95c528da47 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 20:09:07.593328 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80821ef-0d05-4619-bd46-63f95b46b93f None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:07.593617 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80821ef-0d05-4619-bd46-63f95b46b93f None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:07.593891 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80821ef-0d05-4619-bd46-63f95b46b93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:07.621482 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-a80821ef-0d05-4619-bd46-63f95b46b93f None None] MFA Rules not processed for user `81ec842e8a6949a7bfc0fee6c64c96b8`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:09:07.622687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-a80821ef-0d05-4619-bd46-63f95b46b93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:09:07.688131 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1461/2932] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:09:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:09:07.699014 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3b350-fd2d-4941-8500-8bc233c75850 admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:09:07.700761 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-9fe3b350-fd2d-4941-8500-8bc233c75850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:09:07.759044 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3b350-fd2d-4941-8500-8bc233c75850 admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:09:07.762721 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e12dc-932b-4206-887a-29ea9d382cdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe18c9b67d814fbba4614cf7491e136e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:09:07.763335 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e12dc-932b-4206-887a-29ea9d382cdb service cinder] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:07.763643 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e12dc-932b-4206-887a-29ea9d382cdb service cinder] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:07.764589 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e12dc-932b-4206-887a-29ea9d382cdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:07.773301 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e12dc-932b-4206-887a-29ea9d382cdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:09:07.774715 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e12dc-932b-4206-887a-29ea9d382cdb service cinder] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:09:07.783904 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1472/2933] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:09:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:09:09.626687 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf27b71-41c3-47bd-832c-473058927974 None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:09.627397 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf27b71-41c3-47bd-832c-473058927974 None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:09.627397 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf27b71-41c3-47bd-832c-473058927974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:09.645910 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-7cf27b71-41c3-47bd-832c-473058927974 None None] MFA Rules not processed for user `81ec842e8a6949a7bfc0fee6c64c96b8`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:09:09.647095 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-7cf27b71-41c3-47bd-832c-473058927974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:09:09.653853 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1462/2934] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:09:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:09:10.222492 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e12dc-932b-4206-887a-29ea9d382cdb service cinder] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:09:10.228198 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-6c5e12dc-932b-4206-887a-29ea9d382cdb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:09:10.302437 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e12dc-932b-4206-887a-29ea9d382cdb service cinder] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:09:10.307404 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a27bb-15da-42fc-9b69-61b7393b152e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6942a851a69b446e90a2b138f4482465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:09:10.308049 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a27bb-15da-42fc-9b69-61b7393b152e service placement] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:10.308330 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a27bb-15da-42fc-9b69-61b7393b152e service placement] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:10.308606 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a27bb-15da-42fc-9b69-61b7393b152e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:10.310337 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-b92a27bb-15da-42fc-9b69-61b7393b152e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:09:10.321748 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a27bb-15da-42fc-9b69-61b7393b152e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:09:10.323294 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a27bb-15da-42fc-9b69-61b7393b152e service placement] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:09:10.333709 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1473/2935] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:09:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:09:19.640550 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:09:20.059767 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf27b71-41c3-47bd-832c-473058927974 None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:09:20.061228 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-7cf27b71-41c3-47bd-832c-473058927974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:09:20.134642 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf27b71-41c3-47bd-832c-473058927974 None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:09:20.140417 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58db7a-3aec-43b5-a99b-56f0257f5371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f6cc846b342918a177d2794eb3db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:09:20.141260 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58db7a-3aec-43b5-a99b-56f0257f5371 service nova] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:20.141666 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58db7a-3aec-43b5-a99b-56f0257f5371 service nova] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:20.141941 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58db7a-3aec-43b5-a99b-56f0257f5371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:20.143819 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0c58db7a-3aec-43b5-a99b-56f0257f5371 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:09:20.156413 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58db7a-3aec-43b5-a99b-56f0257f5371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:09:20.158143 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58db7a-3aec-43b5-a99b-56f0257f5371 service nova] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:09:20.168709 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1463/2936] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:09:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:09:20.329204 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=79,keystone:INSERT=2 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:09:27.282649 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36592017-61b0-4c19-98cd-c3351e1c263c None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:27.283231 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36592017-61b0-4c19-98cd-c3351e1c263c None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:27.283404 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36592017-61b0-4c19-98cd-c3351e1c263c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:27.341147 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-36592017-61b0-4c19-98cd-c3351e1c263c None None] MFA Rules not processed for user `15fbda6263b44352b3ac560372bef725`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:09:27.342408 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-36592017-61b0-4c19-98cd-c3351e1c263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:09:27.413724 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1474/2937] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Sep 14 20:09:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:09:27.533196 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58db7a-3aec-43b5-a99b-56f0257f5371 service nova] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:09:27.534631 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-0c58db7a-3aec-43b5-a99b-56f0257f5371 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:09:27.624376 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58db7a-3aec-43b5-a99b-56f0257f5371 service nova] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:09:27.629659 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f3dc0-4c7c-4e99-b032-e014e82ce808 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee56bf9af257486e94e6ff1b33086f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:09:27.630261 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f3dc0-4c7c-4e99-b032-e014e82ce808 service swift] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:27.630537 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f3dc0-4c7c-4e99-b032-e014e82ce808 service swift] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:27.630807 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f3dc0-4c7c-4e99-b032-e014e82ce808 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:27.638833 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f3dc0-4c7c-4e99-b032-e014e82ce808 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:09:27.640434 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f3dc0-4c7c-4e99-b032-e014e82ce808 service swift] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:09:27.649251 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1464/2938] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Sep 14 20:09:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 20:09:28.499502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5586c-8fc0-4daa-9c49-c2ff2d29cd7f None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:28.500010 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5586c-8fc0-4daa-9c49-c2ff2d29cd7f None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:28.500127 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5586c-8fc0-4daa-9c49-c2ff2d29cd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:28.519994 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-00e5586c-8fc0-4daa-9c49-c2ff2d29cd7f None None] MFA Rules not processed for user `15fbda6263b44352b3ac560372bef725`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:09:28.521208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-00e5586c-8fc0-4daa-9c49-c2ff2d29cd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:09:28.529553 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1475/2939] 10.222.0.15 () {58 vars in 967 bytes} [Wed Sep 14 20:09:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:09:28.540696 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f3dc0-4c7c-4e99-b032-e014e82ce808 service swift] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:09:28.551958 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f3dc0-4c7c-4e99-b032-e014e82ce808 service swift] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:09:28.557128 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d4450-c60d-4c69-ac7e-80409fe27992 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee56bf9af257486e94e6ff1b33086f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:09:28.557742 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d4450-c60d-4c69-ac7e-80409fe27992 service swift] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:28.558027 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d4450-c60d-4c69-ac7e-80409fe27992 service swift] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:28.558298 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d4450-c60d-4c69-ac7e-80409fe27992 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:28.567406 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d4450-c60d-4c69-ac7e-80409fe27992 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:09:28.569021 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d4450-c60d-4c69-ac7e-80409fe27992 service swift] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:09:28.576986 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1465/2940] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Sep 14 20:09:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 20:09:29.195285 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87706e1e-8c57-482e-93d4-8bcf444f9729 None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:29.195652 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87706e1e-8c57-482e-93d4-8bcf444f9729 None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:29.195933 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87706e1e-8c57-482e-93d4-8bcf444f9729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:29.215237 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-87706e1e-8c57-482e-93d4-8bcf444f9729 None None] MFA Rules not processed for user `15fbda6263b44352b3ac560372bef725`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:09:29.216470 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-87706e1e-8c57-482e-93d4-8bcf444f9729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:09:29.224599 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1476/2941] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Sep 14 20:09:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:09:29.236603 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d4450-c60d-4c69-ac7e-80409fe27992 service swift] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:09:29.247644 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d4450-c60d-4c69-ac7e-80409fe27992 service swift] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:09:29.252889 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e7e20-5fba-4d65-9ef7-84f3377a87ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee56bf9af257486e94e6ff1b33086f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:09:29.253488 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e7e20-5fba-4d65-9ef7-84f3377a87ee service swift] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:29.253783 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e7e20-5fba-4d65-9ef7-84f3377a87ee service swift] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:29.254042 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e7e20-5fba-4d65-9ef7-84f3377a87ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:29.262010 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e7e20-5fba-4d65-9ef7-84f3377a87ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:09:29.263633 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e7e20-5fba-4d65-9ef7-84f3377a87ee service swift] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:09:29.272362 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1466/2942] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Sep 14 20:09:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 20:09:29.826302 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d39bbd-c044-4c78-a192-af96b4b7f92c None None] REQUEST_METHOD: `POST` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:29.826729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d39bbd-c044-4c78-a192-af96b4b7f92c None None] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:29.826879 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d39bbd-c044-4c78-a192-af96b4b7f92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:29.846245 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.auth.core [None req-96d39bbd-c044-4c78-a192-af96b4b7f92c None None] MFA Rules not processed for user `15fbda6263b44352b3ac560372bef725`. Rule list: `[]` (Enabled: `True`). {{(pid=93545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:09:29.847448 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-96d39bbd-c044-4c78-a192-af96b4b7f92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:09:29.854869 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1477/2943] 10.222.0.15 () {58 vars in 967 bytes} [Wed Sep 14 20:09:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:09:29.868311 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e7e20-5fba-4d65-9ef7-84f3377a87ee service swift] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:09:29.880302 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e7e20-5fba-4d65-9ef7-84f3377a87ee service swift] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:09:29.885336 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521d9dc-eb1f-416f-9551-5ef931ae629e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee56bf9af257486e94e6ff1b33086f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:09:29.885953 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521d9dc-eb1f-416f-9551-5ef931ae629e service swift] REQUEST_METHOD: `GET` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:29.886230 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521d9dc-eb1f-416f-9551-5ef931ae629e service swift] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:29.886501 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521d9dc-eb1f-416f-9551-5ef931ae629e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:29.894847 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521d9dc-eb1f-416f-9551-5ef931ae629e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:09:29.896496 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521d9dc-eb1f-416f-9551-5ef931ae629e service swift] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:09:29.904546 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1467/2944] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Sep 14 20:09:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 20:09:32.561942 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d39bbd-c044-4c78-a192-af96b4b7f92c None None] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:09:32.627730 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d39bbd-c044-4c78-a192-af96b4b7f92c None None] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:09:32.632116 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa9ce7-0b70-46cc-afe0-a65fd4a221de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:09:32.632752 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa9ce7-0b70-46cc-afe0-a65fd4a221de admin admin] REQUEST_METHOD: `DELETE` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:32.633028 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa9ce7-0b70-46cc-afe0-a65fd4a221de admin admin] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:32.633299 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa9ce7-0b70-46cc-afe0-a65fd4a221de admin admin] PATH_INFO: `/v3/users/81ec842e8a6949a7bfc0fee6c64c96b8` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:32.634433 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa9ce7-0b70-46cc-afe0-a65fd4a221de admin admin] RBAC: Authorizing `identity:delete_user(user_id=81ec842e8a6949a7bfc0fee6c64c96b8)` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:09:32.636361 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa9ce7-0b70-46cc-afe0-a65fd4a221de admin admin] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:09:32.850891 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:09:32.852411 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-55aa9ce7-0b70-46cc-afe0-a65fd4a221de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81ec842e8a6949a7bfc0fee6c64c96b8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:09:32.951502 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-55aa9ce7-0b70-46cc-afe0-a65fd4a221de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81ec842e8a6949a7bfc0fee6c64c96b8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:09:32.952106 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-55aa9ce7-0b70-46cc-afe0-a65fd4a221de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81ec842e8a6949a7bfc0fee6c64c96b8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:09:32.965034 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-55aa9ce7-0b70-46cc-afe0-a65fd4a221de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81ec842e8a6949a7bfc0fee6c64c96b8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:09:32.971913 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.notifications [None req-55aa9ce7-0b70-46cc-afe0-a65fd4a221de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81ec842e8a6949a7bfc0fee6c64c96b8'} {{(pid=93545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:09:32.977693 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1478/2945] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Sep 14 20:09:32 2022] DELETE /identity/v3/users/81ec842e8a6949a7bfc0fee6c64c96b8 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:09:32.982177 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eca6be-cbf0-4c88-99d6-8d19b18147fd None None] REQUEST_METHOD: `POST` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:32.982679 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eca6be-cbf0-4c88-99d6-8d19b18147fd None None] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:32.982782 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eca6be-cbf0-4c88-99d6-8d19b18147fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:33.003377 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.auth.core [None req-32eca6be-cbf0-4c88-99d6-8d19b18147fd None None] MFA Rules not processed for user `10fb21e5e3c84511bf4f1b659ae7154b`. Rule list: `[]` (Enabled: `True`). {{(pid=93544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 20:09:33.004650 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-32eca6be-cbf0-4c88-99d6-8d19b18147fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:09:33.013805 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=100 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:09:33.063050 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1468/2946] 10.222.0.15 () {58 vars in 958 bytes} [Wed Sep 14 20:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 20:09:33.073488 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa9ce7-0b70-46cc-afe0-a65fd4a221de admin admin] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:09:33.074922 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-55aa9ce7-0b70-46cc-afe0-a65fd4a221de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:09:33.142880 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa9ce7-0b70-46cc-afe0-a65fd4a221de admin admin] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:09:33.146534 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2c55f-28ea-403a-a20a-c2f0d9a87f13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221300017882415ca3a7c9192343b956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:09:33.147143 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2c55f-28ea-403a-a20a-c2f0d9a87f13 service neutron] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:33.147421 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2c55f-28ea-403a-a20a-c2f0d9a87f13 service neutron] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:33.147729 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2c55f-28ea-403a-a20a-c2f0d9a87f13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:33.156590 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2c55f-28ea-403a-a20a-c2f0d9a87f13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:09:33.158509 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2c55f-28ea-403a-a20a-c2f0d9a87f13 service neutron] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:09:33.167819 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1479/2947] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:09:33.449918 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eca6be-cbf0-4c88-99d6-8d19b18147fd None None] Authenticating user token {{(pid=93544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:09:33.451404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.fernet_utils [None req-32eca6be-cbf0-4c88-99d6-8d19b18147fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:09:33.465401 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eca6be-cbf0-4c88-99d6-8d19b18147fd None None] Validating token access rules against request {{(pid=93544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:09:33.471014 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d60184-af8e-40c3-9e0f-fcaedafa5e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fb21e5e3c84511bf4f1b659ae7154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de7968443f1e4b4a80b77215071336a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:09:33.471775 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d60184-af8e-40c3-9e0f-fcaedafa5e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:09:33.472122 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d60184-af8e-40c3-9e0f-fcaedafa5e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:09:33.472996 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d60184-af8e-40c3-9e0f-fcaedafa5e44 admin admin] PATH_INFO: `/v3/projects/0fc07a8b764a448f878fbbebf1a5172d` {{(pid=93544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:09:33.474427 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d60184-af8e-40c3-9e0f-fcaedafa5e44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc07a8b764a448f878fbbebf1a5172d)` {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:09:33.476363 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d60184-af8e-40c3-9e0f-fcaedafa5e44 admin admin] RBAC: Authorization granted {{(pid=93544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:09:33.592296 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c8d60184-af8e-40c3-9e0f-fcaedafa5e44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc07a8b764a448f878fbbebf1a5172d', 'request_id': 'req-c8d60184-af8e-40c3-9e0f-fcaedafa5e44'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:09:33.682591 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c8d60184-af8e-40c3-9e0f-fcaedafa5e44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc07a8b764a448f878fbbebf1a5172d', 'request_id': 'req-c8d60184-af8e-40c3-9e0f-fcaedafa5e44'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:09:33.688753 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c8d60184-af8e-40c3-9e0f-fcaedafa5e44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc07a8b764a448f878fbbebf1a5172d', 'request_id': 'req-c8d60184-af8e-40c3-9e0f-fcaedafa5e44'} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:09:33.699966 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c8d60184-af8e-40c3-9e0f-fcaedafa5e44 admin admin] The token cache is being invalidate because project 0fc07a8b764a448f878fbbebf1a5172d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 20:09:33.700259 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c8d60184-af8e-40c3-9e0f-fcaedafa5e44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:09:33.700904 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG keystone.notifications [None req-c8d60184-af8e-40c3-9e0f-fcaedafa5e44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 20:09:33.702404 dv-cinder-839768-8-smb devstack@keystone.service[93544]: [pid: 93544|app: 0|req: 1469/2948] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Sep 14 20:09:33 2022] DELETE /identity/v3/projects/0fc07a8b764a448f878fbbebf1a5172d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 20:09:43.163704 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=39,keystone:INSERT=1,keystone:DELETE=3 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:09:43.696838 dv-cinder-839768-8-smb devstack@keystone.service[93544]: DEBUG dbcounter [-] [93544] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:14:03.041828 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2c55f-28ea-403a-a20a-c2f0d9a87f13 service neutron] Authenticating user token {{(pid=93545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 20:14:03.043094 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-31f2c55f-28ea-403a-a20a-c2f0d9a87f13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:14:03.184208 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2c55f-28ea-403a-a20a-c2f0d9a87f13 service neutron] Validating token access rules against request {{(pid=93545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 20:14:03.242761 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1bf77-5bca-4b8d-8cf2-22fed9172dfb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6942a851a69b446e90a2b138f4482465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e3e0c278ce94ce3a132496923eef365', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 20:14:03.243367 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1bf77-5bca-4b8d-8cf2-22fed9172dfb service placement] REQUEST_METHOD: `GET` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 20:14:03.243670 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1bf77-5bca-4b8d-8cf2-22fed9172dfb service placement] SCRIPT_NAME: `/identity` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 20:14:03.243940 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1bf77-5bca-4b8d-8cf2-22fed9172dfb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 20:14:03.245908 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.fernet_utils [None req-ceb1bf77-5bca-4b8d-8cf2-22fed9172dfb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 20:14:03.256976 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1bf77-5bca-4b8d-8cf2-22fed9172dfb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 20:14:03.258510 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1bf77-5bca-4b8d-8cf2-22fed9172dfb service placement] RBAC: Authorization granted {{(pid=93545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 20:14:03.268582 dv-cinder-839768-8-smb devstack@keystone.service[93545]: [pid: 93545|app: 0|req: 1480/2949] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Sep 14 20:14:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 20:14:13.264082 dv-cinder-839768-8-smb devstack@keystone.service[93545]: DEBUG dbcounter [-] [93545] Writing DB stats keystone:SELECT=89 {{(pid=93545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}